I've never seen enemies attack earthen walls, as they are terrain modification and not a construction menu object. Same goes for trenches. Basically, if you make a steep enough terrain wall, they cannot modify or path through them but will hit anything they can reach or throw far enough to reach.*
They will attack every other type of construction though, if they cannot directly attack a player.

*drakes are exempt from this, they just fly over it and ignore terrain.