Originally posted by gutlor:

So, what am I supposed to do? Run off till they completely destroy everything then come back and rebuild it with a moat? Start a new game and concentrate on all defenses first?

they target you first (unless there is another enemy they dont like)
the golden rule is like Ailes wrote

they come for you - if you stay inside a building they will wreck it until they can reach you