Best defense for me has always been to charge in and melee. If they're busy trying to hit you, they're not thinking about your buildings or animals. Archery is not nearly as strong in this game as people want to believe it is.