Start keeping your tames in doors. The most challenging so far is the Lox for the aggro damages your builds, especially the stable you built for it.