Use a ward to help a liitle in that, and as shake said , offline players buildings will not become some kinds of "invencible" structures to not being attacked , thats a thing that maybe u imagined from other place not in valheim
Monsters only attack if a player are close to the structures