Golems respawn, going away and sleeping pretty much ensures they'll be there again when you get back. If it's too much to clear and fight in one day then find another alter I guess.

Nothing fights moder for you btw, or any boss - bosses are factioned to all except player.