I checked out the screenshots on your profile.

CRAZY!

But it should all be shelter, I agree. Something is happening due to distances involved for sure.

Maybe start building internal floors up, see how close to roof you need to get to be "sheltered."