So.... why dont you build a protecting wall before you start the building?

Ps: little and normal greydwarfs are afraid of fire.