After the first time i died falling off my roof... guess what I did? I built some scaffolding. I even started placing temporary ladders against my 45 degree roofs.
After that if I died falling off my roof, I could only blame myself, and not the skill loss penalty mechanic.