I agree entirely with you, Tekk. At a skill level of 100[or even 99], you'll lose 5 levels sliding back to 95. To bring that back up to where it was...takes a bit, then the loss of lower level skills dropping back to nearly 0.

I think the 1 skill level drop to be more than enough to help 'balance' risky or inadvertent behavior, I concur. Dropping a few levels due to home construction, fun? not so much...