The only skill I find having a noticeable impact is jumping.

However with no reduction to fall damage, it usually just results in spine cracking landings.

I've died many more times to fall damage while building, than I have to combat with mobs.