Damage seems RNG to a range. Skill increases are small so it isn't really too obvious when you level up. When you really notice it is when you hit a "break point" where suddenly it only takes two hits to chop down the tree rather than 3. Bow skill vs trolls really illustrates this well.

Alternatively it becomes painful when a death puts you back below that break point ha ha.