I haven't even noticed much a real difference having levelled up skills, there are no traits locked to a certain level or anything so it doesn't really matter.