Funny, I've tried it exactly the other way, padded helmet and leggins with Fenris chest. You're not the fastest, but much faster than in full padded. And the armor value is still decent.