I think lox riding is a lot of fun, and therefore worth it. That's just my opinion, though.

While you cannot attack from loxback (since horseback is a word, loxback is, too), the lox can trample things, including enemies.

The wiki article on lox[valheim.fandom.com] has more details about the benefits of lox riding.