I agree. Need to be able to hire a farmer after you plant and harvest your first carrot. He'll plant and reseed automatically. A serving wench after you build the cauldron. She'll cook what ever foods you specify if you have the materials to make them. A herdsman you can hire after you breed your first boar. He'll feed your livestock what ever they need to breed as long as you have it in stock and cull the excess animals. A drover you can hire after you build your first cart. He'll haul ore automatically overland from one specified chest to another specified chest. A sailor that will do the same with ore but over water from one chest to another. Archers that you can hire to defend your base after your first troll raid.

When they aren't working they walk around inside your lodge or sit in the chairs. I have lots and lots of coins and nothing to spend them on.

Interesting ideas, but rather lore unfriendly. You are supposed the be a Viking warrior brought back to life to kill the 'monsters'. All those that came before you (from reading the standing stones) were warriors as well.

So not really a place for farmers and herdsmen.

And the Dvergr are not human, but mystical so they don't really count.

I think you should be able to build these little runestones that spawn in a viking spirit or something that you can put gear on. Then they guard the area.
Even better if it consumes bone fragments or something.

Mods already exist for this.
Also, there are Dvergr in the Mistlands if you refuse to mod.