Yeah, after a few play-thrus I ended up getting mods and now use this one that allows you to plant most stuff at your base. It’s a QoL/time saver for me:

https://www.nexusmods.com/valheim/mods/1042?tab=description

Skal!