tree seeds were added later to let you replant near your home after losing your favorite trees to trolls or whatnot. Its not mean for farming bulk trees; like thistle or mushrooms or berries you are supposed to range out and explore to gather wood.

like it or not, the devs want you to explore, and they attempt to force it upon you by limiting your ability to grow everything at home and rarely leave your home.