I've seen that issue only for Birch so far, and it is a tree you'd want to plant purely for aesthetics. Oaks, on the other hand, are go-to for farming Fine Wood, and seem to give up to 3 seeds from a fell tree, so unless you're fantastically unlucky, it is possible to cultivate dozens. Just make sure you space them charitably to avoid saplings from withering.