The devs intend that you will have to continue making foraging trips to keep everything stocked up. The only way around that is with a mod. But it doesn't really factor into where you put your base for other reasons.

Raspberries and blueberries aren't a big issue later on, but you will want to mark every nearby mushroom patch you find on your map. There is a high quality food recipe later in the game that uses a lot of them.

Hmm...if you have the materials to make a fermenter and a cauldron you should be starting your own farm by now. Look at your forge recipes. Maybe chop down a tall pine tree.