They won't spawn in the building area around a workbench. Best to build one somewhere in the Meadows far from any other biome, and build a house around it. As you progress you may want to wall off an area around your house, farm, beehives and other stuff.