Not just workbenches, but torches, campfires, fermenters, kilns, windmills, and so on prevent spawns within 20m. I've had an island base for hundreds of hours completely immune to spawns/raids.
You either missed a spot or have a mod effecting things.