You don't need workbenches. A campfire will do just fine and they won't be attacked. Frost arrows are good for slowing Growths. You don't really need anything special to kill them. They don't come in starred varieties and they don't have a lot of health. Killing them is no different than killing a blob in the Swamp.