Should not matter. but if you put workbench down, get rid of it and they will return. Also they should respawn in a new location close to that area.