I don't know if they "steal" it as picking it up, but they certainly will destroy anything you've planted if it is whithin eyesight. So a pole fence will not deter them. You have to build a full wall that obscures vision.