Originally posted by Happy:

Sounds like a Grey Dwarf infestation to me. They will occasionally trickle in from the forest to attack planted crops, very common.

The shamans specifically. The poison the spray goes thru the fences and gets em. Its a stinker but make your garden extra wide and plant near the center to defend against it.