They don't like people cutting down their wood...or messing with their copper. So yeah, greydwarves are constantly griefing you. Fortunately after a few upgrades of bronze gear they're no trouble to kill.