Usually it happens during the night. Try to mine during the day and at first look around if there is not the dwarf nest (spawning point of dwarves) or stone ruins (around it they are also large group). And dwarves don't like the fire - try to place some around the deposite.