Set up shop somewhere less well defended and keep them out while you build/craft/farm/smelt/etc chores. Ive got about 40 by doing nothing more than letting them mind my base while I do whatever. My base seems to attract every dwarf in a 10000 meter radius, though.