Not that difficult with wolf/iron gear I have now, but I agree if I had bronze/troll gear it would be a problem. You can get two of them following you at the same time. I think the spawn rate should be lowered. Or maybe they only come out at night?