Are you going out at night? That would make it a fair bit harder. There could also be a spawner nearby (purple glowy thing).