Originally posted by Jitatha:

I just put a red cross on those I have explored

I take my mace out and destroy the green lamps at the entrance to mark an already explored crypt. That way I already know visually without any extra map markers