First of all, it does happen, just like some chambers or crypts can sometimes be empty or ridiculously small.

Second, sometimes doors are hard to see and require you to break the wall. If there is a window to a room you haven't visited it's a hint that there is a hidden door somewhere.