Found out today that activating the menu screen does not pause the game. I had a raid while having the menu screen up. The ground shook and i saw some stone debris fly by me while in my home. I unpaused and went out to dispatch the Trolls. I guess you learn something new every day :-)