Spam alt+enter a few times to try and force the game into actual full screen mode.