Turns out yeah it happens only while world-saving, thank you all.