Originally posted by Honorable_D:

Yeah it slowly drops over the hours. Exit game and load back into it to restore some FPS again.

You also lose performance the more you build in one area.