My game is only 20 odd hours in - so barely noticeable (a micro stutter). Can see it could get worse in a very large settlement, but with the game being so small, have you tried moving it to an SSD (assuming it's installed on HDD)? Maybe that could help?