The problem might be the stonewalls... a friend and I figured a lot of stone walls can make the game pretty unstable in fps.

Thats why I never use them anymore and use the hoe to alter terrain to act as my wall.

And use them very rarely for building.