Take your stuff with you, then it won't be entirely from the beginning.

Also it's impossible for the Elder to spawn anywhere other than the Black Forest, but sometimes there can be other biomes nearby that interfere.