Weird,
When I jump between worlds I remain where I logged in/out, not the starting spawn point.

But yes, all new characters will start at the initial starting point, but once you move it should keep your position.

Is the game saving before you swap worlds?

Hit F5 and type save for quick save to keep location.