Having the same issue; me and a friend on PC have the same world, but friend on Xbox has something completely different and is walking around in the sky.

The game just became available for Xbox so I'm assuming it's just a bug with crossplay (we also had a lot of issues getting Xbox player connected in the first place), so hopefully more people will report the issue and it'll get fixed in the next patch.