Did the world save just as you entered the teleport? Maybe you arrived in a previously saved state.. ie with less fish.