Go a little further. In my game we had to go just a little further away from spawn than what you have done. Im guessing the next island you find going AWAY from spawn, will have swamp on it