You can begin to find swamps 2km from world center. Whether you can walk or need to sail depends on your world seed. If you have a long starting island, you may find a swamp without having to sail.