They'll just keep swimming all the way around, best to wall off the entire coast. Unfortunately that makes boat access a little tricky, but you can place gates in the water to act as boat gates.