Don't fight the terrain, change it!

You can use a pickaxe along the side of a steep mountain to make a trail just wide enough to walk on. If the lower side is steep enough, then they can't climb up to your level. Then shoot down at them with a bow.

Once they're gone, you can use the hoe to raise the ground near your grave so you've not swimming the whole way.