You are probably not unlucky but also not supposed so scale every other rock, unless you want a high vantage point to see further. Near the shore you can get pretty jagged terrain, but if you go deeper its still high rocks but now on flat / hilly terrain.