According to the wiki, each hit to a barnacle has a 10% chance of triggering the leviathan to submerge. So every 10 whacks should do the trick, but you can get lucky and keep going.