Smash the mast with your axe, but do it in shallow water before you do, and clear out your inventory to allow instant material pick up.