Usually if you break the ship while standing next to the mast with one of your weapons, you will grab all the materials and you can just rebuild it. If you are in shallow water you can just break it anywhere, only thing you have to worry about are the nails sinking and if the water is too deep you can loose them.