This seems like something that is very obvious. Why wouldn't you try destroying them with a hammer first when the hammer is how you created them?

Stone piles I think are handy in mines as you don't need a workbench to make them and you can just leave them there. Both types of piles (plus fine/core wood piles) are also handy for quick and temporary storage, for the same reason of not requiring a workbench to build.