Primary attack on the pick will hit the ground beneath your feet.
Alt-attack with an axe will, too.

Primary attack with any hammer other than the building hammer (which has no attack) will perform an AoE attack on the ground in front of you.

I'm not saying you're wrong, just pointing out that there are workarounds.