No consequence. i personally enjoy punching Hugin every once in a while, sometimes it seems to be the only way he actually leaves even after you talk to him.