Are you using the special attack? On an Xbox controller that would be the right button. You have to use it before they jump at you.