it fills faster if you are taking consecutive hits quickly, once filled you stagger back a few steps. i believe damage takes part also, more notably critical strikes that land more damage than the shield can mitigate. higher the crit the more stagger bar is filled.

edit: this is most noticeable in the plains when up against Fulings