Originally posted by Zep Tepi:

There is a button you press to make it do that. Was it ctrl or was it shift?
Anyway sounds like it thinks you are pressing that button.

Left-shift for keyboard, LB for controller. It's not a toggle and it's not tied to caps lock, so it sounds like OP was either holding it down or has a problem with their input device.