If you opt into Steam Input you can make a template that is "disabled" aka everything unbound and then select that in games you want to mute the controller in.
Under setting and controller i believe. can't remember.

but unplug the controller is just easier, i had the same thing happened while having my wheel connect,my character would start turning,