I have this issue when I misclick while in inventory since I also run more than one monitor like you.

I do have to ask, how does it effect combat for you? You don't have a mouse pointer while using tools or weapons. My only guess is that maybe you are opening inventory during combat? If so, while we wait for an exclusive full screen a band aid fix for the time being would be to add consumables to the hot bar.