Maybe it's something that should be in Suggestion & Ideas.
I suppose maybe an left doubleklick could be added for just taking 1 out from the inventory.