AHOC said that most (if not all) of the USB anomalies on Ryzen is because of Infinity Fabric instability. You may need to scale back your memory speed and loosen the timings.

I saw some while I had my CPU Undervolted to the limit (To the point where I was actually black screening rarely) and bumped the voltage back up a bit closer to stock. I think I've had one instance of a USB dropout since, and that very well could have been something else.