That's kinda what I thought you might find.....the internal USB hardware that serves all such ancillary functions (such as WiFi, and keyboards and trackpads, etc) seamlessly starts to have a tummy ache when saturated by the high volume data capabilities of the USB C / Thunderbolt 3 external interfaces when heavily tasked.
Your testing certainly points in that direction....have you submitted this to Apple yet?
