The Problem:
When you connect Windows Remote Desktop, you'll notice that ALL sound devices - on board sound cards, USB sound cards, the WheatNet-IP audio driver - EVERY audio device is replaced by the OS with "Remote Sound." This is Windows funneling the sound from the remote computer to play out of the speakers of the computer you are remoting in from. It looks like this:
The Solution:
Before connecting, go to Local Resources. click Settings under Remote Audio and select "Play on remote computer." This will keep the local PC sound devices from being taken over by RDP.