Just configure your audio input to the device that is your mic, and set the others to pulse in skypes configuration.