Well this is becoming more interesting all the time. I have had my suspicions that this is some how tied into rhythmbox. So I deleted all of the plugins that I could find. This did not fix the problem. However, when I went into the sound settings I discovered that my 2 Airport Expresses and my Apple TV on the network are considered to be output devices.
I have no idea how this happened. How would you suggest that I remove these as sound output devices?