Has anyone noticed that you have do the right click, turn volume up trick multiple times?

Sometimes if I make a skype to skype call, hang up & then call a cell phone (and vice versa), the volume goes back low again. I then have to do the right click, turn volume up. Anyone know why this is?

Thanks