I've also noticed this
But I can't even manually change the output to headphones. I cannot find such an option anywhere. Neither in sound preferences, nor in alsamixer.
I know I chose the option...