Turns out that in the sounds settings area, you have to choose a specific output device with some devices, unless you use paprefs as per the below.

Maybe this will help someone one day..
...