Using Ubuntu 22.04 with Gnome 42.9
Applications > Settings > Sound > Output Device
I have HDMI HD Audio & Headphones & JVC Headset Bluetooth.
Play a song from Rhythmbox and toggle dynamically...