In case you're interested, that's configurable behaviour. The assumption of the default is that you're plugging something in because you want to use...
Open settings and then the Sound tab. There you can reduce the System Volume level. And also reduce the volume levels for System Sounds. I reduce the...
The computer in question is a Dell micro PC. It's an older model so the power supply in integrated rather than an external laptop type power supply....