At this point, I no longer suspect the switch. It seems that the switch works much better after the machine has been on for a while. If the machine is powered off over night, it takes 10-15 minutes to get it started. Once the machine has been up for a while, it seems to turn on more reliably.

So at this point, we suspect the power supply, and have ordered a replacement from Amazon.