I am currently using Ubuntu 11.10 as my VM server's host, and am noticing that the machine is not as quick as it should be, even with no VMs running. The machine runs an Intel E6600 Core2Duo 2.4GHz chip and 8GB of DDR 3 RAM. Moving windows around is laggy, and apps don't load as quick as I would expect.

I suspect some of this is down to Nvidia drivers, and some of the speed issues are also affecting my VMs.

What I am wondering is this: would I be better moving to another host OS for Virtualbox, or is the issue something that is fixable?

I am happy to move to Debian etc, or I also have licenses for Windows XP/Vista/7 and 2k8 Server if anyone things that the driver support would be better here?

I just want a stable/fast host for the VMs.