I had this same problem while trying to get my second video card (ATI HD5450) working.
Manually installing the driver from a fresh ubuntu install worked for me...just skip past my moaning and read...