An easier way, in lieu of building from source, is to use PPAs.

4.6.4 appears to be available in this PPA.
Information on adding and using PPAs can be found here.

If you're looking for the...