Just uninstall anything you don't think you need. Synaptic will have discriptions for most apps so if it doesn't seem important you can uninstall it. Just try to avoid things like lib*, ect...

Another option is to just try Lubuntu instead. You'd probably have a better time if you did.