I've been using sudo apt-get autoremove since I started using Ubuntu with 11.04. I haven't noticed any ill-effect.

One request: when you post something like "I see some people had issues after...