Try running:


sudo /usr/lib/emacsen-common/emacs-remove xemacs21