Yes, you can install Xubuntu using UNetbootin: once you have installed it, it will prompt you to chose between Ubuntu, Kubuntu or Xubuntu. Chose what you like...

To completely remove Windows you should check this out.