Now I have tried installing with the partition stuff both manually and with the LVM things and it seems to go faster during the rest of the installation when I choose to setup manually. Do I need the LVM stuff?
Personal choice imo. If you aren't adding drives often you can do fine without LVM. I don't use it on my server because it added more complexity for me.