In my searches, I came across this topic that indicated that high xorg memory usage isn't abnormal. However, if the 90MB that this user indicated is "high", then my memory usage is astronomical....