I don't think you're being logged out. I think X is crashing. When X restarts it will take you to the login screen.