I had exactly the same problem with a Nautilus window opening on every restart. To get rid of it I went to System Settings -> Startup and Shutdown -> Session Management. In the "On Login" section...