When I was loading the SSL I had to go back and forth. I am not really sure if my SSL has a passphrase.

when I checked mods-enabled/ssl.conf
SSLPassPhraseDialog exec:/usr/share/apache2/ask-for-passphrase

does that load passphrase when apache restarted? If it does, I dont get prompted for passphrase... however, I do get bus errors if I stop using the site.