When I was loading the SSL I had to go back and forth. I am not really sure if my SSL has a passphrase.
when I checked mods-enabled/ssl.conf
does that load passphrase when apache restarted? If it does, I dont get prompted for passphrase... however, I do get bus errors if I stop using the site.