Check auth.log and syslog to see what it says.