An easier fix is to add /usr/lib/firefox to /etc/ld.so.conf and to run ldconfig (as root). This will also work for the applet. (Tested that for SVN.)

I've added a more detailed description to the bug report in Launchpad: https://launchpad.net/ubuntu/+source/firefox/+bug/26436