After kpkeerthi's suggestion I additionally had to install the package
gstreamer0.10-fluendo-mp3 until it worked. On the banshee-website they say by the way.

Wrong information, sorry ... it...