Rhythmbox plugin: A method to sift and remove duplicate songs?

[scrawl]

Latest version pushed to bzr. Changelog:

- Fixed #579902 (Problem when using show bothh option and more than 2 duplicates)
- Fixed #579911 (importing multiple files at once triggers duplicate check several times)
- Also recognizes not 100% exact entries as duplicates by stripping common parts like "feat.", "vs.", "presents", "&", "and" ... (for example "A & B - Foo bar" and "A and B - Foo bar" will be recognized)
- Before checking, the filters in the library source are resetted so we really get all entries in the source

[mihai.ile]

This is great, today is the day I actually used the plugin
Removed about 150MB of duplicates

Oh and to download directly from the launchpad, while in

~/.gnome2/rhythmbox/plugins

just do:

bzr branch lp:rb-duplicate-source duplicate-source

[The Real Dave]

Edit: Those error messages should be fixed with this patch: replace line ~239 (new_entry = self.db.entry_new(self.entry_type, symlink_file_rb ) in __init__.py with

			# Make sure the entry is not existing already
			if self.db.entry_lookup_by_location(symlink_file_rb) == None:
				new_entry = self.db.entry_new(self.entry_type, symlink_file_rb )
			else:
				return

I edited the file, and ran Rhythmbox. Before I manually cleared out most of the duplicates (~2500), with the plugin enabled, Rhythmbox would just lock up. I later found out, after removing the duplicates by hand, that it's duplicating the duplicates. For example, I have one duplicate album at the moment, which the plugin has found almost 400 times. I've checked, and I definitely don't have 400 copies

Though I don't exactly need this plugin anymore, I'll gladly help test new versions and that

[scrawl]

I edited the file, and ran Rhythmbox. I later found out, after removing the duplicates by hand, that it's duplicating the duplicates. For example, I have one duplicate album at the moment, which the plugin has found almost 400 times. I've checked, and I definitely don't have 400 copies

This should be fixed in the newest release (- Fixed #579911 (importing / removing multiple files at once triggers duplicate check several times), did you already have that one or did you just edit the previous version?

[CheshireMac]

I'm actually having an issue regarding imports . . . when I imported my music to RhythmBox, all the files were duplicated in the library. I'm curious if there's a way to delete the duplicates without sifting through thousands of songs . . .

[scrawl]

Please try a newer version, its fixed there: http://scrawl.bplaced.net/duplicate-source.tar.gz

[The Real Dave]

This should be fixed in the newest release (- Fixed #579911 (importing / removing multiple files at once triggers duplicate check several times), did you already have that one or did you just edit the previous version?

Ah, my apologies, I had the previous version

[Garthhh]

just download the archive provided in the earlier post and unpack it. Then you have to put the "duplicate-source" folder inside ~/.gnome2/rhythmbox/plugins/ folder. If it does not exist, create it.
Then, in rhythmbox just activate the plugin (Edit->Plugins)

After a little you should have a source called Duplicates (just like in the screenshots in this thread) if you actually have duplicated files in your library.

Hi this look great
but I'm noob & having a bit of trouble installing
I downloaded the file from the 67th post
where do I find?
~/.gnome2/rhythmbox/plugins/ folder.



But don't see it in the list of plug ins on rhythm box

thanks for your hard work

[mihai.ile]

Ok, just start a terminal and use this command to install it:

wget http://scrawl.bplaced.net/duplicate-source.tar.gz -O tmp.tar.gz && mkdir -vp ~/.gnome2/rhythmbox/plugins/duplicate-source/ && tar -xf tmp.tar.gz -C ~/.gnome2/rhythmbox/plugins && rm -v tmp.tar.gz

What it does:
-download the plugin into tmp.tar.gz file
-create ~/.gnome2/rhythmbox/plugins/
-extract the plugin
-remove the downloaded tmp.tar.gz file

Then just restart Rhythmbox and check if you have it in the plugins list.

Hope it helps.

[Garthhh]

Ok, just start a terminal and use this command to install it:

wget http://scrawl.bplaced.net/duplicate-source.tar.gz -O tmp.tar.gz && mkdir -vp ~/.gnome2/rhythmbox/plugins/duplicate-source/ && tar -xf tmp.tar.gz -C ~/.gnome2/rhythmbox/plugins && rm -v tmp.tar.gz

What it does:
-download the plugin into tmp.tar.gz file
-create ~/.gnome2/rhythmbox/plugins/
-extract the plugin
-remove the downloaded tmp.tar.gz file

Then just restart Rhythmbox and check if you have it in the plugins list.

Hope it helps.

That worked
I probably have several 1000's of duplicates
this will help me make a dent in them
some are a little trickier to find
same album, one just numbered tracks, or some with the track number in the title
sometimes I'll trade back up discs & basically have to pick through for what I don't have
or suffer the consequences if I import en mass
it would be cool to set up queries with multiple rules
sort of a duplicate smart playlist

how would have I done the install through the GUI?

I also have music-applet-2.5.1 tar.gz which is a lot like foxytunes I hope
I'm looking for onscreen controls with less clicks
stop me before I hyjack some more