Twins v0.4 released.

[SOULRiDER]

Here is the latest version of my program. Im still planning on adding more options in the future but for now this is it.

Description:
Twins is a program that scans directories looking for identical files and lists them for their easy identification. Twins was written in python. Latest version is 0.4

Changes since last version:

new in 0.4
FIXED: A file would appear to be a duplicate when it was scanned and then re-scanned if being pointed by one or more symlinks.
FIXED: Bug where the program kept scanning the same directories in an endless loop.

Usage:

twins [options] [target directory]
 OPTIONS:
        -s, --slent                 Do not be verbose, only show final report.
        -r, --recursive             Be recursive, enter subdirectories.
        -h, --include-hidden        Scan hidden files, if recursive will scan hidden directories.
        -l, --follow-links          Follow symlinks.

I hope everyone likes it and finds it useful. If you have any comments please let me know here or by e-mail. My address is located in the source of the program.


Also, if someone is familiar with making deb packages i would like to ask for their help so I can easily distribute this and eventually if possible get it in the repos.

[Note360]

ooh... looks cool. looks cool I need soemthign to scan for duplicate songs for me, but thats more of an id3 thing

One mroe suggestion. It would be cool if you did something liek modularize it and seperate the single executables up. Alot of people prefer this method.

[compwiz18]

Looks great!

I'm trying it now on my external drive. I know it has a lot of duplicates on it...

Thanks!

I can make a deb for it, if you would like. Just post a reply and I'll get to it.

[compwiz18]

Traceback (most recent call last):
  File "twins.py", line 158, in <module>
    findDupes(parameters[-1])
  File "twins.py", line 72, in findDupes
    findDupes(fullPath)
  File "twins.py", line 72, in findDupes
    findDupes(fullPath)
  File "twins.py", line 48, in findDupes
    for element in dircache.listdir(path):
  File "/usr/lib/python2.5/dircache.py", line 27, in listdir
    list = os.listdir(path)
OSError: [Errno 13] Permission denied: '/media/external-1/backups/files/lost+found'

When it hits a folder it doesn't have permissions for, it dies, taking all the collected MD5 sums with it...

[SOULRiDER]

Ok, i think ive fixed it. I still havnt really read about handling errors so i will probably have to improve it int he future, but this should do it for now.

Also, a deb would be great but I will im trying to modularize the program now so i will be releasing a new version later. Thanks for trying it out, i really apreciate it!!

[compwiz18]

Cool.

If you want me to make a deb of it when you release the new version, just stick a post on this thread.

[SOULRiDER]

I will, thanks man!

[erfahren]

Ran it on my /home directory and saw how much of a pack-rat I am!

it would be cool if something like this could eventually be incorporated with a program (command line or GUI) with the ability to find and remove those hidden backup files (ending with ~) and clear out the ~/.thumbnails directory.

works well though. thanks!

[Harpoon]

This is a much need tool, and thank you for the good work.

I used it for a quick check on a small directory (no hidden files/permission problems) and it worked as advertised.

Ran it against a larger directory using -r (with lots of dupes) and it worked a hitch.

Just for "fun" I ran it against my /etc directory (figured there would be few dupes, but at least some other potential problems) and got:

hashing output interspersed with a few messages similar to this one:
Error opening file for reading: [Errno 13] Permission denied: '/etc/apt/trustdb.gpg' - Skipping

it continues to scan. Great.

Then the fatal:
Hashing /etc/cups/raw.types...
...done hashing. MD5Sum is: 8d45496cddd485f6d9a894321fcd4028

Traceback (most recent call last):
File "twins", line 158, in <module>
findDupes(parameters[-1])
File "twins", line 72, in findDupes
findDupes(fullPath)
File "twins", line 72, in findDupes
findDupes(fullPath)
File "twins", line 48, in findDupes
for element in dircache.listdir(path):
File "/usr/lib/python2.5/dircache.py", line 27, in listdir
list = os.listdir(path)
OSError: [Errno 13] Permission denied: '/etc/cups/ssl'

and it terminates. I don't know if it found any dupes (doubt it).

Hope this is useful to you. I've been away from programming way too long to offer fix suggestions.

[Note360]

I think I can handle the error if you want... It shouldnt be that hard just a simple try except OSError