Results 1 to 4 of 4

Thread: rsync script is quite slow - thoughts?

  1. #1
    Join Date
    Nov 2009
    Location
    Portland, OR
    Beans
    42
    Distro
    Xubuntu 13.04 Raring Ringtail

    rsync script is quite slow - thoughts?

    I've been using rsync to back up my home folder, my music, my movies, and my crontab to an external hard drive.

    I made a similar little script with the intention of adding any new music I've put on my computer to an ipod (running rockbox).

    The script currently looks like this:

    rsync -avrz --delete /home/paul/Music/A /media/BOX
    rsync -avrz --delete /home/paul/Music/B /media/BOX

    It works, but when building the incremental file list it takes a really long time running through the appx. twenty-five gigs of files. In fact, it takes almost as long as it takes for me to just copy the same set of files from the hard drive to the ipod. Any way I can increase the speed here? I'm not seeing anything promising in the man pages.

  2. #2
    Join Date
    Nov 2007
    Location
    London, England
    Beans
    7,699

    Re: rsync script is quite slow - thoughts?

    Try adding option
    Code:
    --modify-window=5
    .
    I've seen this suggested before. I believe that NTFS only stores timestamps with 2-second accuracy, so that files might appear to rsync to be modified at different times, which will then force a full read and bytewise compare which is time consuming.

  3. #3
    Join Date
    Nov 2009
    Location
    Portland, OR
    Beans
    42
    Distro
    Xubuntu 13.04 Raring Ringtail

    Re: rsync script is quite slow - thoughts?

    The Ipod's drive is formatted as FAT but it's definitely running faster. (Took about three minutes instead of half an hour.)

    It's showing some "invalid argument" errors for files which are somesong.flac.ehf4 or anothersong.mp3.ey7r aren't transferring. I guess the .ehf4 is some sort of appellation from rsync?

  4. #4
    Join Date
    Nov 2009
    Location
    Portland, OR
    Beans
    42
    Distro
    Xubuntu 13.04 Raring Ringtail

    Re: rsync script is quite slow - thoughts?

    Figured out the failure to transfer. Scanned over the ones that didn't transfer and they all have wacky punctuation in their titles.

    So, yeah, should be good to go. Thanks so much for the suggestion.

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •