Results 1 to 3 of 3

Thread: rsync small and large files

  1. #1
    Join Date
    Mar 2011
    Location
    California
    Beans
    59

    rsync small and large files

    So I have 140gigs worth of family photos and videos. I have unlimited storage with a domain. So I would like to use that storage to back up these files. I already have a local backup so now I would like a backup in the cloud. I have read on rsync and that seems the way I would like to go.

    I will probably do something like
    Code:
     rsync -e 'ssh -p 1234' -azv /directory/blahblah  blah@blah.com:/directory/blahblah
    I'll probably need to run this for a while or stop it and continue. My concern is how rsync handles large files... if I stop the backup in the middle of a large file will I be able to just continue where it left off or will it restart? I'm hoping I don't have to be baby sit too much. Should I always run rsync with --partial?

    Advice? Thanks in advance.

  2. #2
    Join Date
    Feb 2009
    Location
    Dallas, TX
    Beans
    7,651
    Distro
    Ubuntu 16.04 Xenial Xerus

    Re: rsync small and large files

    Hi Mr.Dee.

    Quote Originally Posted by Mr.Dee View Post
    I have read on rsync and that seems the way I would like to go.
    I like rsync a lot, and I use it extensively. However, let me point out some cons, just so you have a more complete picture:
    • Although it can be used as a backup tool, its main purpose is mirroring, so for actual backup tool it would need more scripting (full backup, incremental, differential, etc).
    • rsync works almost flawlessly on a LAN, but the game changes for a large transfer over the Internet (see link below).
    • Most cloud services don't allow rsync to them. You can rsync to your cloud local drive, like UbuntuOne or Dropbox, but in general you can't rsync directly. AFAIK, only paid services allow it, like Amazon S3 for example.

    Quote Originally Posted by Mr.Dee View Post
    if I stop the backup in the middle of a large file will I be able to just continue where it left off or will it restart
    Yes, but not by itself, you would need to script it (see link example below).
    Quote Originally Posted by Mr.Dee View Post
    Should I always run rsync with --partial?
    I would recommend it, yes.

    Take a look at this thread. There are both rsync options and scripting to take care of these concerns.

    I hope that helps. Let us know how it goes.
    Regards.

  3. #3
    Join Date
    Mar 2011
    Location
    California
    Beans
    59

    Re: rsync small and large files

    thanks for your reply papibe, and for the link to that thread. So far rsync has been working ok. I have debian server I am uploading to. I'll start adding --partial and consider keepalive. So far everything has been stable. I've run rsync for up to 8 hours without trouble.
    Last edited by Mr.Dee; October 22nd, 2012 at 06:55 PM. Reason: argg i spelled it as sever, meant server. The most common misspell lol.

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •