Page 1 of 2 12 LastLast
Results 1 to 10 of 14

Thread: rsync won't transfer some files

  1. #1
    Join Date
    Apr 2009
    Beans
    9

    rsync won't transfer some files

    I'm doing an rsync -aHK from one 8.04 server to another 8.04 server as root over ssh, transferring about 60 gb. I've found that it isn't transferring everything though.

    If I do a diff of the two folders I find that I'm missing 18000 files.

    Am I using the wrong arguments on rsync? Will files with certain permissions not transfer over rsync with ssh?

    The full scenario is I have an email server running zimbra. I do an rsync of the live directory while email is up. Shut down zimbra, do a second rsync to get the changes and then start it back up. That one works fine. I get a functional backup with all the appropriate files intact. The problem is happening when I do an rsync of the backup to a second server. I'm at a loss.

    Anyone have ideas of what I can look for?

  2. #2
    Join Date
    Apr 2009
    Beans
    9

    Re: rsync won't transfer some files

    Did I post this thread in the wrong spot for it to be seen by the right people?

  3. #3
    Join Date
    Feb 2009
    Location
    Dallas, TX
    Beans
    7,277
    Distro
    Ubuntu 14.04 Trusty Tahr

    Re: rsync won't transfer some files

    A few questions:

    Are the machines' clocks well set?
    The last rsync is from ext4 to ext4? or there's NTFS mixed in there?

    Could you post the actual commands you are using?

    Regards.

  4. #4
    Join Date
    Oct 2005
    Location
    Al Ain
    Beans
    8,164

    Re: rsync won't transfer some files

    Howdy,

    Try -v and -n to see what is going on.

    Also try unison.

  5. #5
    Join Date
    Apr 2009
    Beans
    9

    Re: rsync won't transfer some files

    I checked the time on both servers. They are both set correctly. Both servers are using ext3, there is no ntfs anywhere in transfer.

    The exact command I ran from within the directory I want to transfer is:

    rsync -aKH ./* root@server.name.com:/opt/zimbra/

    I don't know if doing a transfer with -v will be useful. It looks like there are about 700,000 files in the source folder.

    A thought I just had, probably wrong, but could I be causing the problem by using ./* instead of putting in a full path?

  6. #6
    Join Date
    Nov 2008
    Location
    Metro Boston
    Beans
    10,247
    Distro
    Kubuntu 14.04 Trusty Tahr

    Re: rsync won't transfer some files

    Quote Originally Posted by jhuhmann View Post
    rsync -aKH ./* root@server.name.com:/opt/zimbra/
    Try using just "." instead of "./*".

    I find just using -a is sufficient. Do you actually have hard links (-H)? What purpose does (-K) serve? It isn't especially clear from the rsync man page.
    Last edited by SeijiSensei; October 10th, 2011 at 04:16 PM.

  7. #7
    Join Date
    Apr 2009
    Beans
    9

    Re: rsync won't transfer some files

    I'm in the midst of trying another rsync will the full path instead of ./*

    Is using ./* redundant? Does it mean something different than . does?

  8. #8
    Join Date
    May 2011
    Beans
    159
    Distro
    Xubuntu

    Re: rsync won't transfer some files

    I use this to backup entire proxy box
    Code:
    rsync -avz --progress /  hostname@lan.ip.address.here:~
    it works great.

  9. #9
    Join Date
    Nov 2008
    Location
    Metro Boston
    Beans
    10,247
    Distro
    Kubuntu 14.04 Trusty Tahr

    Re: rsync won't transfer some files

    Quote Originally Posted by jhuhmann View Post
    I'm in the midst of trying another rsync will the full path instead of ./*

    Is using ./* redundant? Does it mean something different than . does?
    Typing "ls ." shows me the current directory. Typing "ls ./*" recurses through the subdirectories. Since the "-a" switch to rsync invokes recursion automatically, I'm not sure that ./* adds anything.

    Try running "rsync -avn ." and "rsync -avn ./*" from the same directory. You'll see a list of the files that would be transferred. Do they differ?

  10. #10
    Join Date
    Apr 2009
    Beans
    9

    Re: rsync won't transfer some files

    Quote Originally Posted by SeijiSensei View Post

    I find just using -a is sufficient. Do you actually have hard links (-H)? What purpose does (-K) serve? It isn't especially clear from the rsync man page.
    I'm not doing -aHK because I have any particular insight into what it does, or a great deal of knowledge about what I'm doing. I'm doing it mostly because the zimbra open source forums have almost everyone doing the same thing. I'm operating loosely from this. I can only assume that Zimbra is using hard links in however they do their setup.

Page 1 of 2 12 LastLast

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •