Results 1 to 3 of 3

Thread: rsync intermittent failures

  1. #1
    Join Date
    Aug 2010
    Location
    Lancs, United Kingdom
    Beans
    1,533
    Distro
    Ubuntu Mate 16.04 Xenial Xerus

    rsync intermittent failures

    As per this thread I am backing up a website using rsynch thus:
    Code:
    rsync -avz --copy-links user@some-ftp.site.com: .
    Intermittently it fails with:
    Code:
    receiving file list ... Write failed: Broken pipe
    
    rsync: connection unexpectedly closed (0 bytes received so far) [Receiver]
    rsync error: unexplained error (code 255) at io.c(226) [Receiver=3.1.1]
    When it succeeds, it takes roughly 40 minutes. When it fails, it takes 2 hours 11 mins (always) and the error message is as above (always). The pattern over the last 10 nights has been:
    Success, Success, Fail, Success, Success, Success, Fail, Success, Fail, Fail.

    Sometimes it might work 7 nights in a row, or fail for 3 or 4 in a row. Are there any suggestions that might help me reduce the failure rate? I have no control over the remote system's configuration.

  2. #2
    Join Date
    Mar 2010
    Location
    Squidbilly-Land
    Beans
    18,883
    Distro
    Ubuntu Mate 16.04 Xenial Xerus

    Re: rsync intermittent failures

    Is the connection working through an ssh connection? ssh has been the default mode for network-ed rsync for a long time.
    Check the stability of the local network --> internet and likewise the remote server network --> internet.
    Some firewalls will close connections after 60 minutes. I've come across this in a corporate setup when they added a firewall rule to disconnect connections after 24 hrs without asking anyone. Some of our servers were in different network zones based on risk mitigation efforts. In the software, we had to setup a keep-alive setting from the client to the server. ssh has this as an option, controllable by the client.

  3. #3
    Join Date
    Aug 2010
    Location
    Lancs, United Kingdom
    Beans
    1,533
    Distro
    Ubuntu Mate 16.04 Xenial Xerus

    Re: rsync intermittent failures

    @TheFu Thanks for your reply. Yes it is ssh. Your suggestions are worth looking into - I will do this.

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •