bug-parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

GNU Parallel Bug Reports how can i use parallel for rsync


From: zhao chenzhou
Subject: GNU Parallel Bug Reports how can i use parallel for rsync
Date: Tue, 18 Dec 2018 14:45:06 +0000

how can i use parallel for rsync:
https://www.gnu.org/software/parallel/man.html#EXAMPLE:-Working-as-xargs--n1.-Argument-appending

rsync is a great tool, but sometimes it will not fill up the available bandwidth. This is often a problem when copying several big files over high speed connections.

The following will start one rsync per big file in src-dir to dest-dir on the server fooserver:

  cd src-dir; find . -type f -size +100000 | \
    parallel -v ssh fooserver mkdir -p /dest-dir/{//}\; \
      rsync -s -Havessh {} fooserver:/dest-dir/{}

The dirs created may end up with wrong permissions and smaller files are not being transferred. To fix those run rsync a final time:

  rsync -Havessh src-dir/ fooserver:/dest-dir/

If you are unable to push data, but need to pull them and the files are called digits.png (e.g. 000000.png) you might be able to do:

  seq -w 0 99 | parallel rsync -Havessh fooserver:src/*{}.png destdir/
I dont kown how to insted of above  -Havessh  fooserver elgments ?
what is the meaning ?

if i want send the file to 192.168.0.9 from local 
IS right like this ?
 find ./ -type d| parallel -v ssh address@hidden mkdir -p /root/{//}\; rsync -s -Havessh {} address@hidden:/root/{}
 
  find . -type f -size +100000 | \
    parallel -v ssh address@hidden mkdir -p /root/{//}\; \
      rsync -s -Havessh {} address@hidden:/root/{}

reply via email to

[Prev in Thread] Current Thread [Next in Thread]