Re: [rdiff-backup-users] Measuring transfer size

On Wed, Aug 12, 2009 at 1:01 PM, Simon Hobson <address@hidden> wrote:

Thijs de Zoete wrote:

I've measured the transfer size myself, and it came to notice that the sizes sent over the connection are fairly small compared to other backup tools with default setups.
I guessed the files are being gzipped before they will be transfered.

No, I believe it uses the rsync protocol so only changed parts of files are transmitted. The protocol is clever enough to work out when bits have been inserted or deleted. For example, if you insert 1 byte at the beginning of a 1GB file, most tools would find every block of the file to have changed and copy a whole gig - rsync works out that the contents have moved along and only copies a few k.

rsync can also compress the data that is sent, but the key feature is eliminating so much data transmission in the first place.

Add in the facility (in the rsync tool) to limit bandwidth used to a specific value, and you get a very powerful tool for backups across a slow link - I've been using rsync for this for many years.

http://en.wikipedia.org/wiki/Rsync
http://rsync.samba.org/tech_report/tech_report.html

--
Simon Hobson

Visit http://www.magpiesnestpublishing.co.uk/ for books by acclaimed
author Gladys Hobson. Novels - poetry - short stories - ideal as
Christmas stocking fillers. Some available as e-books.

_______________________________________________
rdiff-backup-users mailing list at address@hidden
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

From:	Thijs de Zoete
Subject:	Re: [rdiff-backup-users] Measuring transfer size
Date:	Wed, 12 Aug 2009 14:15:43 +0200