rdiff-backup-users
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [rdiff-backup-users] --check-destination-dir taking a very long time


From: Harald Hannelius
Subject: Re: [rdiff-backup-users] --check-destination-dir taking a very long time
Date: Thu, 12 Sep 2019 15:38:41 +0300 (EEST)
User-agent: Alpine 2.11 (LNX 23 2013-08-11)



What would You recommend instead?

On Thu, 12 Sep 2019, Patrik Dufresne wrote:

Hello Walt,

That's a good news you manage to recover your backup.

ext4 has limitation that might be reached for a backup storage. Personally,
I would way ext4 file system is not a good choice for data storage. As you
found, it has limitation on number of subfolder, it's a journaling
filesystem, doesn't have copy on write, not snapshot, it doesn't have any
checksum either.

--
Patrik Dufresne Service Logiciel inc.
http://www.patrikdufresne.com <http://patrikdufresne.com/>/
514-971-6442
130 rue Doris
St-Colomban, QC J5K 1T9


On Thu, Sep 12, 2019 at 7:53 AM Walt Mankowski <address@hidden> wrote:

Update -- it took about 30 hours to do the regression, started doing
the backup, and then quickly crashed with another "No space left on
device" exception. In kern.log I found these messages:

Sep 11 21:53:47 scruffy kernel: [294433.260536] EXT4-fs warning (device
sde1): ext4_dx_add_entry:2190: Directory (ino: 30017692) index full, reach
max htree level :2
Sep 11 21:53:47 scruffy kernel: [294433.260540] EXT4-fs warning (device
sde1): ext4_dx_add_entry:2194: Large directory feature is not enabled on
this filesystem

It got the error while trying to write a file in
~/.cache/chromium/Default/Cache. Turns out that after running
rdiff-backup for years I'd accumulated over 6 million files in

/backup/scruffy/rdiff-backup-data/increments/home/waltman/.cache/chromium/Default/Cache
It's a bit fuzzy how many files you can add to an ext4 directory, but
it looks like I hit the limit.

I added ~/.cache/chromium to my exclude list and restarted the
backup. It looks a lot happier now.

Walt

_______________________________________________
rdiff-backup-users mailing list at address@hidden
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL:
http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
_______________________________________________
rdiff-backup-users mailing list at address@hidden
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki



--

Harald Hannelius | harald.hannelius/a\arcada.fi | +358 50 594 1020



reply via email to

[Prev in Thread] Current Thread [Next in Thread]