Re: using --remove-older-than takes a very long time?

[Derek Atkins]

Hi Eric,

I got more tests run tonight.

Last night I ran a bonnie++ test through encfs.  Tonight I ran it directly
on NFS.  Boy, what a difference that made!  The test through encfs took
233 minutes of real time to finish whereas directly into NFS it finished
in 11 minutes.  Maybe I need to re-think my backup encryption solution?

Then I ran your sets of tests, once through encfs and once directly on
NFS.  The encfs tests were slower (of course), but there was a good 2x
speed difference when including the sync vs not.  As for encfs vs raw-NFS,
there appears to be about a 25% speed difference there.  But this test,
unlike bonnie++, was able to use the cache whereas the bonnie++ tests use
a 16G dataset when there is only 8G of RAM on the system.

All test results are included here:

TESTING THROUGH ENCFS:

date; time bonnie++ -r 8192 ; date
Fri 21 Feb 2020 09:06:21 PM EST
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version  1.98       ------Sequential Output------ --Sequential Input-
--Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Name:Size etc        /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP 
/sec %CP
backup          16G    0k  18 3835k  17 3283k  15  273k  85 54.8m  11
482.3  33
Latency             12246ms     859ms    1633ms    1577ms   10015us     403ms
Version  1.98       ------Sequential Create------ --------Random
Create--------
backup              -Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP 
/sec %CP
                 16     0   8     0   9     0   9     0   8     0   9    
0   8
Latency             10227us    2896us   96684us   11198us    3271us   10385us
1.98,1.98,backup,1,1582413653,16G,,8192,5,0,18,3835,17,3283,15,273,85,56122,11,482.3,33,16,,,,,154,8,685,9,398,9,161,8,724,9,417,8,12246ms,859ms,1633ms,1577ms,10015us,403ms,10227us,2896us,96684us,11198us,3271us,10385us

real    233m43.383s
user    2m50.934s
sys     36m6.502s
Sat 22 Feb 2020 01:00:04 AM EST

--------------------------------------------------
TESTING DIRECTLY INTO NFS:

( cd /net/freenas/mnt/freenas-0/backups/TEST; date; time bonnie++ -r 8192
-d /net/freenas/mnt/freenas-0/backups/TEST ; date )
Sat 22 Feb 2020 08:23:20 PM EST
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version  1.98       ------Sequential Output------ --Sequential Input-
--Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Name:Size etc        /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP 
/sec %CP
backup          16G  239k  98  106m  34 54.2m  24  247k  99  117m  23 
2104  70
Latency             78483us   44241us    2014ms    2122ms     192ms    8766us
Version  1.98       ------Sequential Create------ --------Random
Create--------
backup              -Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP 
/sec %CP
                 16     0  29     0  44     0  30     0  29     0  20    
0  20
Latency              4981us   20428us    1313us   19010us    1701us    1910us
1.98,1.98,backup,1,1582341907,16G,,8192,5,239,98,108291,34,55517,24,247,99,119606,23,2104,70,16,,,,,760,29,32324,44,3098,30,1039,29,1130,20,1066,20,78483us,44241us,2014ms,2122ms,192ms,8766us,4981us,20428us,1313us,19010us,1701us,1910us

real    11m44.364s
user    0m43.998s
sys     2m43.481s
Sat 22 Feb 2020 08:35:05 PM EST

--------------------------------------------------
TESTING THROUGH ENCFS:

$ time for i in $(seq 1 100); do touch $i; sync; done

real    0m2.076s
user    0m0.281s
sys     0m1.006s
$ time for i in $(seq 1 100); do rm $i; sync; done

real    0m1.390s
user    0m0.267s
sys     0m0.802s
$ time for i in $(seq 1 100); do touch $i; done

real    0m1.349s
user    0m0.148s
sys     0m0.446s
$ time for i in $(seq 1 100); do rm $i; done

real    0m0.930s
user    0m0.160s
sys     0m0.476s

--------------------------------------------------
TESTING DIRECTLY INTO NFS:

$ time for i in $(seq 1 100); do touch $i; sync; done

real    0m1.469s
user    0m0.296s
sys     0m0.947s
$ time for i in $(seq 1 100); do rm $i; sync; done

real    0m1.007s
user    0m0.230s
sys     0m0.588s
$ time for i in $(seq 1 100); do touch $i; done

real    0m0.852s
user    0m0.151s
sys     0m0.498s
$ time for i in $(seq 1 100); do rm $i; done

real    0m0.691s
user    0m0.106s
sys     0m0.371s


-- 
       Derek Atkins                 617-623-3745
       address@hidden             www.ihtfp.com
       Computer and Internet Security Consultant