[lmi] Build time comparison

[Greg Chicares]

It looks like our corporate server is slower than I remember.
I've run 'lmi_setup_00.sh' there and on my own PC, watching
what each script writes to /dev/tty output as it completes,
and just creating a debian chroot felt so slow on the server
a few days ago that I kept peeking at the logs to see whether
something had gone wrong, and watching the apt-get cache to
see if it wasn't working. Below, though, I compare the clock
time taken by each step, and report that 'debootstrap' takes
about five times as long, but the highly parallel system_test
target takes eight times as long, and I really can't explain
that factor-of-eight difference.

Results of 'time lmi_setup_00.sh':
  server: 14076.05s user 1297.94s system 187% cpu 2:16:55.81 total
  my PC:  23976.03s user 1446.80s system 908% cpu 46:37.19 total
8215.81 = (2 * 60 + 16) * 60 + 55.81
2797.19 = (0 * 60 + 46) * 60 + 37.19
2.937 = 8215.81 / 2797.19

Here's the result of
  $</proc/cpuinfo grep 'model name' |wc -l
  $</proc/cpuinfo grep 'model name' |sort -u
on the server:
  8
  model name      : Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
and on my machine:
  32
  model name      : Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz
The "Gold 6252" has 24 cores according to intel; it looks like they
allocate only eight to us. My PC has 16 physical cores, but I've
enabled hyperthreading, whereas the server has not (according to
"Thread(s) per core" reported by lscpu).

BTW, the server we had a year ago reported eight cores of
  Intel(R) Xeon(R) CPU E5-2698 v4 @ 2.20GHz
which has a slightly higher "CPU mark" than the Gold 6252
according to cpubenchmark.net, FWIW. Maybe I'll boot up my old
dual-E5520 box and see whether it beats the corporate server.

* Clock time for each lmi_setup*.sh script, with ratio if time >= 10 seconds

                        ./lmi_setup_02.sh                       
                00:00:00        ./lmi_setup_05r.sh                      
                00:00:14        ./lmi_setup_07r.sh                      
                00:00:02        ./lmi_setup_10r.sh                      
./lmi_setup_10.sh
534%            00:05:42        ./lmi_setup_11.sh               00:01:04        
./lmi_setup_11.sh
637%            00:40:26        ./lmi_setup_20.sh               00:06:21        
./lmi_setup_20.sh
                00:00:02        ./lmi_setup_21.sh               00:00:03        
./lmi_setup_21.sh
                00:00:06        ./lmi_setup_24.sh               00:00:01        
./lmi_setup_24.sh
                00:00:00        ./lmi_setup_25.sh               00:00:00        
./lmi_setup_25.sh
                00:00:01        ./lmi_setup_25.sh               00:00:01        
./lmi_setup_25.sh
                00:00:01        ./lmi_setup_25.sh               00:00:00        
./lmi_setup_25.sh
                00:00:00        ./lmi_setup_29.sh               00:00:01        
./lmi_setup_29.sh
                00:00:01        ./lmi_setup_30.sh               00:00:00        
./lmi_setup_30.sh
200%            00:00:10        ./lmi_setup_40.sh               00:00:05        
./lmi_setup_40.sh
138%            00:00:22        ./lmi_setup_40.sh               00:00:16        
./lmi_setup_40.sh
197%            00:45:04        ./lmi_setup_42.sh               00:22:56        
./lmi_setup_42.sh
801%            00:20:57        ./lmi_setup_43.sh               00:02:37        
./lmi_setup_43.sh
177%            00:22:23        ./lmi_setup_44.sh               00:12:39        
./lmi_setup_44.sh
                00:00:01        ./lmi_setup_01r.sh              00:00:00        
./lmi_setup_01.sh
                00:00:01        ./lmi_setup_00.sh               00:00:00        
./lmi_setup_00.sh


* Raw data: screen copies, slightly reformatted for pasting into a spreadsheet

                /tmp[0]$time /opt/lmi/src/lmi/gwc/redhat_rebuild.sh
                Last-modified header missing -- time-stamps turned off.
2020-10-13 18:34:35     
URL:https://raw.githubusercontent.com/let-me-illustrate/lmimaster/lmi_setup_00.sh
 [6116/6116] -> "lmi_setup_00.sh" [1]
20201013        22:35:57        ./lmi_setup_02.sh: Removed old chroot.
20201013        22:35:57        ./lmi_setup_05r.sh: Reconfigured redhat chroot.
20201013        22:36:11        ./lmi_setup_07r.sh: Installed EPEL.
20201013        22:36:13        ./lmi_setup_10r.sh: Installed 'debootstrap' 
[redhat].
20201013        22:41:55        ./lmi_setup_11.sh: Ran 'debootstrap'.
20201013        23:22:21        ./lmi_setup_20.sh: Installed debian packages.
20201013        23:22:23        ./lmi_setup_21.sh: Updated debian chroot.
20201013        23:22:29        ./lmi_setup_24.sh: Configured users.
20201013        23:22:29        ./lmi_setup_25.sh: Configured {zsh,vim,git} for 
user 'root'.
20201013        23:22:30        ./lmi_setup_25.sh: Configured {zsh,vim,git} for 
user '[greg]'
20201013        23:22:31        ./lmi_setup_25.sh: Configured {zsh,vim,git} for 
user '[kim]'
20201013        23:22:31        ./lmi_setup_29.sh: Created lmi directories.
20201013        23:22:32        ./lmi_setup_30.sh: Copied optional files.
20201013        23:22:42        ./lmi_setup_40.sh: Configured 'wine' for user 
'[greg]'.
20201013        23:23:04        ./lmi_setup_40.sh: Configured 'wine' for user 
'[kim]'.
                Finished building lmi.
20201014        00:08:08        ./lmi_setup_42.sh: Installed lmi for '[greg]'.
20201014        00:29:05        ./lmi_setup_43.sh: Ran system test for '[greg]'.
                LMI_TRIPLET = "x86_64-w64-mingw32"
                  Production system built--ready to start GUI test in another 
session.
                LMI_TRIPLET = "i686-w64-mingw32"
                  Production system built--ready to start GUI test in another 
session.
20201014        00:51:28        ./lmi_setup_44.sh: Ran nychthemeral test for 
'[greg]'.
20201014        00:51:29        ./lmi_setup_01r.sh [redhat host]
20201014        00:51:30        ./lmi_setup_00.sh Installed and tested lmi.
                Elapsed: 02:16:54; log suffix: 20201013T2234Z
                /opt/lmi/src/lmi/gwc/redhat_rebuild.sh  14076.05s user 1297.94s 
system 187% cpu 2:16:55.81 total

                /home/greg[0]#cp -a 
/srv/chroot/bullseye0/opt/lmi/src/lmi/lmi_setup_* .
                /home/greg[0]#time ./lmi_setup_00.sh 
>/srv/cache_for_lmi/logs/chroot_log_$(date -u +"%Y%m%dT%H%MZ") 2>&1
20201013        22:36:54        ./lmi_setup_10.sh: Installed 'debootstrap' 
[debian].
20201013        22:37:58        ./lmi_setup_11.sh: Ran 'debootstrap'.
20201013        22:44:19        ./lmi_setup_20.sh: Installed debian packages.
20201013        22:44:22        ./lmi_setup_21.sh: Updated debian chroot.
20201013        22:44:23        ./lmi_setup_24.sh: Configured users.
20201013        22:44:23        ./lmi_setup_25.sh: Configured {zsh,vim,git} for 
user 'root'.
20201013        22:44:24        ./lmi_setup_25.sh: Configured {zsh,vim,git} for 
user 'greg'.
20201013        22:44:24        ./lmi_setup_25.sh: Configured {zsh,vim,git} for 
user 'nemo'.
20201013        22:44:25        ./lmi_setup_29.sh: Created lmi directories.
20201013        22:44:25        ./lmi_setup_30.sh: Copied optional files.
20201013        22:44:30        ./lmi_setup_40.sh: Configured 'wine' for user 
'greg'.
20201013        22:44:46        ./lmi_setup_40.sh: Configured 'wine' for user 
'nemo'.
                Finished building lmi.
20201013        23:07:42        ./lmi_setup_42.sh: Installed lmi for 'greg'.
20201013        23:10:19        ./lmi_setup_43.sh: Ran system test for 'greg'.
                LMI_TRIPLET = "x86_64-w64-mingw32"
                  Production system built--ready to start GUI test in another 
session.
                LMI_TRIPLET = "i686-w64-mingw32"
                  Production system built--ready to start GUI test in another 
session.
20201013        23:22:58        ./lmi_setup_44.sh: Ran nychthemeral test for 
'nemo'.
20201013        23:22:58        ./lmi_setup_01.sh [debian host]
20201013        23:22:58        ./lmi_setup_00.sh Installed and tested lmi.
                Elapsed: 00:46:37; log suffix: 20201013T2236Z
                ./lmi_setup_00.sh >  2>&1  23976.03s user 1446.80s system 908% 
cpu 46:37.19 total