Re: profiling Octave

[Dmitri A. Sergatskov]

On Fri, Aug 9, 2019 at 2:16 PM Carnë Draug <address@hidden> wrote:
>
> On Fri, 9 Aug 2019 at 05:30, Rik <address@hidden> wrote:
> > I wanted to look to look empirically at the slow down that has occurred
> > over time with Octave.
> >
> > [...]
> >
> > Any ideas?
>
> Have we actually established that Octave has indeed been running
> slower over time?  There's been a lot of talk about it, but all the
> measurements I have seen where by running the test suite and not a
> real Octave program.
>
> I think that before worrying about what tools to check where the
> performance drop is, maybe we should get a set of programs that can be
> used to confirm this slowdown.
>
> For what is worth, I too have the feeling that Octave has been getting
> slower over time, I just haven't actually got around to confirm this
> with proper methods.
>

I run somewhat modified sciviews' benchmark (size of test matrices
increased) and
I do not see much difference in the last few years:

octave-4.2.0-rc2 (2016-09-21):
   Octave Benchmark 2
   ==================
Number of times each test is run__________________________: 3

   I. Matrix calculation
   ---------------------
Creation, transp., deformation of a 5000x5000 matrix (sec): 1.1713
5000x5000 normal distributed random matrix ^1001____ (sec): 1.9489
Sorting of 9,000,000 random values__________________ (sec): 1.0415
5000x5000 cross-product matrix (b = a' * a)_________ (sec): 2.7143
Linear regression over 5000x5000 matrix (c = a \\ b') (sec): 2.1651
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 1.7034

   II. Matrix functions
   --------------------
FFT over 9,000,001 random values____________________ (sec): 0.80781
Eigenvalues of a 900x900 random matrix ______________ (sec): 2.4541
Determinant of a 5000x5000 random matrix____________ (sec): 1.2405
Cholesky decomposition of a 5000x5000 matrix________ (sec): 0.5662
Inverse of a 5000x5000 random matrix________________ (sec): 3.9265
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 1.3498

   III. Programmation
   ------------------
9,500,000 Fibonacci numbers calculation (vector calc)_ (sec): 1.5602
Creation of a 5250x5250 Hilbert matrix (matrix calc) (sec): 0.48573
Grand common divisors of 500,000 pairs (recursion)___ (sec): 0.17606
Creation of a 620x620 Toeplitz matrix (loops)_______ (sec): 5.363
Escoufier's method on a 97x97 matrix (mixed)________ (sec): 5.8139
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 1.5959


Total time for all 15 tests_________________________ (sec): 31.4351
Overall mean (sum of I, II and III trimmed means/3)_ (sec): 1.5424
                      --- End of test ---

Today's (2019-08-09) dev (hgid = 2c4759c8239c @)

   Octave Benchmark 2
   ==================
Number of times each test is run__________________________: 3

   I. Matrix calculation
   ---------------------
Creation, transp., deformation of a 5000x5000 matrix (sec): 1.1394
5000x5000 normal distributed random matrix ^1001____ (sec): 0.93096
Sorting of 9,000,000 random values__________________ (sec): 1.0292
5000x5000 cross-product matrix (b = a' * a)_________ (sec): 1.4269
Linear regression over 5000x5000 matrix (c = a \\ b') (sec): 1.2995
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 1.1508

   II. Matrix functions
   --------------------
FFT over 9,000,001 random values____________________ (sec): 0.81812
Eigenvalues of a 900x900 random matrix ______________ (sec): 0.64627
Determinant of a 5000x5000 random matrix____________ (sec): 1.3008
Cholesky decomposition of a 5000x5000 matrix________ (sec): 0.57645
Inverse of a 5000x5000 random matrix________________ (sec): 3.7264
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 0.8827

   III. Programmation
   ------------------
9,500,000 Fibonacci numbers calculation (vector calc)_ (sec): 0.86849
Creation of a 5250x5250 Hilbert matrix (matrix calc) (sec): 0.52379
Grand common divisors of 500,000 pairs (recursion)___ (sec): 0.16265
Creation of a 620x620 Toeplitz matrix (loops)_______ (sec): 4.4124
Escoufier's method on a 97x97 matrix (mixed)________ (sec): 5.966
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 1.2614


Total time for all 15 tests_________________________ (sec): 24.8273
Overall mean (sum of I, II and III trimmed means/3)_ (sec): 1.0861
                      --- End of test ---

This is on i7-2600 computer.

Dmitri.
--