guile-devel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Results of tests of guile-2.9


From: Mikael Djurfeldt
Subject: Re: Results of tests of guile-2.9
Date: Tue, 13 Nov 2018 00:53:25 +0100

It would be nice to have guile-1.8 in that list since some users stayed at that version due to 2.0 being slower.

Maybe, in time, we can get everyone back to the most recent release. :-))

Den tis 13 nov. 2018 00:48 skrev Mikael Djurfeldt <address@hidden>:
Thanks, Arne!

Den mån 12 nov. 2018 01:04 skrev Arne Babenhauserheide <address@hidden>:

Mikael Djurfeldt <address@hidden> writes:

> That sounds great! Can you say something about how much quicker 2.9.1 is
> compared to 2.2?

You can find that by looking at the benchmarks by ecraven:

https://ecraven.github.io/r7rs-benchmarks/

Comparing 2.9 and 2.2 there, you see a 30% reduction in execution time
(averaged by geometric mean).

In other words: Guile 2.9 is about 50% faster than Guile 2.2.

And looking at details, Guile 2.9 is faster than Guile 2.2 in almost
every test, and it did not experience significant slowdown in any test.


I also did a summary of all the results which shows that Guile is
closing in on MIT-scheme and chicken (but you’ll notice that the
ordering is very different from the one on the site, which shows nicely
that your result depends on what you look at, and how you look — and
you can see that they have very different performance characteristics):


The first number is the geometric mean of the slowdown against the
fastest implementation in each test. The number in parens is the
number of successful tests.

1.9881572085609192 (38 / 38) stalin-unknown
2.1500822915753734 (57 / 57) chez-9.5.1-m64
2.738525957787122 (55 / 55) gambitc-v4.9.0
2.7694443820075634 (55 / 55) gerbil-v0.14-DEV
4.205151966183653 (50 / 50) bigloo-4.3a
5.442681840154815 (57 / 57) larceny-1.3
5.707385688762197 (57 / 57) racket-7.0/r7rs
8.679978781946975 (50 / 50) chicken-4.13.0
9.248983537329178 (51 / 51) mit-9.2.1
10.587408686012083 (55 / 55) guile-2.9.1.3-1f678
10.615583087968362 (41 / 41) bones-unknown
11.524752498102057 (56 / 56) cyclone-0.9.3
14.448014458884698 (57 / 57) petite-9.5.1-m64
15.089971411932236 (56 / 56) guile-2.2.4
18.035143748368437 (45 / 45) ypsilon-unknown
19.005148516339332 (44 / 44) femtolisp-unknown
19.139543005333042 (56 / 56) gauche-0.9.6
27.645742735331833 (57 / 57) sagittarius-0.9.2
31.157381722908422 (36 / 36) rscheme-unknown
34.153836451059746 (39 / 39) scheme48-unknown
36.48670680531284 (41 / 41) picrin-unknown
38.99165232121692 (48 / 48) kawa-3.0
47.53962620985255 (28 / 28) rhizome-unknown
55.19456628888817 (11 / 11) s9fes-unknown
64.80503623166697 (35 / 35) SISC-1.16.6
86.0140998934114 (48 / 48) chibi-unknown
109.67746150832924 (35 / 35) chickencsi-4.13.0
180.3672988266313 (17 / 17) foment-0.4

created with

`for i in bigloo-4.3a bones-unknown chez-9.5.1-m64 chibi-unknown chicken-4.13.0 chickencsi-4.13.0 cyclone-0.9.3 femtolisp-unknown foment-0.4 gambitc-v4.9.0 gauche-0.9.6 gerbil-v0.14-DEV guile-2.2.4 guile-2.9.1.3-1f678 ironscheme kawa-3.0 larceny-1.3 mit-9.2.1 petite-9.5.1-m64 picrin-unknown racket-7.0/r7rs rhizome-unknown rscheme-unknown s9fes-unknown sagittarius-0.9.2 scheme48-unknown SISC-1.16.6 stalin-unknown tinyscheme ypsilon-unknown; do echo $(./evaluate-r7rs-benchmark.w /tmp/all.csv $i | tail -n 1) $i; done | sort -g`

using https://bitbucket.org/ArneBab/wisp/src/tip/examples/evaluate-r7rs-benchmark.w

Best wishes,
Arne
--
Unpolitisch sein
heißt politisch sein
ohne es zu merken

reply via email to

[Prev in Thread] Current Thread [Next in Thread]