Re: benchmarking framework

[Neil Jerram]

>>>>> "Dirk" == Dirk Herrmann <address@hidden> writes:

    Dirk> I have taken the freedom to add a benchmarking framework to
    Dirk> guile.

My results, in case they are interesting ...

Benchmarking /home/neil/Guile/cvs/guile-core/pre-inst-guile ...
with GUILE_LOAD_PATH=/home/neil/Guile/cvs/guile-core/benchmark-suite
;; frame time per iteration: 1.1444091796875e-6
("continuations.bm: call/cc" 300 "user:" 0.72 "benchmark:" 0.719656677246094 
"bench/interp:" -3.4332275390625e-4 "gc:" 0.72)
("if.bm: if-<expr>-then-else: executing then" 330000 "user:" 0.71 "benchmark:" 
0.332344970703125 "bench/interp:" 0.042344970703125 "gc:" 0.29)
("if.bm: if-<expr>-then-else: executing else" 330000 "user:" 0.73 "benchmark:" 
0.352344970703125 "bench/interp:" 0.082344970703125 "gc:" 0.27)
("if.bm: if-<expr>-then: executing then" 330000 "user:" 0.71 "benchmark:" 
0.332344970703125 "bench/interp:" 0.042344970703125 "gc:" 0.29)
("if.bm: if-<expr>-then: executing else" 330000 "user:" 0.72 "benchmark:" 
0.342344970703125 "bench/interp:" 0.072344970703125 "gc:" 0.27)
("if.bm: if-<iloc>-then-else: executing then" 330000 "user:" 0.72 "benchmark:" 
0.342344970703125 "bench/interp:" 0.062344970703125 "gc:" 0.28)
("if.bm: if-<iloc>-then-else: executing else" 330000 "user:" 0.71 "benchmark:" 
0.332344970703125 "bench/interp:" 0.042344970703125 "gc:" 0.29)
("if.bm: if-<iloc>-then: executing then" 330000 "user:" 0.72 "benchmark:" 
0.342344970703125 "bench/interp:" 0.062344970703125 "gc:" 0.28)
("if.bm: if-<iloc>-then: executing else" 330000 "user:" 0.7 "benchmark:" 
0.322344970703125 "bench/interp:" 0.032344970703125 "gc:" 0.29)
("if.bm: if-<bool>-then-else: executing then" 330000 "user:" 0.7 "benchmark:" 
0.322344970703125 "bench/interp:" 0.032344970703125 "gc:" 0.29)
("if.bm: if-<bool>-then-else: executing else" 330000 "user:" 0.7 "benchmark:" 
0.322344970703125 "bench/interp:" 0.052344970703125 "gc:" 0.27)
("if.bm: if-<bool>-then: executing then" 330000 "user:" 0.69 "benchmark:" 
0.312344970703125 "bench/interp:" 0.032344970703125 "gc:" 0.28)
("if.bm: if-<bool>-then: executing else" 330000 "user:" 0.69 "benchmark:" 
0.312344970703125 "bench/interp:" 0.052344970703125 "gc:" 0.26)
("logand.bm: bignum" 130000 "user:" 0.88 "benchmark:" 0.731226806640625 
"bench/interp:" 0.211226806640625 "gc:" 0.52)

Did you consider using symbols rather than strings for "user:",
"benchmark:" and so on?  I think that would be more readable, and
marginally easier to process programmatically as well.

Also, from the PHB department :-), is there a single headline number
that could usefully be boiled down from these results?

Regards,
        Neil