[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Gcl-devel] Re: concise

From: Camm Maguire
Subject: [Gcl-devel] Re: concise
Date: 28 Feb 2006 13:53:21 -0500
User-agent: Gnus/5.09 (Gnus v5.9.0) Emacs/21.2


Robert Boyer <address@hidden> writes:

> > What I would really love is a set of concise benchmarks that point out
> > critical performance characteristics of the existing applications,
> > acl2/nqthm, maxima and axiom.
> Concise.  Hmm.
> Well.  Given how cheap cycles have become, why don't you periodically run the
> full ACL2 "make certify-books" and the nqthm-1992 "make giant-test"?  Each
> takes about an hour or two.

Yes, this is quite good for final releases and such, but it is just
too time consuming, both computer and human, to make quick development
cycle progress, which is all the more important in open source when
development has to fit into spare moments.

> That will not give you any really accurate indication of "why" the
> performance went up or down, but I bet that a gprof of the exact same runs
> might help a lot to that end.
> If you'd like me to give you some scripts, I'd be most happy to.
> Bob
> P. S.  As for the Gabriel benchmarks, they now run too fast for GCL to
> measure with much accuracy, which is an indication merely that GCL's time
> scale of reporting deserves some refinement.  Currently, we have:
> 100 is rather crude, but we can do better in Gnu-Linux, I suspect.  Accuracy
> down below that level is, of course, another question, but since we're
> nowadays doing a billion things a second, a billion here and a billion there
> and soon we're talking about real time, to mangle a phrase of Sen. Dirksen.

Yes, we can get down to micro seconds if needed, or simply expand the
benchmark problem sizes.  At some point, we might want a lisp
interface to page fault counting and other performance measures that
can be read off the cpu.

Take care,


Camm Maguire                                            address@hidden
"The earth is but one country, and mankind its citizens."  --  Baha'u'llah

reply via email to

[Prev in Thread] Current Thread [Next in Thread]