Re: Performance tracking

[Ken Raeburn]

On Sep 17, 2009, at 17:53, Ludovic Courtès wrote:
> I was thinking we could have a dedicated machine running benchmarks,
> say, everyday, and publishing plots somewhere.

I'd suggest multiple machines, if possible.  Different operating  
systems (for example, I've seen that mutex performance differs quite a  
bit between Linux and Mac OS X), maybe different processor families.   
If some of the benchmarks test multithreaded performance, perhaps  
multiprocessor vs uniprocessor systems too.

Testing on a single machine is better than not testing at all, but I  
don't think we want to fine-tune it for one system at the expense of  
performance on lots of others.

Ken