On Tue, Jan 4, 2011 at 11:35 PM, Stefan Marr <squeak@stefan-marr.de> wrote:

Hi Igor:

On 04 Jan 2011, at 22:40, Igor Stasenko wrote:

> Okay, how about creating a separate
> VMBenchmarks repository
> and putting VMBenchmarks package there?

Sure, sounds good. There are also the Systems benchmarks at http://www.squeaksource.com/PharoBenchmarks.

yes!� few months ago I commited this:

"
Several fixes to Benchmark. Now you can run for example:

Benchmark testStandardToFile: (FileStream forceNewFileNamed: 'mariano').
"

So, at least, I was able to run all benchmarks :)

However, it still needs cleaning, improvement, testing, blah.� But it is a good start point I think.

Cheers

Mariano
�

One question would be what to include in such a benchmark suite.
And another question how to design the benchmark harness.

I need something (and if you are going to automate it, you probably, too) which is scriptable from the command line.
My harness registers itself in the startup list and then looks for the command line arguments to choose a benchmark class.

Best regards
Stefan

--
Stefan Marr
Software Languages Lab
Vrije Universiteit Brussel
Pleinlaan 2 / B-1050 Brussels / Belgium
http://soft.vub.ac.be/~smarr
Phone: +32 2 629 2974
Fax: � +32 2 629 3525