On Tue, Jan 4, 2011 at 11:35 PM, Stefan Marr <squeak@stefan-marr.de> wrote:
Hi Igor:
On 04 Jan 2011, at 22:40, Igor Stasenko wrote:
Okay, how about creating a separate VMBenchmarks repository and putting VMBenchmarks package there?
Sure, sounds good. There are also the Systems benchmarks at http://www.squeaksource.com/PharoBenchmarks.
yes! few months ago I commited this: " Several fixes to Benchmark. Now you can run for example: Benchmark testStandardToFile: (FileStream forceNewFileNamed: 'mariano'). " So, at least, I was able to run all benchmarks :) However, it still needs cleaning, improvement, testing, blah. But it is a good start point I think. Cheers Mariano
One question would be what to include in such a benchmark suite. And another question how to design the benchmark harness.
I need something (and if you are going to automate it, you probably, too) which is scriptable from the command line. My harness registers itself in the startup list and then looks for the command line arguments to choose a benchmark class.
Best regards Stefan
-- Stefan Marr Software Languages Lab Vrije Universiteit Brussel Pleinlaan 2 / B-1050 Brussels / Belgium http://soft.vub.ac.be/~smarr <http://soft.vub.ac.be/%7Esmarr> Phone: +32 2 629 2974 Fax: +32 2 629 3525