Hi:

I have a design problem with my test cases.

In my benchmark suite I have a runner class that controls how benchmarks are executed.
Now I want to subclass it to provide a runner that automatically finds a reasonable number of iterations for microbenchmarks. Thus, it will first measure the time of a first run and then double the number of iterations until it has some like at least 300ms runtime.

Ok, thats the domain design, now the question how do I test that hierarchy with SUnit?
It seems like my test hierarchy that parallels the domain hierarchy is not actually working like I would expected it.

Thus, my basic test class implements some 9 tests, and my auto-sizing test-class adds two more test.
However, when I run the tests, only 11 tests are executed and not 2*9 + 2 = 20 tests.
Is there something I am missing? Is there a way that I can force SUnit to also execute the tests of the superclass?

Or, something that would actually be nice, is there a way that I can automatically parameterize my tests with data?

Then I would not need to us subclassing in my test hierarchy, but could just tell the basic tests to run with all the different runner classes, and for the autosizing runners, I can just run additional tests.

Thanks
Stefan

--
Stefan Marr
Software Languages Lab
Vrije Universiteit Brussel
Pleinlaan 2 / B-1050 Brussels / Belgium
http://soft.vub.ac.be/~smarr
Phone: +32 2 629 2974
Fax: �� +32 2 629 3525

--
Stefan Marr
Software Languages Lab
Vrije Universiteit Brussel
Pleinlaan 2 / B-1050 Brussels / Belgium
http://soft.vub.ac.be/~smarr
Phone: +32 2 629 2974
Fax: �� +32 2 629 3525