On 2013-01-24, at 18:16, Igor Stasenko <siguctua@gmail.com> wrote:
On 24 January 2013 18:12, Camillo Bruni <camillobruni@gmail.com> wrote:
I've been thinking these days on how to implement regression tests. Obviously the core requirement is to launch a separate image and capture terminal output and/or result files.
For now I will put them into a separate repository:
http://smalltalkhub.com/#!/~Pharo/regression-testing
Some question: - Is there a test ConfigurationOf* which can be used to try loading different versions / groups? - Is it ok to rely on OSProcess for now to run launch a separate new image?
+ 1 we need such tests. And actually it would be even useful to know which code crashing the system , e.g. we can even have a tests which succeed only if they crashing VM.
yes exactly!! I even thought about doing this random code-change validation ;) 1. chose a random method (minus some uninteresting packages or only those with methods) 2. make it return a wrong value 3. run all tests 4. make sure we get an assertion failed ;)