[Pharo-project] Fileout the test results
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc. I would love to do this from the Test Runner, no by code. Best, Mariano
On 24 sept. 09, at 15:22, Mariano Martinez Peck wrote:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
You can take a look at http://www.squeaksource.com/ TestServerSimple.html for some samples of code.
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- Simon
2009/9/24 Simon Denier <Simon.Denier@inria.fr>
On 24 sept. 09, at 15:22, Mariano Martinez Peck wrote:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
You can take a look at http://www.squeaksource.com/TestServerSimple.html for some samples of code.
Wow! I wasn't aware of that project. What's the idea of that project? I didn't find any information there. However, I was thinking in something much more simpler. For newbies (like me hahaha) or people who may want to contribute to Pharo just testing and sending the reports. Perhaps a simple button in Test Runner that says "Fileout results". So that he can send the file to the mailing list or whatever. what do you think ?
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- Simon
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
On 24 sept. 09, at 15:34, Mariano Martinez Peck wrote:
2009/9/24 Simon Denier <Simon.Denier@inria.fr>
On 24 sept. 09, at 15:22, Mariano Martinez Peck wrote:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
You can take a look at http://www.squeaksource.com/TestServerSimple.html for some samples of code.
Wow! I wasn't aware of that project. What's the idea of that project? I didn't find any information there.
Just having a simple automated engine to run tests for Moose automatically. The code is adapted from some previous project in Switzerland and, to be honest, it's pretty much a hack leaving plenty of dead code behind. Configuration of projects to test is hard-coded. I am working on a new TestServer which would use Metacello configurations.
However, I was thinking in something much more simpler. For newbies (like me hahaha) or people who may want to contribute to Pharo just testing and sending the reports. Perhaps a simple button in Test Runner that says "Fileout results". So that he can send the file to the mailing list or whatever.
what do you think ?
That's a very good idea. We need more power tools for the tests anyway. I would also like to see more powerful features for regression testing (there is a basic test history only accessible through the TestRunner right now)
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- Simon
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- Simon
2009/9/24 Simon Denier <Simon.Denier@inria.fr>
On 24 sept. 09, at 15:34, Mariano Martinez Peck wrote:
2009/9/24 Simon Denier <Simon.Denier@inria.fr>
On 24 sept. 09, at 15:22, Mariano Martinez Peck wrote:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
You can take a look at http://www.squeaksource.com/TestServerSimple.html for some samples of code.
Wow! I wasn't aware of that project. What's the idea of that project? I didn't find any information there.
Just having a simple automated engine to run tests for Moose automatically. The code is adapted from some previous project in Switzerland and, to be honest, it's pretty much a hack leaving plenty of dead code behind. Configuration of projects to test is hard-coded. I am working on a new TestServer which would use Metacello configurations.
Sounds excellent. I really would love to have continuous integration in Pharo. Are you aware of http://www.squeaksource.com/ContIntegration.html ?? Perhaps you can join efforts...
However, I was thinking in something much more simpler. For newbies (like me hahaha) or people who may want to contribute to Pharo just testing and sending the reports. Perhaps a simple button in Test Runner that says "Fileout results". So that he can send the file to the mailing list or whatever.
what do you think ?
That's a very good idea. We need more power tools for the tests anyway. I would also like to see more powerful features for regression testing (there is a basic test history only accessible through the TestRunner right now)
Excellent!
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- Simon
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- Simon
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
On 24 sept. 09, at 15:56, Mariano Martinez Peck wrote:
2009/9/24 Simon Denier <Simon.Denier@inria.fr>
On 24 sept. 09, at 15:34, Mariano Martinez Peck wrote:
2009/9/24 Simon Denier <Simon.Denier@inria.fr>
On 24 sept. 09, at 15:22, Mariano Martinez Peck wrote:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
You can take a look at http://www.squeaksource.com/TestServerSimple.html for some samples of code.
Wow! I wasn't aware of that project. What's the idea of that project? I didn't find any information there.
Just having a simple automated engine to run tests for Moose automatically. The code is adapted from some previous project in Switzerland and, to be honest, it's pretty much a hack leaving plenty of dead code behind. Configuration of projects to test is hard-coded. I am working on a new TestServer which would use Metacello configurations.
Sounds excellent. I really would love to have continuous integration in Pharo. Are you aware of http://www.squeaksource.com/ ContIntegration.html ??
Perhaps you can join efforts...
Indeed, it looks interesting -- Simon
Yes but so far I think that we should improve TestServerSimple.
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
You can take a look at http://www.squeaksource.com/TestServerSimple.html for some samples of code.
Wow! I wasn't aware of that project. What's the idea of that project? I didn't find any information there.
Just having a simple automated engine to run tests for Moose automatically. The code is adapted from some previous project in Switzerland and, to be honest, it's pretty much a hack leaving plenty of dead code behind. Configuration of projects to test is hard-coded. I am working on a new TestServer which would use Metacello configurations.
Sounds excellent. I really would love to have continuous integration in Pharo. Are you aware of http://www.squeaksource.com/ ContIntegration.html ??
Perhaps you can join efforts...
However, I was thinking in something much more simpler. For newbies (like me hahaha) or people who may want to contribute to Pharo just testing and sending the reports. Perhaps a simple button in Test Runner that says "Fileout results". So that he can send the file to the mailing list or whatever.
what do you think ?
That's a very good idea. We need more power tools for the tests anyway. I would also like to see more powerful features for regression testing (there is a basic test history only accessible through the TestRunner right now)
Excellent!
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- Simon
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- Simon
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
2009/9/24 Mariano Martinez Peck <marianopeck@gmail.com>:
However, I was thinking in something much more simpler. For newbies (like me hahaha) or people who may want to contribute to Pharo just testing and sending the reports. Perhaps a simple button in Test Runner that says "Fileout results". So that he can send the file to the mailing list or whatever.
what do you think ?
That's a good idea. Adding it should be pretty straightforward. Could you please have a look? -- Damien Cassou http://damiencassou.seasidehosting.st "Lambdas are relegated to relative obscurity until Java makes them popular by not having them." James Iry
it would be good to have a xml or kind of format to store results of tests. Philippe also suggested a format that is compatible with Junit this way we could use Java infrastrcture. So yes I woul dlike to get such behavior. Stef On Sep 24, 2009, at 3:34 PM, Mariano Martinez Peck wrote:
2009/9/24 Simon Denier <Simon.Denier@inria.fr>
On 24 sept. 09, at 15:22, Mariano Martinez Peck wrote:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
You can take a look at http://www.squeaksource.com/TestServerSimple.html for some samples of code.
Wow! I wasn't aware of that project. What's the idea of that project? I didn't find any information there.
However, I was thinking in something much more simpler. For newbies (like me hahaha) or people who may want to contribute to Pharo just testing and sending the reports. Perhaps a simple button in Test Runner that says "Fileout results". So that he can send the file to the mailing list or whatever.
what do you think ?
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- Simon
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
Hi Mariano, I agree it would be a cool feature to add to the TestRunner. I guess it is even quite simple. In the meantime this is what I do: 1. Shift-Click with middle mouse button on the list, so that the halos for the PluggableListMorphPlus are show. 2. Click on the red Menu halo and select the menu item "copy list to clipboard". 3. Voilà ! There is even a "copy selection to clipboard". This is Morphic at its best IMO. Cheers, Bernhard Am 24.09.2009 um 15:22 schrieb Mariano Martinez Peck:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
On Thu, Sep 24, 2009 at 2:07 PM, Bernhard Pieber <bernhard@pieber.com>wrote:
Hi Mariano,
I agree it would be a cool feature to add to the TestRunner. I guess it is even quite simple.
In the meantime this is what I do: 1. Shift-Click with middle mouse button on the list, so that the halos for the PluggableListMorphPlus are show. 2. Click on the red Menu halo and select the menu item "copy list to clipboard".
Hi Bernhard! I tried but I didn't finde a "copy list to clipboard". I am using pharo1.0-10451-BETAdev09.09.3
3. Voilà !
There is even a "copy selection to clipboard".
This is Morphic at its best IMO.
Cheers, Bernhard
Am 24.09.2009 um 15:22 schrieb Mariano Martinez Peck:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
you could also look at the baseline test result scripts i wrote for publishing to the Pharo wiki. They write it out in Google wiki format, but it could be adapted for simple email use. I hadn't got as far as integrating this into the image, but we don't need much code to write out the TestResult in a decent format. cheers Mike 2009/9/24 Mariano Martinez Peck <marianopeck@gmail.com>:
On Thu, Sep 24, 2009 at 2:07 PM, Bernhard Pieber <bernhard@pieber.com> wrote:
Hi Mariano,
I agree it would be a cool feature to add to the TestRunner. I guess it is even quite simple.
In the meantime this is what I do: 1. Shift-Click with middle mouse button on the list, so that the halos for the PluggableListMorphPlus are show. 2. Click on the red Menu halo and select the menu item "copy list to clipboard".
Hi Bernhard!
I tried but I didn't finde a "copy list to clipboard". I am using pharo1.0-10451-BETAdev09.09.3
3. Voilà !
There is even a "copy selection to clipboard".
This is Morphic at its best IMO.
Cheers, Bernhard
Am 24.09.2009 um 15:22 schrieb Mariano Martinez Peck:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
Hi Mariano, I just tried it with a newly downloaded pharo1.0-10451-BETAdev09.09.3 and it worked in all lists of the TestRunner. See screenshots below. Cheers, Bernhard Am 24.09.2009 um 19:20 schrieb Mariano Martinez Peck:
On Thu, Sep 24, 2009 at 2:07 PM, Bernhard Pieber <bernhard@pieber.com> wrote: Hi Mariano,
I agree it would be a cool feature to add to the TestRunner. I guess it is even quite simple.
In the meantime this is what I do: 1. Shift-Click with middle mouse button on the list, so that the halos for the PluggableListMorphPlus are show. 2. Click on the red Menu halo and select the menu item "copy list to clipboard".
Hi Bernhard!
I tried but I didn't finde a "copy list to clipboard". I am using pharo1.0-10451-BETAdev09.09.3
3. Voilà !
There is even a "copy selection to clipboard".
This is Morphic at its best IMO.
Cheers, Bernhard
Am 24.09.2009 um 15:22 schrieb Mariano Martinez Peck:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
Bernhard: sorry I forgot this thread, but I couldn't see what you see :( ahaha very weird. Damien: I am a bit complicated right now but at least I opened a ticket so that to remember: http://code.google.com/p/pharo/issues/detail?id=1281 Best, Mariano 2009/9/24 Bernhard Pieber <bernhard@pieber.com>
Hi Mariano, I just tried it with a newly downloaded pharo1.0-10451-BETAdev09.09.3 and it worked in all lists of the TestRunner. See screenshots below.
Cheers, Bernhard
Am 24.09.2009 um 19:20 schrieb Mariano Martinez Peck:
On Thu, Sep 24, 2009 at 2:07 PM, Bernhard Pieber <bernhard@pieber.com>wrote:
Hi Mariano,
I agree it would be a cool feature to add to the TestRunner. I guess it is even quite simple.
In the meantime this is what I do: 1. Shift-Click with middle mouse button on the list, so that the halos for the PluggableListMorphPlus are show. 2. Click on the red Menu halo and select the menu item "copy list to clipboard".
Hi Bernhard!
I tried but I didn't finde a "copy list to clipboard". I am using pharo1.0-10451-BETAdev09.09.3
3. Voilà !
There is even a "copy selection to clipboard".
This is Morphic at its best IMO.
Cheers, Bernhard
Am 24.09.2009 um 15:22 schrieb Mariano Martinez Peck:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
I used to do same things, when need to copy text somewhere outside the squeak. But i think this is not a newbie solution, yet it quite simple & obvious once you know how to work with morphs. :) Another way, even if you don't have this 'copy list to clipboard' sometimes, you can always inspect the morph and extract any data & model it displaying. 2009/9/25 Bernhard Pieber <bernhard@pieber.com>
Hi Mariano, I just tried it with a newly downloaded pharo1.0-10451-BETAdev09.09.3 and it worked in all lists of the TestRunner. See screenshots below.
Cheers, Bernhard
Am 24.09.2009 um 19:20 schrieb Mariano Martinez Peck:
On Thu, Sep 24, 2009 at 2:07 PM, Bernhard Pieber <bernhard@pieber.com>wrote:
Hi Mariano,
I agree it would be a cool feature to add to the TestRunner. I guess it is even quite simple.
In the meantime this is what I do: 1. Shift-Click with middle mouse button on the list, so that the halos for the PluggableListMorphPlus are show. 2. Click on the red Menu halo and select the menu item "copy list to clipboard".
Hi Bernhard!
I tried but I didn't finde a "copy list to clipboard". I am using pharo1.0-10451-BETAdev09.09.3
3. Voilà !
There is even a "copy selection to clipboard".
This is Morphic at its best IMO.
Cheers, Bernhard
Am 24.09.2009 um 15:22 schrieb Mariano Martinez Peck:
Hi folks: Several times, I wanted to send by email for example, the results of running some tests. The only and ugly way I found to do this is using PrintScreen and send the screenshots. Now, the question is, is there a way to file out the results? Not only the amount (the number) of success, failures, error, expected failures, but also which tests where the failures, errors, etc.
I would love to do this from the Test Runner, no by code.
Best,
Mariano _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- Best regards, Igor Stasenko AKA sig.
participants (7)
-
Bernhard Pieber -
Damien Cassou -
Igor Stasenko -
Mariano Martinez Peck -
Michael Roberts -
Simon Denier -
Stéphane Ducasse