[Pharo-project] Jenkis is testing twice (or counting twice)
Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples: https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collection... https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMe... Of course, running those tests from a normal TestRunner I see the correct amount of tests. Any ideas? -- Mariano http://marianopeck.wordpress.com
Divide by two? *Somebody* was going to say it :) On the optimistic side, the tests are being used and results reported. ________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr [pharo-project-bounces@lists.gforge.inria.fr] On Behalf Of Mariano Martinez Peck [marianopeck@gmail.com] Sent: Wednesday, October 05, 2011 3:50 PM To: Pharo Development Subject: [Pharo-project] Jenkis is testing twice (or counting twice) Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples: https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collection... https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMe... Of course, running those tests from a normal TestRunner I see the correct amount of tests. Any ideas? -- Mariano http://marianopeck.wordpress.com
On Wed, Oct 5, 2011 at 10:15 PM, Schwab,Wilhelm K <bschwab@anest.ufl.edu>wrote:
Divide by two?
*Somebody* was going to say it :)
hehehehheheh. But the problem is that you know to which packages you have to divide. Because it affects only some of them, not all ;)
On the optimistic side, the tests are being used and results reported.
________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr [ pharo-project-bounces@lists.gforge.inria.fr] On Behalf Of Mariano Martinez Peck [marianopeck@gmail.com] Sent: Wednesday, October 05, 2011 3:50 PM To: Pharo Development Subject: [Pharo-project] Jenkis is testing twice (or counting twice)
Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples:
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collection...
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMe...
Of course, running those tests from a normal TestRunner I see the correct amount of tests.
Any ideas?
-- Mariano http://marianopeck.wordpress.com
-- Mariano http://marianopeck.wordpress.com
Mariano, You are, of course, correct in wanting to fix it. Do the troublesome tests result in debug logs? If not, could that be made to happen? There is no guarantee that it will show itself this way, but it might be worth a try. Bill ________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr [pharo-project-bounces@lists.gforge.inria.fr] On Behalf Of Mariano Martinez Peck [marianopeck@gmail.com] Sent: Wednesday, October 05, 2011 4:48 PM To: Pharo-project@lists.gforge.inria.fr Subject: Re: [Pharo-project] Jenkis is testing twice (or counting twice) On Wed, Oct 5, 2011 at 10:15 PM, Schwab,Wilhelm K <bschwab@anest.ufl.edu<mailto:bschwab@anest.ufl.edu>> wrote: Divide by two? *Somebody* was going to say it :) hehehehheheh. But the problem is that you know to which packages you have to divide. Because it affects only some of them, not all ;) On the optimistic side, the tests are being used and results reported. ________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr<mailto:pharo-project-bounces@lists.gforge.inria.fr> [pharo-project-bounces@lists.gforge.inria.fr<mailto:pharo-project-bounces@lists.gforge.inria.fr>] On Behalf Of Mariano Martinez Peck [marianopeck@gmail.com<mailto:marianopeck@gmail.com>] Sent: Wednesday, October 05, 2011 3:50 PM To: Pharo Development Subject: [Pharo-project] Jenkis is testing twice (or counting twice) Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples: https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collection... https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMe... Of course, running those tests from a normal TestRunner I see the correct amount of tests. Any ideas? -- Mariano http://marianopeck.wordpress.com -- Mariano http://marianopeck.wordpress.com
On Thu, Oct 6, 2011 at 2:49 AM, Schwab,Wilhelm K <bschwab@anest.ufl.edu>wrote:
Mariano,
You are, of course, correct in wanting to fix it. Do the troublesome tests result in debug logs?
No, because they succeed :( You can see it here: https://ci.lille.inria.fr/pharo/job/Fuel/465/testReport/FuelTests.InternalMe... I think it is something related to HDTestReport of HudsonBuildTools Lukas any idea? If not, could that be made to happen? There is no guarantee that it will
show itself this way, but it might be worth a try.
Bill
________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr [ pharo-project-bounces@lists.gforge.inria.fr] On Behalf Of Mariano Martinez Peck [marianopeck@gmail.com] Sent: Wednesday, October 05, 2011 4:48 PM To: Pharo-project@lists.gforge.inria.fr Subject: Re: [Pharo-project] Jenkis is testing twice (or counting twice)
On Wed, Oct 5, 2011 at 10:15 PM, Schwab,Wilhelm K <bschwab@anest.ufl.edu <mailto:bschwab@anest.ufl.edu>> wrote: Divide by two?
*Somebody* was going to say it :)
hehehehheheh. But the problem is that you know to which packages you have to divide. Because it affects only some of them, not all ;)
On the optimistic side, the tests are being used and results reported.
________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr<mailto: pharo-project-bounces@lists.gforge.inria.fr> [ pharo-project-bounces@lists.gforge.inria.fr<mailto: pharo-project-bounces@lists.gforge.inria.fr>] On Behalf Of Mariano Martinez Peck [marianopeck@gmail.com<mailto:marianopeck@gmail.com>] Sent: Wednesday, October 05, 2011 3:50 PM To: Pharo Development Subject: [Pharo-project] Jenkis is testing twice (or counting twice)
Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples:
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collection...
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMe...
Of course, running those tests from a normal TestRunner I see the correct amount of tests.
Any ideas?
-- Mariano http://marianopeck.wordpress.com
-- Mariano http://marianopeck.wordpress.com
-- Mariano http://marianopeck.wordpress.com
Well, of course the problem was mine, since I was sending a list of CATEGORIES to HDTestReport runPackages: instead of packages.... On Mon, Oct 31, 2011 at 12:44 AM, Mariano Martinez Peck < marianopeck@gmail.com> wrote:
On Thu, Oct 6, 2011 at 2:49 AM, Schwab,Wilhelm K <bschwab@anest.ufl.edu>wrote:
Mariano,
You are, of course, correct in wanting to fix it. Do the troublesome tests result in debug logs?
No, because they succeed :(
You can see it here: https://ci.lille.inria.fr/pharo/job/Fuel/465/testReport/FuelTests.InternalMe...
I think it is something related to HDTestReport of HudsonBuildTools
Lukas any idea?
If not, could that be made to happen? There is no guarantee that it will
show itself this way, but it might be worth a try.
Bill
________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr [ pharo-project-bounces@lists.gforge.inria.fr] On Behalf Of Mariano Martinez Peck [marianopeck@gmail.com] Sent: Wednesday, October 05, 2011 4:48 PM To: Pharo-project@lists.gforge.inria.fr Subject: Re: [Pharo-project] Jenkis is testing twice (or counting twice)
On Wed, Oct 5, 2011 at 10:15 PM, Schwab,Wilhelm K <bschwab@anest.ufl.edu <mailto:bschwab@anest.ufl.edu>> wrote: Divide by two?
*Somebody* was going to say it :)
hehehehheheh. But the problem is that you know to which packages you have to divide. Because it affects only some of them, not all ;)
On the optimistic side, the tests are being used and results reported.
________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr<mailto: pharo-project-bounces@lists.gforge.inria.fr> [ pharo-project-bounces@lists.gforge.inria.fr<mailto: pharo-project-bounces@lists.gforge.inria.fr>] On Behalf Of Mariano Martinez Peck [marianopeck@gmail.com<mailto:marianopeck@gmail.com>] Sent: Wednesday, October 05, 2011 3:50 PM To: Pharo Development Subject: [Pharo-project] Jenkis is testing twice (or counting twice)
Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples:
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collection...
https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMe...
Of course, running those tests from a normal TestRunner I see the correct amount of tests.
Any ideas?
-- Mariano http://marianopeck.wordpress.com
-- Mariano http://marianopeck.wordpress.com
-- Mariano http://marianopeck.wordpress.com
-- Mariano http://marianopeck.wordpress.com
Nice catch! Things like that can be frustrating to find. But it gets to something I generally tell myself while chasing what seems to be a disproportionately stubborn defect: when Smalltalk fails, it usually does so for a "good" reason. By that, I mean that Smalltalk systems generally do just what we humans told them to do. Bill ________________________________ From: pharo-project-bounces@lists.gforge.inria.fr [pharo-project-bounces@lists.gforge.inria.fr] on behalf of Mariano Martinez Peck [marianopeck@gmail.com] Sent: Sunday, October 30, 2011 7:55 PM To: Pharo-project@lists.gforge.inria.fr Subject: Re: [Pharo-project] Jenkis is testing twice (or counting twice) Well, of course the problem was mine, since I was sending a list of CATEGORIES to HDTestReport runPackages: instead of packages.... On Mon, Oct 31, 2011 at 12:44 AM, Mariano Martinez Peck <marianopeck@gmail.com<mailto:marianopeck@gmail.com>> wrote: On Thu, Oct 6, 2011 at 2:49 AM, Schwab,Wilhelm K <bschwab@anest.ufl.edu<mailto:bschwab@anest.ufl.edu>> wrote: Mariano, You are, of course, correct in wanting to fix it. Do the troublesome tests result in debug logs? No, because they succeed :( You can see it here: https://ci.lille.inria.fr/pharo/job/Fuel/465/testReport/FuelTests.InternalMe... I think it is something related to HDTestReport of HudsonBuildTools Lukas any idea? If not, could that be made to happen? There is no guarantee that it will show itself this way, but it might be worth a try. Bill ________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr<mailto:pharo-project-bounces@lists.gforge.inria.fr> [pharo-project-bounces@lists.gforge.inria.fr<mailto:pharo-project-bounces@lists.gforge.inria.fr>] On Behalf Of Mariano Martinez Peck [marianopeck@gmail.com<mailto:marianopeck@gmail.com>] Sent: Wednesday, October 05, 2011 4:48 PM To: Pharo-project@lists.gforge.inria.fr<mailto:Pharo-project@lists.gforge.inria.fr> Subject: Re: [Pharo-project] Jenkis is testing twice (or counting twice) On Wed, Oct 5, 2011 at 10:15 PM, Schwab,Wilhelm K <bschwab@anest.ufl.edu<mailto:bschwab@anest.ufl.edu><mailto:bschwab@anest.ufl.edu<mailto:bschwab@anest.ufl.edu>>> wrote: Divide by two? *Somebody* was going to say it :) hehehehheheh. But the problem is that you know to which packages you have to divide. Because it affects only some of them, not all ;) On the optimistic side, the tests are being used and results reported. ________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr<mailto:pharo-project-bounces@lists.gforge.inria.fr><mailto:pharo-project-bounces@lists.gforge.inria.fr<mailto:pharo-project-bounces@lists.gforge.inria.fr>> [pharo-project-bounces@lists.gforge.inria.fr<mailto:pharo-project-bounces@lists.gforge.inria.fr><mailto:pharo-project-bounces@lists.gforge.inria.fr<mailto:pharo-project-bounces@lists.gforge.inria.fr>>] On Behalf Of Mariano Martinez Peck [marianopeck@gmail.com<mailto:marianopeck@gmail.com><mailto:marianopeck@gmail.com<mailto:marianopeck@gmail.com>>] Sent: Wednesday, October 05, 2011 3:50 PM To: Pharo Development Subject: [Pharo-project] Jenkis is testing twice (or counting twice) Take as an example Fuel. For 2 of the 6 packages, it runs the tests twice. Or at least they are count twice. Examples: https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.Collection... https://ci.lille.inria.fr/pharo/job/Fuel/369/testReport/FuelTests.InternalMe... Of course, running those tests from a normal TestRunner I see the correct amount of tests. Any ideas? -- Mariano http://marianopeck.wordpress.com -- Mariano http://marianopeck.wordpress.com -- Mariano http://marianopeck.wordpress.com -- Mariano http://marianopeck.wordpress.com
participants (2)
-
Mariano Martinez Peck -
Schwab,Wilhelm K