Ok, i checked this problem with three vms and the results are pretty similar between them (while they are different from Sven's)...
- self compiled latest pharo vm
- latest vm from get.pharo.org
- stable vm from get.pharo.org

"PharoVM self compiled"
Smalltalk vm version �'NBCoInterpreter NativeBoost-CogPlugin-GuillermoPolito.19 uuid: acc98e51-2fba-4841-a965-2975997bba66 Jun 16 2013, NBCogit NativeBoost-CogPlugin-GuillermoPolito.19 uuid: acc98e51-2fba-4841-a965-2975997bba66 Jun 16 2013, git@gitorious.org:cogvm/blessed.git Commit: 0505d0c93504af2ad6dbd4cc580e6732120363d7 Date: 2013-06-12 16:26:39 +0200 By: Esteban Lorenzano <estebanlm@gmail.com> '

[ SystemNavigation new allCallsOn: #ifTrue: ] timeToRun 124 129

[ SystemNavigation new browseAllCallsOn: #ifTrue: ] timeToRun 4977 4688

"From our servers latest"
Smalltalk vm version 'NBCoInterpreter NativeBoost-CogPlugin-GuillermoPolito.19 uuid: acc98e51-2fba-4841-a965-2975997bba66 May 31 2013, NBCogit NativeBoost-CogPlugin-GuillermoPolito.19 uuid: acc98e51-2fba-4841-a965-2975997bba66 May 31 2013, git://gitorious.org/cogvm/blessed.git Commit: 0f562e0afe14e533470278943b5d65d42ea133c2 Date: 2013-05-30 16:38:08 +0200 By: Igor Stasenko <siguctua@gmail.com> Jenkins build #14595'

[ SystemNavigation new allCallsOn: #ifTrue: ] timeToRun 123 124

[ SystemNavigation new browseAllCallsOn: #ifTrue: ] timeToRun 5187 5578

"From our servers stable"
Smalltalk vm version 'NBCoInterpreter NativeBoost-CogPlugin-EstebanLorenzano.18 uuid: a53445f9-c0c0-4015-97a3-be7db8d9ed6b Mar 13 2013, NBCogit NativeBoost-CogPlugin-EstebanLorenzano.18 uuid: a53445f9-c0c0-4015-97a3-be7db8d9ed6b Mar 13 2013, git://gitorious.org/cogvm/blessed.git Commit: 412abef33cbed05cf1d75329e451d71c0c6aa5a7 Date: 2013-03-13 17:48:50 +0100 By: Esteban Lorenzano <estebanlm@gmail.com> Jenkins build #14535'

[ SystemNavigation new allCallsOn: #ifTrue: ] timeToRun 123 122

[ SystemNavigation new browseAllCallsOn: #ifTrue: ] timeToRun 5429 5036


ideas?
Guille


On Sun, Jun 16, 2013 at 2:22 PM, Camillo Bruni <camillobruni@gmail.com> wrote:

On 2013-06-15, at 18:09, St�phane Ducasse <stephane.ducasse@inria.fr> wrote:

>
> On Jun 15, 2013, at 3:54 PM, Camillo Bruni <camillobruni@gmail.com> wrote:
>
>>
>> On 2013-06-15, at 13:16, St�phane Ducasse <stephane.ducasse@inria.fr> wrote:
>>
>>>
>>>> actually https://ci.inria.fr/pharo/view/VM/job/PharoVM-tests/ succesfully detected the degeneration and thus failed.
>>>> And yes, we will add real benchmarks at some point. But for that we first need dedicated machines, as running them on a virtualized environment doesn't make much sense :/.
>>>
>>> What do we need to start?
>>
>> some machines :) as long as they are ours it doesn't really matter what size as long as they only run benchmarks.
>> the current mac slave is not the best choice as it will be under load from jenkins�
>
> Is a another mac ok?

sure :) whatever dedicated machine will do, I think the only requirement is, that at least OSX 10.6 runs on it. (or we can always install a linux on top :P)

>> Anne told me that there is sort of a service from inria where they provide certain machines for benchmarking
>
> I do not know but we can ask.

I will check on monday...