July 2013 - Pharo-users - lists.pharo.org

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by Sebastian Tleye

Yes please (if it is not too much work :) ) I would like to check something. 2013/7/29 phil(a)highoctane.be <phil(a)highoctane.be> > I can send you my image but need to remove all my credentials from there > first. > > --- > Philippe Back > Dramatic Performance Improvements > Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 > Mail:phil@highoctane.be | Web: http://philippeback.eu > Blog: http://philippeback.be | Twitter: @philippeback > Youtube: http://www.youtube.com/user/philippeback/videos > > High Octane SPRL > rue cour Boisacq 101 | 1301 Bierges | Belgium > > Featured on the Software Process and Measurement Cast > http://spamcast.libsyn.com > Sparx Systems Enterprise Architect and Ability Engineering EADocX Value > Added Reseller > > > > > On Mon, Jul 29, 2013 at 4:43 PM, StÃ©phane Ducasse < > stephane.ducasse(a)inria.fr> wrote: > >> >> >> >> Look at the top consumers, especially the Semaphore thing. It is way >> beyond whatever was expected. There is something wrong there. >> >> >> >> There must be a leak of Points, MorphExtensions and I can't just >> figure out why there are so many Floats. >> >> >> > MorphExtension should only be referenced by the Morph it extends. So >> there should always be more Morphs than extensions. >> > This looks really strange. >> >> yes this is really strange. >> >> > >> > Marcus >> > >> > >> >> >> >> >

July 29, 2013

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by phil＠highoctane.be

I can send you my image but need to remove all my credentials from there first. --- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller On Mon, Jul 29, 2013 at 4:43 PM, StÃ©phane Ducasse <stephane.ducasse(a)inria.fr > wrote: > >> > >> Look at the top consumers, especially the Semaphore thing. It is way > beyond whatever was expected. There is something wrong there. > >> > >> There must be a leak of Points, MorphExtensions and I can't just figure > out why there are so many Floats. > >> > > MorphExtension should only be referenced by the Morph it extends. So > there should always be more Morphs than extensions. > > This looks really strange. > > yes this is really strange. > > > > > Marcus > > > > > > > >

July 29, 2013

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by StÃ©phane Ducasse

>> >> Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there. >> >> There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats. >> > MorphExtension should only be referenced by the Morph it extends. So there should always be more Morphs than extensions. > This looks really strange. yes this is really strange. > > Marcus > >

July 29, 2013

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by Marcus Denker

On Jul 29, 2013, at 4:08 PM, "phil(a)highoctane.be" <phil(a)highoctane.be> wrote: > Yes, I did. I do regular saves and then a final save and quit. > > How can I know if the AST cache is large in a running image? > This can not happen in 2.0, as method #ast has not senders. #parseTree does not cache. Marcus

July 29, 2013

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by phil＠highoctane.be

Yes, I did. I do regular saves and then a final save and quit. How can I know if the AST cache is large in a running image? Phil On Mon, Jul 29, 2013 at 3:53 PM, ClÃ©ment Bera <bera.clement(a)gmail.com>wrote: > A possibility would be the AST cache. During development, if you do things > like recompileAll or load packages the AST cache can grow the image size up > to 300 Mo. But this cache is deleted when saving & quitting the image. > > Did you save and quit the image before looking at the memory size ? > > It might also be bugs related to Morph as you suggested because there was > refactoring in it. We are investigating. > > > 2013/7/29 Marcus Denker <marcus.denker(a)inria.fr> > >> >> On Jul 29, 2013, at 11:29 AM, phil(a)highoctane.be wrote: >> >> > Hello, >> > >> > I've been loading all of those packages in order to build a full web >> stack development image. >> > >> > Everything now loads fine and kind of works but... >> > >> > The image is really slowing down and the size is getting very large. >> > >> > Here is the current one: >> > >> > 332580684 29 jul 10:50 >> Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image >> > >> > 300+ megs... >> > >> >> Can you try to execute >> >> ImageCleaner cleanUpForRelease >> >> This way we know if maybe some cache is hanging onto something. >> >> > I've been doing some development in there and started looking for why >> this was getting so large and slow. >> > >> > I did a SpaceTally print analysis and imported the results in a >> spreadsheet. >> > >> > Look at the top consumers, especially the Semaphore thing. It is way >> beyond whatever was expected. There is something wrong there. >> > >> > There must be a leak of Points, MorphExtensions and I can't just figure >> out why there are so many Floats. >> > >> MorphExtension should only be referenced by the Morph it extends. So >> there should always be more Morphs than extensions. >> This looks really strange. >> >> Marcus >> >> >> >

July 29, 2013

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by ClÃ©ment Bera

A possibility would be the AST cache. During development, if you do things like recompileAll or load packages the AST cache can grow the image size up to 300 Mo. But this cache is deleted when saving & quitting the image. Did you save and quit the image before looking at the memory size ? It might also be bugs related to Morph as you suggested because there was refactoring in it. We are investigating. 2013/7/29 Marcus Denker <marcus.denker(a)inria.fr> > > On Jul 29, 2013, at 11:29 AM, phil(a)highoctane.be wrote: > > > Hello, > > > > I've been loading all of those packages in order to build a full web > stack development image. > > > > Everything now loads fine and kind of works but... > > > > The image is really slowing down and the size is getting very large. > > > > Here is the current one: > > > > 332580684 29 jul 10:50 > Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image > > > > 300+ megs... > > > > Can you try to execute > > ImageCleaner cleanUpForRelease > > This way we know if maybe some cache is hanging onto something. > > > I've been doing some development in there and started looking for why > this was getting so large and slow. > > > > I did a SpaceTally print analysis and imported the results in a > spreadsheet. > > > > Look at the top consumers, especially the Semaphore thing. It is way > beyond whatever was expected. There is something wrong there. > > > > There must be a leak of Points, MorphExtensions and I can't just figure > out why there are so many Floats. > > > MorphExtension should only be referenced by the Morph it extends. So there > should always be more Morphs than extensions. > This looks really strange. > > Marcus > > >

July 29, 2013

Re: [Pharo-users] [Voyage] Using OID as a domain object identifier

by Norbert Hartl

Am 29.07.2013 um 15:46 schrieb "Esteban A. Maringolo" <emaringolo(a)gmail.com>: > Hi all, > > Is it a good practice to use the OID value (anInteger) as an > "external" identifier of your domain object? > > Let's suppose I have a collection of "People", as I save them in the > collection, it will automatically create OIDs for them. > > But let's suppose I want to map that person to a RESTful URI, would it > be "legal" to use its OID as part of the URI? > > E.g. mydomain.com/people/123456790 > where 123456790 is the OID value. > > I like OID/UUIDs, and I don't want to duplicate that logic in my app. > I think for your purpose OID will be fine but I'm not sure. I use UUIDs. You can instruct mongo to use a UUID instead of an OID. Works flawlessly. Norbert

July 29, 2013

[Voyage] Using OID as a domain object identifier

by Esteban A. Maringolo

Hi all, Is it a good practice to use the OID value (anInteger) as an "external" identifier of your domain object? Let's suppose I have a collection of "People", as I save them in the collection, it will automatically create OIDs for them. But let's suppose I want to map that person to a RESTful URI, would it be "legal" to use its OID as part of the URI? E.g. mydomain.com/people/123456790 where 123456790 is the OID value. I like OID/UUIDs, and I don't want to duplicate that logic in my app. Regards, Esteban A. Maringolo

July 29, 2013

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by phil＠highoctane.be

I did. No significant change. --- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller On Mon, Jul 29, 2013 at 2:20 PM, Marcus Denker <marcus.denker(a)inria.fr>wrote: > > On Jul 29, 2013, at 11:29 AM, phil(a)highoctane.be wrote: > > > Hello, > > > > I've been loading all of those packages in order to build a full web > stack development image. > > > > Everything now loads fine and kind of works but... > > > > The image is really slowing down and the size is getting very large. > > > > Here is the current one: > > > > 332580684 29 jul 10:50 > Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image > > > > 300+ megs... > > > > Can you try to execute > > ImageCleaner cleanUpForRelease > > This way we know if maybe some cache is hanging onto something. > > > I've been doing some development in there and started looking for why > this was getting so large and slow. > > > > I did a SpaceTally print analysis and imported the results in a > spreadsheet. > > > > Look at the top consumers, especially the Semaphore thing. It is way > beyond whatever was expected. There is something wrong there. > > > > There must be a leak of Points, MorphExtensions and I can't just figure > out why there are so many Floats. > > > MorphExtension should only be referenced by the Morph it extends. So there > should always be more Morphs than extensions. > This looks really strange. > > Marcus > > > >

July 29, 2013

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by phil＠highoctane.be

What Metacello line ? :-) I see that we are navigating the same kinds of waters with these things. Hopefully for the best. I am also quite concerned about the image doing blocking calls w/ databases etc. Phil On Mon, Jul 29, 2013 at 2:11 PM, Mariano Martinez Peck < marianopeck(a)gmail.com> wrote: > > > > On Mon, Jul 29, 2013 at 9:02 AM, phil(a)highoctane.be <phil(a)highoctane.be>wrote: > >> Yes, same for me here. >> >> I'll update my configuration to load everything in a fresh 2.0 and report >> the results. >> >> Thing is that loading that full configuration takes ages (GlorpDBX is >> taking 20 minutes to load...) and the VM gets the SmallInteger bug >> triggered with such a large config... >> > > It's easy to fix workaround SmallInteger add issue. Just one line of code > in Metacello. > And yes, it takes ages. I also build an app that loads Seaside, Magritte3, > GlorpDBX, etc and it takes quite a lot. > Esteban did something to improve Monticello loading in Pharo 3.0....but > that's 3.0, not 2.0... > > >> >> I really need to get to grips with what happens down there. >> >> Phil >> >> On Monday, July 29, 2013, Sebastian Tleye wrote: >> >>> Try loading the packages each one at time, and between packages save the >>> image and check if it is growing. >>> >>> >>> 2013/7/29 Sebastian Tleye <stleye(a)gmail.com> >>> >>> What also happened to me, is that, each time i saved the image (even if >>> i did nothing), the image was growing its size. >>> >>> >>> 2013/7/29 Sebastian Tleye <stleye(a)gmail.com> >>> >>> Mmm, so i'm not sure. >>> I remember, when i had this problem, i was using directly changeSets, i >>> solved the problem doing "FileIn entire file" instead of "Install into a >>> new change set" (when you drag a changeset into Pharo). But it was like a >>> random bug since i haven't had that problem again (even using "Install into >>> a new change set" >>> >>> >>> 2013/7/29 phil(a)highoctane.be <phil(a)highoctane.be> >>> >>> Hi Sebastian, >>> >>> No, not intentionally. My code is going into the default change set and >>> there isn't that much. >>> >>> But... when looking at the Changes Sorter, there are indeed a lot of >>> entries related to all of those modules (due to the configurations being >>> loaded I guess - see screenshots for samples, the list is much longer). >>> >>> Phil >>> >>> >>> >>> >>> On Mon, Jul 29, 2013 at 11:39 AM, Sebastian Tleye <stleye(a)gmail.com>wrote: >>> >>> Hi Phil >>> >>> Have you been using changeSets? >>> I had the same problem once, i couldn't figure out what the problem was, >>> but i think there is a problem in the sorter tool (and change sets). >>> >>> >>> >>> 2013/7/29 phil(a)highoctane.be <phil(a)highoctane.be> >>> >>> Hello, >>> >>> I've been loading all of those packages in order to build a full web >>> stack development image. >>> >>> Everything now loads fine and kind of works but... >>> >>> The image is really slowing down and the size is getting very large. >>> >>> Here is the current one: >>> >>> 332580684 29 jul 10:50 >>> Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image >>> >>> 300+ megs... >>> >>> I've been doing some development in there and started looking for why >>> this was getting so large and slow. >>> >>> I did a SpaceTally print analysis and imported the results in a >>> spreadsheet. >>> >>> Look at the top consumers, especially the Semaphore thing. It is way >>> beyond whatever was expected. There is something wrong there. >>> >>> There must be a leak of Points, MorphExtensions and I can't just figure >>> out why there are so many Floats. >>> >>> I've been running test suites for some of the packages (e.g. OpenDBX and >>> Glorp) and this may be the result. >>> >>> This image is kind of what one doing web dev would end up with. >>> >>> But then, it is very hard to get rid of that unwanted space. >>> >>> I am trying to build a system I can start using for business projects >>> and feel concerned about that memory growth very seriously. >>> >>> Any pointers (I chased some already but here, there are way too many >>> entries) >>> >>> Thx >>> >>> Phil >>> >>> >>> >>> >>> >> >> -- >> --- >> Philippe Back >> Dramatic Performance Improvements >> Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 >> Mail:phil@highoctane.be | Web: http://philippeback.eu >> Blog: http://philippeback.be | Twitter: @philippeback >> Youtube: http://www.youtube.com/user/philippeback/videos >> >> High Octane SPRL >> rue cour Boisacq 101 | 1301 Bierges | Belgium >> >> Featured on the Software Process and Measurement Cast >> http://spamcast.libsyn.com >> Sparx Systems Enterprise Architect and Ability Engineering EADocX Value >> Added Reseller >> >> >> >> > > > -- > Mariano > http://marianopeck.wordpress.com >

July 29, 2013