- Pharo-users - lists.pharo.org

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by Marcus Denker

On Jul 29, 2013, at 4:08 PM, "phil(a)highoctane.be" <phil(a)highoctane.be> wrote: > Yes, I did. I do regular saves and then a final save and quit. > > How can I know if the AST cache is large in a running image? > This can not happen in 2.0, as method #ast has not senders. #parseTree does not cache. Marcus

July 29, 2013

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by phil＠highoctane.be

Yes, I did. I do regular saves and then a final save and quit. How can I know if the AST cache is large in a running image? Phil On Mon, Jul 29, 2013 at 3:53 PM, ClÃ©ment Bera <bera.clement(a)gmail.com>wrote: > A possibility would be the AST cache. During development, if you do things > like recompileAll or load packages the AST cache can grow the image size up > to 300 Mo. But this cache is deleted when saving & quitting the image. > > Did you save and quit the image before looking at the memory size ? > > It might also be bugs related to Morph as you suggested because there was > refactoring in it. We are investigating. > > > 2013/7/29 Marcus Denker <marcus.denker(a)inria.fr> > >> >> On Jul 29, 2013, at 11:29 AM, phil(a)highoctane.be wrote: >> >> > Hello, >> > >> > I've been loading all of those packages in order to build a full web >> stack development image. >> > >> > Everything now loads fine and kind of works but... >> > >> > The image is really slowing down and the size is getting very large. >> > >> > Here is the current one: >> > >> > 332580684 29 jul 10:50 >> Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image >> > >> > 300+ megs... >> > >> >> Can you try to execute >> >> ImageCleaner cleanUpForRelease >> >> This way we know if maybe some cache is hanging onto something. >> >> > I've been doing some development in there and started looking for why >> this was getting so large and slow. >> > >> > I did a SpaceTally print analysis and imported the results in a >> spreadsheet. >> > >> > Look at the top consumers, especially the Semaphore thing. It is way >> beyond whatever was expected. There is something wrong there. >> > >> > There must be a leak of Points, MorphExtensions and I can't just figure >> out why there are so many Floats. >> > >> MorphExtension should only be referenced by the Morph it extends. So >> there should always be more Morphs than extensions. >> This looks really strange. >> >> Marcus >> >> >> >

July 29, 2013

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by ClÃ©ment Bera

A possibility would be the AST cache. During development, if you do things like recompileAll or load packages the AST cache can grow the image size up to 300 Mo. But this cache is deleted when saving & quitting the image. Did you save and quit the image before looking at the memory size ? It might also be bugs related to Morph as you suggested because there was refactoring in it. We are investigating. 2013/7/29 Marcus Denker <marcus.denker(a)inria.fr> > > On Jul 29, 2013, at 11:29 AM, phil(a)highoctane.be wrote: > > > Hello, > > > > I've been loading all of those packages in order to build a full web > stack development image. > > > > Everything now loads fine and kind of works but... > > > > The image is really slowing down and the size is getting very large. > > > > Here is the current one: > > > > 332580684 29 jul 10:50 > Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image > > > > 300+ megs... > > > > Can you try to execute > > ImageCleaner cleanUpForRelease > > This way we know if maybe some cache is hanging onto something. > > > I've been doing some development in there and started looking for why > this was getting so large and slow. > > > > I did a SpaceTally print analysis and imported the results in a > spreadsheet. > > > > Look at the top consumers, especially the Semaphore thing. It is way > beyond whatever was expected. There is something wrong there. > > > > There must be a leak of Points, MorphExtensions and I can't just figure > out why there are so many Floats. > > > MorphExtension should only be referenced by the Morph it extends. So there > should always be more Morphs than extensions. > This looks really strange. > > Marcus > > >

July 29, 2013

Re: [Pharo-users] [Voyage] Using OID as a domain object identifier

by Norbert Hartl

Am 29.07.2013 um 15:46 schrieb "Esteban A. Maringolo" <emaringolo(a)gmail.com>: > Hi all, > > Is it a good practice to use the OID value (anInteger) as an > "external" identifier of your domain object? > > Let's suppose I have a collection of "People", as I save them in the > collection, it will automatically create OIDs for them. > > But let's suppose I want to map that person to a RESTful URI, would it > be "legal" to use its OID as part of the URI? > > E.g. mydomain.com/people/123456790 > where 123456790 is the OID value. > > I like OID/UUIDs, and I don't want to duplicate that logic in my app. > I think for your purpose OID will be fine but I'm not sure. I use UUIDs. You can instruct mongo to use a UUID instead of an OID. Works flawlessly. Norbert

July 29, 2013

[Voyage] Using OID as a domain object identifier

by Esteban A. Maringolo

Hi all, Is it a good practice to use the OID value (anInteger) as an "external" identifier of your domain object? Let's suppose I have a collection of "People", as I save them in the collection, it will automatically create OIDs for them. But let's suppose I want to map that person to a RESTful URI, would it be "legal" to use its OID as part of the URI? E.g. mydomain.com/people/123456790 where 123456790 is the OID value. I like OID/UUIDs, and I don't want to duplicate that logic in my app. Regards, Esteban A. Maringolo

July 29, 2013

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by phil＠highoctane.be

I did. No significant change. --- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller On Mon, Jul 29, 2013 at 2:20 PM, Marcus Denker <marcus.denker(a)inria.fr>wrote: > > On Jul 29, 2013, at 11:29 AM, phil(a)highoctane.be wrote: > > > Hello, > > > > I've been loading all of those packages in order to build a full web > stack development image. > > > > Everything now loads fine and kind of works but... > > > > The image is really slowing down and the size is getting very large. > > > > Here is the current one: > > > > 332580684 29 jul 10:50 > Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image > > > > 300+ megs... > > > > Can you try to execute > > ImageCleaner cleanUpForRelease > > This way we know if maybe some cache is hanging onto something. > > > I've been doing some development in there and started looking for why > this was getting so large and slow. > > > > I did a SpaceTally print analysis and imported the results in a > spreadsheet. > > > > Look at the top consumers, especially the Semaphore thing. It is way > beyond whatever was expected. There is something wrong there. > > > > There must be a leak of Points, MorphExtensions and I can't just figure > out why there are so many Floats. > > > MorphExtension should only be referenced by the Morph it extends. So there > should always be more Morphs than extensions. > This looks really strange. > > Marcus > > > >

July 29, 2013

Re: [Pharo-users] Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower

by phil＠highoctane.be

What Metacello line ? :-) I see that we are navigating the same kinds of waters with these things. Hopefully for the best. I am also quite concerned about the image doing blocking calls w/ databases etc. Phil On Mon, Jul 29, 2013 at 2:11 PM, Mariano Martinez Peck < marianopeck(a)gmail.com> wrote: > > > > On Mon, Jul 29, 2013 at 9:02 AM, phil(a)highoctane.be <phil(a)highoctane.be>wrote: > >> Yes, same for me here. >> >> I'll update my configuration to load everything in a fresh 2.0 and report >> the results. >> >> Thing is that loading that full configuration takes ages (GlorpDBX is >> taking 20 minutes to load...) and the VM gets the SmallInteger bug >> triggered with such a large config... >> > > It's easy to fix workaround SmallInteger add issue. Just one line of code > in Metacello. > And yes, it takes ages. I also build an app that loads Seaside, Magritte3, > GlorpDBX, etc and it takes quite a lot. > Esteban did something to improve Monticello loading in Pharo 3.0....but > that's 3.0, not 2.0... > > >> >> I really need to get to grips with what happens down there. >> >> Phil >> >> On Monday, July 29, 2013, Sebastian Tleye wrote: >> >>> Try loading the packages each one at time, and between packages save the >>> image and check if it is growing. >>> >>> >>> 2013/7/29 Sebastian Tleye <stleye(a)gmail.com> >>> >>> What also happened to me, is that, each time i saved the image (even if >>> i did nothing), the image was growing its size. >>> >>> >>> 2013/7/29 Sebastian Tleye <stleye(a)gmail.com> >>> >>> Mmm, so i'm not sure. >>> I remember, when i had this problem, i was using directly changeSets, i >>> solved the problem doing "FileIn entire file" instead of "Install into a >>> new change set" (when you drag a changeset into Pharo). But it was like a >>> random bug since i haven't had that problem again (even using "Install into >>> a new change set" >>> >>> >>> 2013/7/29 phil(a)highoctane.be <phil(a)highoctane.be> >>> >>> Hi Sebastian, >>> >>> No, not intentionally. My code is going into the default change set and >>> there isn't that much. >>> >>> But... when looking at the Changes Sorter, there are indeed a lot of >>> entries related to all of those modules (due to the configurations being >>> loaded I guess - see screenshots for samples, the list is much longer). >>> >>> Phil >>> >>> >>> >>> >>> On Mon, Jul 29, 2013 at 11:39 AM, Sebastian Tleye <stleye(a)gmail.com>wrote: >>> >>> Hi Phil >>> >>> Have you been using changeSets? >>> I had the same problem once, i couldn't figure out what the problem was, >>> but i think there is a problem in the sorter tool (and change sets). >>> >>> >>> >>> 2013/7/29 phil(a)highoctane.be <phil(a)highoctane.be> >>> >>> Hello, >>> >>> I've been loading all of those packages in order to build a full web >>> stack development image. >>> >>> Everything now loads fine and kind of works but... >>> >>> The image is really slowing down and the size is getting very large. >>> >>> Here is the current one: >>> >>> 332580684 29 jul 10:50 >>> Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image >>> >>> 300+ megs... >>> >>> I've been doing some development in there and started looking for why >>> this was getting so large and slow. >>> >>> I did a SpaceTally print analysis and imported the results in a >>> spreadsheet. >>> >>> Look at the top consumers, especially the Semaphore thing. It is way >>> beyond whatever was expected. There is something wrong there. >>> >>> There must be a leak of Points, MorphExtensions and I can't just figure >>> out why there are so many Floats. >>> >>> I've been running test suites for some of the packages (e.g. OpenDBX and >>> Glorp) and this may be the result. >>> >>> This image is kind of what one doing web dev would end up with. >>> >>> But then, it is very hard to get rid of that unwanted space. >>> >>> I am trying to build a system I can start using for business projects >>> and feel concerned about that memory growth very seriously. >>> >>> Any pointers (I chased some already but here, there are way too many >>> entries) >>> >>> Thx >>> >>> Phil >>> >>> >>> >>> >>> >> >> -- >> --- >> Philippe Back >> Dramatic Performance Improvements >> Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 >> Mail:phil@highoctane.be | Web: http://philippeback.eu >> Blog: http://philippeback.be | Twitter: @philippeback >> Youtube: http://www.youtube.com/user/philippeback/videos >> >> High Octane SPRL >> rue cour Boisacq 101 | 1301 Bierges | Belgium >> >> Featured on the Software Process and Measurement Cast >> http://spamcast.libsyn.com >> Sparx Systems Enterprise Architect and Ability Engineering EADocX Value >> Added Reseller >> >> >> >> > > > -- > Mariano > http://marianopeck.wordpress.com >

July 29, 2013

Re: [Pharo-users] Bug in Date>>readFrom:pattern: ? Pharo2.0

by Marcus Denker

On Jul 29, 2013, at 2:34 PM, JosÃ© ComesaÃ±a <jose.comesana(a)gmail.com> wrote: > It was already discussed and modified: https://pharo.fogbugz.com/default.asp?10869 > This one is just an open reportâ¦ no action was done. I have merged it into Issue 11222 But there is a third issue about exactly the same, this I think is from you: 10870 Corrections to Date class >>readFrom:pattern: https://pharo.fogbugz.com/f/cases/10870 > Regards > > 2013/7/24 Sabine KnÃ¶fel <sabine.knoefel(a)gmail.com> > Hi, > > Date readFrom: '4.2.13' readStream pattern: 'd.m.yy' > > Does not return 4.2.2013 but 4.2.0013 > > The comment is saying > "A year given using only two decimals is considered to be >2000" > > So, the comment is not ok or this is a bug? > > Sabine > > > > -- > View this message in context: http://forum.world.st/Bug-in-Date-readFrom-pattern-Pharo2-0-tp4700427.html > Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. > >

July 29, 2013

Re: [Pharo-users] Voyage: Circular references

by Esteban Lorenzano

Hi Sabine, I'm really sorry, I just went on vacations when you sent this mail :( Is this problem persisting? Did you reach a solution? Can I help you with something? Esteban On Jul 19, 2013, at 12:56 PM, Sabine KnÃ¶fel <sabine.knoefel(a)gmail.com> wrote: > Hi Esteban, > > thanks! > > I think the solution of Bernat will not be enough for me. > I added the class methods isVoyageRoot to the root objects (like trip, > country and so on). > > But I have instances which should never be persistent, e.g. the > country I mentioned. The Country has currencies and expense rates and > this is a lot of stuff...this should be only transient in the image. > > The transient country is referenced by persistent instances of trip. > (countrie does naturally not point to trips) > > Trip (persistant) -> Country (transient) > > If I try to save a trip, voyage at some point enters > >>rawReference: description: > and there, it looks whether anObject (a country) isNew: > isNew means the other object, the country has an _id (mongo id). > > The country does not have an id and for this reason, voyage tries to > make it persistent although its class has isVogageRoot false. > And than the system enters a point where it tries to make so many > objects persistent that the image does not respond anymore. > > So, my question is: is it possible to define > "In class trip, there is an inst var country -> voyage please save > only a symbol here" > and > "voyage, if loading a trip, for inst var country, do shting" > > Sure, I could save symbols within the trips country inst var all the time > and get the country it if needed, but it would be nicer if voyage coud > do that for me .-) > > Sabine > > > > > > On Fri, Jul 19, 2013 at 11:52 AM, EstebanLM [via Smalltalk] > <[hidden email]> wrote: > > > Hi Sabine, > > > > If Bernat help is not enough, I would like to have some more insight on your > > problem, so If you can put here a better description of your model and the > > problem you are having, I will have a look :) > > > > Esteban > > > > On Jul 19, 2013, at 10:42 AM, Bernat Romagosa <[hidden email]> wrote: > > > > Hi Sabine! > > > > If you want an object to be referenced by another, and not embedded in it, > > you need to give that object root entity. As a root, the object will have a > > collection of its own, and will be referenced by other objects by id. If the > > object is not root, it will be embedded inside the referring object as a > > property. > > > > So, to be safe, always set #isVoyageRoot to return true at class side of all > > objects you don't want to have embedded. In general, "big enough" objects > > who are referenced by different objects should be root. > > > > In my case, I had a centre which had users which had centres. Users also had > > projects, and projects also had users. Big mess, I know. Besides that, all > > users, centres and projects had profiles. My solution was to make centres, > > projects and users be roots, and let only the profiles be embedded. > > > > I hope this helped! > > > > Bernat. > > > > > > 2013/7/19 Sabine KnÃ¶fel <[hidden email]> > >> > >> Hi Esteban, > >> > >> yes, now the Rectangle Example works after doing the reset. > >> > >> But saving my model still leads to a non responding image because > >> Voyage is trying to write json for all model stuf deep deep deep and > >> circular. Perhaps same like: > >> http://forum.world.st/Voyage-Circular-references-td4691940.html#a4699436 > >> > >> I dont know anything about Magritte (yet) and I need a hint what to > >> define in my model so that it stops creating json at certain points > >> and creates only e.g. a Symbol. > >> > >> Example: My model instance of trip has a connection to an instance of > >> country. The country should not be written in json with all its > >> definitions. Voyage should only write e.g. #germany in the json and > >> later, when getting the instance back from the database, I want to > >> reassign the trip to the country. > >> > >> I already implemented this stuff when working witk Mongotalk the last > >> months and it worked fine. But my question yesterday: > >> > >> http://forum.world.st/MongoDB-open-close-in-production-singleton-or-not-td4… > >> lead to my impression that I should use voyage. > >> > >> So, how can I define the "borders"? > >> > >> Sabine > >> > >> On Thu, Jul 18, 2013 at 7:45 PM, EstebanLM [via Smalltalk] > >> <[hidden email]> wrote: > >> > >> > Hi Sabine, > >> > > >> > Probably you do not missed anything. > >> > Probably I missed to update the voyage configuration :) > >> > > >> > can you try doing > >> > > >> > VOMongoRepository allInstancesDo: #reset. > >> > > >> > before trying again? > >> > > >> > Cheers, > >> > Esteban > >> > > >> > On Jul 18, 2013, at 6:31 PM, Sabine KnÃ¶fel <[hidden email]> wrote: > >> > >> > > >> >> I found this: > >> >> http://smallworks.eu/web/blog/2013-06-14-voyage-the-adventure > >> >> > >> >> Chapter "Enhancing storage" > >> >> But if I add the 3+1 methods to Rectangle, and save it again, the json > >> >> did > >> >> not change. > >> >> > >> >> Did I miss something? > >> >> > >> >> > >> >> > >> >> > >> >> -- > >> >> View this message in context: > >> >> http://forum.world.st/Voyage-Circular-references-tp4691940p4699436.html > >> >> Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. > >> >> > >> > > >> > > >> > > >> > > >> > ________________________________ > >> > If you reply to this email, your message will be added to the discussion > >> > below: > >> > http://forum.world.st/Voyage-Circular-references-tp4691940p4699443.html > >> > To unsubscribe from Voyage: Circular references, click here. > >> > NAML > >> > >> ________________________________ > >> View this message in context: Re: Voyage: Circular references > >> > >> Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. > > > > > > > > > > -- > > Bernat Romagosa. > > > > > > > > > > ________________________________ > > If you reply to this email, your message will be added to the discussion > > below: > > http://forum.world.st/Voyage-Circular-references-tp4691940p4699516.html > > To unsubscribe from Voyage: Circular references, click here. > > NAML > > View this message in context: Re: Voyage: Circular references > Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.

July 29, 2013

Re: [Pharo-users] Bug in Date>>readFrom:pattern: ? Pharo2.0

by JosÃ© ComesaÃ±a

It was already discussed and modified: https://pharo.fogbugz.com/default.asp?10869 Regards 2013/7/24 Sabine KnÃ¶fel <sabine.knoefel(a)gmail.com> > Hi, > > Date readFrom: '4.2.13' readStream pattern: 'd.m.yy' > > Does not return 4.2.2013 but 4.2.0013 > > The comment is saying > "A year given using only two decimals is considered to be >2000" > > So, the comment is not ok or this is a bug? > > Sabine > > > > -- > View this message in context: > http://forum.world.st/Bug-in-Date-readFrom-pattern-Pharo2-0-tp4700427.html > Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. > >

July 29, 2013