Pharo 2.0 with Seaside + DBXTalk + GlorpDBX + Magritte 3 + TWBS is getting slower and slower
Hello, I've been loading all of those packages in order to build a full web stack development image. Everything now loads fine and kind of works but... The image is really slowing down and the size is getting very large. Here is the current one: 332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image 300+ megs... I've been doing some development in there and started looking for why this was getting so large and slow. I did a SpaceTally print analysis and imported the results in a spreadsheet. Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there. There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats. I've been running test suites for some of the packages (e.g. OpenDBX and Glorp) and this may be the result. This image is kind of what one doing web dev would end up with. But then, it is very hard to get rid of that unwanted space. I am trying to build a system I can start using for business projects and feel concerned about that memory growth very seriously. Any pointers (I chased some already but here, there are way too many entries); Thx Phil
Hi Phil Have you been using changeSets? I had the same problem once, i couldn't figure out what the problem was, but i think there is a problem in the sorter tool (and change sets). 2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
I've been running test suites for some of the packages (e.g. OpenDBX and Glorp) and this may be the result.
This image is kind of what one doing web dev would end up with.
But then, it is very hard to get rid of that unwanted space.
I am trying to build a system I can start using for business projects and feel concerned about that memory growth very seriously.
Any pointers (I chased some already but here, there are way too many entries);
Thx
Phil
Hi Sebastian, No, not intentionally. My code is going into the default change set and there isn't that much. But... when looking at the Changes Sorter, there are indeed a lot of entries related to all of those modules (due to the configurations being loaded I guess - see screenshots for samples, the list is much longer). Phil On Mon, Jul 29, 2013 at 11:39 AM, Sebastian Tleye <stleye@gmail.com> wrote:
Hi Phil
Have you been using changeSets? I had the same problem once, i couldn't figure out what the problem was, but i think there is a problem in the sorter tool (and change sets).
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
I've been running test suites for some of the packages (e.g. OpenDBX and Glorp) and this may be the result.
This image is kind of what one doing web dev would end up with.
But then, it is very hard to get rid of that unwanted space.
I am trying to build a system I can start using for business projects and feel concerned about that memory growth very seriously.
Any pointers (I chased some already but here, there are way too many entries)
Thx
Phil
Mmm, so i'm not sure. I remember, when i had this problem, i was using directly changeSets, i solved the problem doing "FileIn entire file" instead of "Install into a new change set" (when you drag a changeset into Pharo). But it was like a random bug since i haven't had that problem again (even using "Install into a new change set" 2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hi Sebastian,
No, not intentionally. My code is going into the default change set and there isn't that much.
But... when looking at the Changes Sorter, there are indeed a lot of entries related to all of those modules (due to the configurations being loaded I guess - see screenshots for samples, the list is much longer).
Phil
On Mon, Jul 29, 2013 at 11:39 AM, Sebastian Tleye <stleye@gmail.com>wrote:
Hi Phil
Have you been using changeSets? I had the same problem once, i couldn't figure out what the problem was, but i think there is a problem in the sorter tool (and change sets).
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
I've been running test suites for some of the packages (e.g. OpenDBX and Glorp) and this may be the result.
This image is kind of what one doing web dev would end up with.
But then, it is very hard to get rid of that unwanted space.
I am trying to build a system I can start using for business projects and feel concerned about that memory growth very seriously.
Any pointers (I chased some already but here, there are way too many entries)
Thx
Phil
What also happened to me, is that, each time i saved the image (even if i did nothing), the image was growing its size. 2013/7/29 Sebastian Tleye <stleye@gmail.com>
Mmm, so i'm not sure. I remember, when i had this problem, i was using directly changeSets, i solved the problem doing "FileIn entire file" instead of "Install into a new change set" (when you drag a changeset into Pharo). But it was like a random bug since i haven't had that problem again (even using "Install into a new change set"
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hi Sebastian,
No, not intentionally. My code is going into the default change set and there isn't that much.
But... when looking at the Changes Sorter, there are indeed a lot of entries related to all of those modules (due to the configurations being loaded I guess - see screenshots for samples, the list is much longer).
Phil
On Mon, Jul 29, 2013 at 11:39 AM, Sebastian Tleye <stleye@gmail.com>wrote:
Hi Phil
Have you been using changeSets? I had the same problem once, i couldn't figure out what the problem was, but i think there is a problem in the sorter tool (and change sets).
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
I've been running test suites for some of the packages (e.g. OpenDBX and Glorp) and this may be the result.
This image is kind of what one doing web dev would end up with.
But then, it is very hard to get rid of that unwanted space.
I am trying to build a system I can start using for business projects and feel concerned about that memory growth very seriously.
Any pointers (I chased some already but here, there are way too many entries)
Thx
Phil
Try loading the packages each one at time, and between packages save the image and check if it is growing. 2013/7/29 Sebastian Tleye <stleye@gmail.com>
What also happened to me, is that, each time i saved the image (even if i did nothing), the image was growing its size.
2013/7/29 Sebastian Tleye <stleye@gmail.com>
Mmm, so i'm not sure. I remember, when i had this problem, i was using directly changeSets, i solved the problem doing "FileIn entire file" instead of "Install into a new change set" (when you drag a changeset into Pharo). But it was like a random bug since i haven't had that problem again (even using "Install into a new change set"
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hi Sebastian,
No, not intentionally. My code is going into the default change set and there isn't that much.
But... when looking at the Changes Sorter, there are indeed a lot of entries related to all of those modules (due to the configurations being loaded I guess - see screenshots for samples, the list is much longer).
Phil
On Mon, Jul 29, 2013 at 11:39 AM, Sebastian Tleye <stleye@gmail.com>wrote:
Hi Phil
Have you been using changeSets? I had the same problem once, i couldn't figure out what the problem was, but i think there is a problem in the sorter tool (and change sets).
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
I've been running test suites for some of the packages (e.g. OpenDBX and Glorp) and this may be the result.
This image is kind of what one doing web dev would end up with.
But then, it is very hard to get rid of that unwanted space.
I am trying to build a system I can start using for business projects and feel concerned about that memory growth very seriously.
Any pointers (I chased some already but here, there are way too many entries)
Thx
Phil
Yes, same for me here. I'll update my configuration to load everything in a fresh 2.0 and report the results. Thing is that loading that full configuration takes ages (GlorpDBX is taking 20 minutes to load...) and the VM gets the SmallInteger bug triggered with such a large config... I really need to get to grips with what happens down there. Phil On Monday, July 29, 2013, Sebastian Tleye wrote:
Try loading the packages each one at time, and between packages save the image and check if it is growing.
2013/7/29 Sebastian Tleye <stleye@gmail.com>
What also happened to me, is that, each time i saved the image (even if i did nothing), the image was growing its size.
2013/7/29 Sebastian Tleye <stleye@gmail.com>
Mmm, so i'm not sure. I remember, when i had this problem, i was using directly changeSets, i solved the problem doing "FileIn entire file" instead of "Install into a new change set" (when you drag a changeset into Pharo). But it was like a random bug since i haven't had that problem again (even using "Install into a new change set"
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hi Sebastian,
No, not intentionally. My code is going into the default change set and there isn't that much.
But... when looking at the Changes Sorter, there are indeed a lot of entries related to all of those modules (due to the configurations being loaded I guess - see screenshots for samples, the list is much longer).
Phil
On Mon, Jul 29, 2013 at 11:39 AM, Sebastian Tleye <stleye@gmail.com>wrote:
Hi Phil
Have you been using changeSets? I had the same problem once, i couldn't figure out what the problem was, but i think there is a problem in the sorter tool (and change sets).
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
I've been running test suites for some of the packages (e.g. OpenDBX and Glorp) and this may be the result.
This image is kind of what one doing web dev would end up with.
But then, it is very hard to get rid of that unwanted space.
I am trying to build a system I can start using for business projects and feel concerned about that memory growth very seriously.
Any pointers (I chased some already but here, there are way too many entries)
Thx
Phil
-- --- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller
On Mon, Jul 29, 2013 at 9:02 AM, phil@highoctane.be <phil@highoctane.be>wrote:
Yes, same for me here.
I'll update my configuration to load everything in a fresh 2.0 and report the results.
Thing is that loading that full configuration takes ages (GlorpDBX is taking 20 minutes to load...) and the VM gets the SmallInteger bug triggered with such a large config...
It's easy to fix workaround SmallInteger add issue. Just one line of code in Metacello. And yes, it takes ages. I also build an app that loads Seaside, Magritte3, GlorpDBX, etc and it takes quite a lot. Esteban did something to improve Monticello loading in Pharo 3.0....but that's 3.0, not 2.0...
I really need to get to grips with what happens down there.
Phil
On Monday, July 29, 2013, Sebastian Tleye wrote:
Try loading the packages each one at time, and between packages save the image and check if it is growing.
2013/7/29 Sebastian Tleye <stleye@gmail.com>
What also happened to me, is that, each time i saved the image (even if i did nothing), the image was growing its size.
2013/7/29 Sebastian Tleye <stleye@gmail.com>
Mmm, so i'm not sure. I remember, when i had this problem, i was using directly changeSets, i solved the problem doing "FileIn entire file" instead of "Install into a new change set" (when you drag a changeset into Pharo). But it was like a random bug since i haven't had that problem again (even using "Install into a new change set"
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hi Sebastian,
No, not intentionally. My code is going into the default change set and there isn't that much.
But... when looking at the Changes Sorter, there are indeed a lot of entries related to all of those modules (due to the configurations being loaded I guess - see screenshots for samples, the list is much longer).
Phil
On Mon, Jul 29, 2013 at 11:39 AM, Sebastian Tleye <stleye@gmail.com>wrote:
Hi Phil
Have you been using changeSets? I had the same problem once, i couldn't figure out what the problem was, but i think there is a problem in the sorter tool (and change sets).
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
I've been running test suites for some of the packages (e.g. OpenDBX and Glorp) and this may be the result.
This image is kind of what one doing web dev would end up with.
But then, it is very hard to get rid of that unwanted space.
I am trying to build a system I can start using for business projects and feel concerned about that memory growth very seriously.
Any pointers (I chased some already but here, there are way too many entries)
Thx
Phil
-- --- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos
High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium
Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller
-- Mariano http://marianopeck.wordpress.com
What Metacello line ? :-) I see that we are navigating the same kinds of waters with these things. Hopefully for the best. I am also quite concerned about the image doing blocking calls w/ databases etc. Phil On Mon, Jul 29, 2013 at 2:11 PM, Mariano Martinez Peck < marianopeck@gmail.com> wrote:
On Mon, Jul 29, 2013 at 9:02 AM, phil@highoctane.be <phil@highoctane.be>wrote:
Yes, same for me here.
I'll update my configuration to load everything in a fresh 2.0 and report the results.
Thing is that loading that full configuration takes ages (GlorpDBX is taking 20 minutes to load...) and the VM gets the SmallInteger bug triggered with such a large config...
It's easy to fix workaround SmallInteger add issue. Just one line of code in Metacello. And yes, it takes ages. I also build an app that loads Seaside, Magritte3, GlorpDBX, etc and it takes quite a lot. Esteban did something to improve Monticello loading in Pharo 3.0....but that's 3.0, not 2.0...
I really need to get to grips with what happens down there.
Phil
On Monday, July 29, 2013, Sebastian Tleye wrote:
Try loading the packages each one at time, and between packages save the image and check if it is growing.
2013/7/29 Sebastian Tleye <stleye@gmail.com>
What also happened to me, is that, each time i saved the image (even if i did nothing), the image was growing its size.
2013/7/29 Sebastian Tleye <stleye@gmail.com>
Mmm, so i'm not sure. I remember, when i had this problem, i was using directly changeSets, i solved the problem doing "FileIn entire file" instead of "Install into a new change set" (when you drag a changeset into Pharo). But it was like a random bug since i haven't had that problem again (even using "Install into a new change set"
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hi Sebastian,
No, not intentionally. My code is going into the default change set and there isn't that much.
But... when looking at the Changes Sorter, there are indeed a lot of entries related to all of those modules (due to the configurations being loaded I guess - see screenshots for samples, the list is much longer).
Phil
On Mon, Jul 29, 2013 at 11:39 AM, Sebastian Tleye <stleye@gmail.com>wrote:
Hi Phil
Have you been using changeSets? I had the same problem once, i couldn't figure out what the problem was, but i think there is a problem in the sorter tool (and change sets).
2013/7/29 phil@highoctane.be <phil@highoctane.be>
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
I've been running test suites for some of the packages (e.g. OpenDBX and Glorp) and this may be the result.
This image is kind of what one doing web dev would end up with.
But then, it is very hard to get rid of that unwanted space.
I am trying to build a system I can start using for business projects and feel concerned about that memory growth very seriously.
Any pointers (I chased some already but here, there are way too many entries)
Thx
Phil
-- --- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos
High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium
Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller
-- Mariano http://marianopeck.wordpress.com
On Jul 29, 2013, at 11:29 AM, phil@highoctane.be wrote:
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
Can you try to execute ImageCleaner cleanUpForRelease This way we know if maybe some cache is hanging onto something.
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
MorphExtension should only be referenced by the Morph it extends. So there should always be more Morphs than extensions. This looks really strange. Marcus
I did. No significant change. --- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller On Mon, Jul 29, 2013 at 2:20 PM, Marcus Denker <marcus.denker@inria.fr>wrote:
On Jul 29, 2013, at 11:29 AM, phil@highoctane.be wrote:
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
Can you try to execute
ImageCleaner cleanUpForRelease
This way we know if maybe some cache is hanging onto something.
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
MorphExtension should only be referenced by the Morph it extends. So there should always be more Morphs than extensions. This looks really strange.
Marcus
A possibility would be the AST cache. During development, if you do things like recompileAll or load packages the AST cache can grow the image size up to 300 Mo. But this cache is deleted when saving & quitting the image. Did you save and quit the image before looking at the memory size ? It might also be bugs related to Morph as you suggested because there was refactoring in it. We are investigating. 2013/7/29 Marcus Denker <marcus.denker@inria.fr>
On Jul 29, 2013, at 11:29 AM, phil@highoctane.be wrote:
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
Can you try to execute
ImageCleaner cleanUpForRelease
This way we know if maybe some cache is hanging onto something.
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
MorphExtension should only be referenced by the Morph it extends. So there should always be more Morphs than extensions. This looks really strange.
Marcus
Yes, I did. I do regular saves and then a final save and quit. How can I know if the AST cache is large in a running image? Phil On Mon, Jul 29, 2013 at 3:53 PM, Clément Bera <bera.clement@gmail.com>wrote:
A possibility would be the AST cache. During development, if you do things like recompileAll or load packages the AST cache can grow the image size up to 300 Mo. But this cache is deleted when saving & quitting the image.
Did you save and quit the image before looking at the memory size ?
It might also be bugs related to Morph as you suggested because there was refactoring in it. We are investigating.
2013/7/29 Marcus Denker <marcus.denker@inria.fr>
On Jul 29, 2013, at 11:29 AM, phil@highoctane.be wrote:
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
Can you try to execute
ImageCleaner cleanUpForRelease
This way we know if maybe some cache is hanging onto something.
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
MorphExtension should only be referenced by the Morph it extends. So there should always be more Morphs than extensions. This looks really strange.
Marcus
On Jul 29, 2013, at 4:08 PM, "phil@highoctane.be" <phil@highoctane.be> wrote:
Yes, I did. I do regular saves and then a final save and quit.
How can I know if the AST cache is large in a running image?
This can not happen in 2.0, as method #ast has not senders. #parseTree does not cache. Marcus
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
MorphExtension should only be referenced by the Morph it extends. So there should always be more Morphs than extensions. This looks really strange.
yes this is really strange.
Marcus
I can send you my image but need to remove all my credentials from there first. --- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller On Mon, Jul 29, 2013 at 4:43 PM, Stéphane Ducasse <stephane.ducasse@inria.fr
wrote:
Look at the top consumers, especially the Semaphore thing. It is way
beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure
out why there are so many Floats.
MorphExtension should only be referenced by the Morph it extends. So there should always be more Morphs than extensions. This looks really strange.
yes this is really strange.
Marcus
Yes please (if it is not too much work :) ) I would like to check something. 2013/7/29 phil@highoctane.be <phil@highoctane.be>
I can send you my image but need to remove all my credentials from there first.
--- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos
High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium
Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller
On Mon, Jul 29, 2013 at 4:43 PM, Stéphane Ducasse < stephane.ducasse@inria.fr> wrote:
Look at the top consumers, especially the Semaphore thing. It is way
beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just
figure out why there are so many Floats.
MorphExtension should only be referenced by the Morph it extends. So there should always be more Morphs than extensions. This looks really strange.
yes this is really strange.
Marcus
The image and the changes file are here: (uploading... will take a while - 30 min or so) https://www.dropbox.com/sh/wfxep3jm5v27szt/5keLUTFvGz Phil On Mon, Jul 29, 2013 at 5:06 PM, Sebastian Tleye <stleye@gmail.com> wrote:
Yes please (if it is not too much work :) ) I would like to check something.
2013/7/29 phil@highoctane.be <phil@highoctane.be>
I can send you my image but need to remove all my credentials from there first.
--- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos
High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium
Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller
On Mon, Jul 29, 2013 at 4:43 PM, Stéphane Ducasse < stephane.ducasse@inria.fr> wrote:
Look at the top consumers, especially the Semaphore thing. It is way
beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just
figure out why there are so many Floats.
MorphExtension should only be referenced by the Morph it extends. So there should always be more Morphs than extensions. This looks really strange.
yes this is really strange.
Marcus
On Jul 29, 2013, at 7:31 PM, phil@highoctane.be wrote:
The image and the changes file are here: (uploading... will take a while - 30 min or so)
Ok, I downloaded them. Marcus
On 30 July 2013 10:51, Marcus Denker <marcus.denker@inria.fr> wrote:
On Jul 29, 2013, at 7:31 PM, phil@highoctane.be wrote:
The image and the changes file are here: (uploading... will take a while - 30 min or so)
https://www.dropbox.com/sh/wfxep3jm5v27szt/5keLUTFvGz
Ok, I downloaded them.
Marcus
it appears that .changes file is corrupt, for instance , browse: WAWelcomeBrowse>>renderContentOn: and it shows: ontentOn: html html heading level1...... (and i guess all code which loaded after certain point is corrupt) i also found 2 UI processes hanging around as well as some others which i cannot terminate.. something went wrong during installing the code. -- Best regards, Igor Stasenko.
On Jul 30, 2013, at 11:31 AM, Igor Stasenko <siguctua@gmail.com> wrote:
On 30 July 2013 10:51, Marcus Denker <marcus.denker@inria.fr> wrote:
On Jul 29, 2013, at 7:31 PM, phil@highoctane.be wrote:
The image and the changes file are here: (uploading... will take a while - 30 min or so)
https://www.dropbox.com/sh/wfxep3jm5v27szt/5keLUTFvGz
Ok, I downloaded them.
Marcus
it appears that .changes file is corrupt, for instance , browse:
WAWelcomeBrowse>>renderContentOn:
and it shows:
ontentOn: html html heading level1......
(and i guess all code which loaded after certain point is corrupt)
i also found 2 UI processes hanging around as well as some others which i cannot terminate.. something went wrong during installing the code.
Another thing that is non-standard is the MemoryMonitor⦠sadly there are almost no comments, and it is unclear if there are maybe probes installed in any methods? I could not find a way to remove all probes, nor a description of how they work. So would omit that in the next update. Marcus
the changes file contained passwords and I replaced the text. So offsets may be wrong due to that. Memorymonitor is not doing fanct stuff. It just counts instances. Phil On Tuesday, July 30, 2013, Marcus Denker <marcus.denker@inria.fr> wrote:
On Jul 30, 2013, at 11:31 AM, Igor Stasenko <siguctua@gmail.com> wrote:
On 30 July 2013 10:51, Marcus Denker <marcus.denker@inria.fr> wrote:
On Jul 29, 2013, at 7:31 PM, phil@highoctane.be wrote:
The image and the changes file are here: (uploading... will take a
while -
30 min or so)
https://www.dropbox.com/sh/wfxep3jm5v27szt/5keLUTFvGz
Ok, I downloaded them.
Marcus
it appears that .changes file is corrupt, for instance , browse:
WAWelcomeBrowse>>renderContentOn:
and it shows:
ontentOn: html html heading level1......
(and i guess all code which loaded after certain point is corrupt)
i also found 2 UI processes hanging around as well as some others which i cannot terminate.. something went wrong during installing the code.
Another thing that is non-standard is the MemoryMonitor⦠sadly there are almost no comments, and it is unclear if there are maybe probes installed in any methods? I could not find a way to remove all probes, nor a description of how they work.
So would omit that in the next update.
Marcus
-- --- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller
On Jul 30, 2013, at 1:49 PM, "phil@highoctane.be" <phil@highoctane.be> wrote:
the changes file contained passwords and I replaced the text. So offsets may be wrong due to that.
Yes, the first thing I wanted to do is to recompile everything. Does not work.
Memorymonitor is not doing fanct stuff. It just counts instances.
Yes, but maybe it holds on to these instances? Marcus
Guys, I have images also with seaside, magritte, glorp, postgresV2, etc and it is also around 200MB. I will try to do some research today and let you know. Cheers, On Tue, Jul 30, 2013 at 8:55 AM, Marcus Denker <marcus.denker@inria.fr>wrote:
On Jul 30, 2013, at 1:49 PM, "phil@highoctane.be" <phil@highoctane.be> wrote:
the changes file contained passwords and I replaced the text. So offsets may be wrong due to that.
Yes, the first thing I wanted to do is to recompile everything. Does not work.
Memorymonitor is not doing fanct stuff. It just counts instances.
Yes, but maybe it holds on to these instances?
Marcus
-- Mariano http://marianopeck.wordpress.com
hehehe I did know about the executors, but I didn't know about the WeakRegistry, I always thought it was only the #default instance :) BTW, I have just send an email about the 200MB image... Cheers, On Wed, Jul 31, 2013 at 10:48 AM, Mariano Martinez Peck < marianopeck@gmail.com> wrote:
Guys, I have images also with seaside, magritte, glorp, postgresV2, etc and it is also around 200MB. I will try to do some research today and let you know.
Cheers,
On Tue, Jul 30, 2013 at 8:55 AM, Marcus Denker <marcus.denker@inria.fr>wrote:
On Jul 30, 2013, at 1:49 PM, "phil@highoctane.be" <phil@highoctane.be> wrote:
the changes file contained passwords and I replaced the text. So offsets may be wrong due to that.
Yes, the first thing I wanted to do is to recompile everything. Does not work.
Memorymonitor is not doing fanct stuff. It just counts instances.
Yes, but maybe it holds on to these instances?
Marcus
-- Mariano http://marianopeck.wordpress.com
-- Mariano http://marianopeck.wordpress.com
FWIW I only installed configurations the standard way. On Tuesday, July 30, 2013, Marcus Denker <marcus.denker@inria.fr> wrote:
On Jul 30, 2013, at 11:31 AM, Igor Stasenko <siguctua@gmail.com> wrote:
On 30 July 2013 10:51, Marcus Denker <marcus.denker@inria.fr> wrote:
On Jul 29, 2013, at 7:31 PM, phil@highoctane.be wrote:
The image and the changes file are here: (uploading... will take a
while -
30 min or so)
https://www.dropbox.com/sh/wfxep3jm5v27szt/5keLUTFvGz
Ok, I downloaded them.
Marcus
it appears that .changes file is corrupt, for instance , browse:
WAWelcomeBrowse>>renderContentOn:
and it shows:
ontentOn: html html heading level1......
(and i guess all code which loaded after certain point is corrupt)
i also found 2 UI processes hanging around as well as some others which i cannot terminate.. something went wrong during installing the code.
Another thing that is non-standard is the MemoryMonitor⦠sadly there are almost no comments, and it is unclear if there are maybe probes installed in any methods? I could not find a way to remove all probes, nor a description of how they work.
So would omit that in the next update.
Marcus
-- --- Philippe Back Dramatic Performance Improvements Mob: +32(0) 478 650 140 | Fax: +32 (0) 70 408 027 Mail:phil@highoctane.be | Web: http://philippeback.eu Blog: http://philippeback.be | Twitter: @philippeback Youtube: http://www.youtube.com/user/philippeback/videos High Octane SPRL rue cour Boisacq 101 | 1301 Bierges | Belgium Featured on the Software Process and Measurement Cast http://spamcast.libsyn.com Sparx Systems Enterprise Architect and Ability Engineering EADocX Value Added Reseller
just for your information we are looking at it and also in 30 because we have memory leaks due to announcements. Stef and Igor looking at the butterflies outside the window :) On Jul 29, 2013, at 11:28 AM, phil@highoctane.be wrote:
Hello,
I've been loading all of those packages in order to build a full web stack development image.
Everything now loads fine and kind of works but...
The image is really slowing down and the size is getting very large.
Here is the current one:
332580684 29 jul 10:50 Pharo-DripfeedIt-Magritte3-OpenDBX_20130729_1050.image
300+ megs...
I've been doing some development in there and started looking for why this was getting so large and slow.
I did a SpaceTally print analysis and imported the results in a spreadsheet.
Look at the top consumers, especially the Semaphore thing. It is way beyond whatever was expected. There is something wrong there.
There must be a leak of Points, MorphExtensions and I can't just figure out why there are so many Floats.
I've been running test suites for some of the packages (e.g. OpenDBX and Glorp) and this may be the result.
This image is kind of what one doing web dev would end up with.
But then, it is very hard to get rid of that unwanted space.
I am trying to build a system I can start using for business projects and feel concerned about that memory growth very seriously.
Any pointers (I chased some already but here, there are way too many entries);
Thx
Phil
<Screen Shot 2013-07-29 at 11.09.56.png><STspace.text>
Phil do you have some scripts to load these packages because we have problems to reproduce your problems. We cleaned some places but we are blind. Stef
participants (7)
-
Clément Bera -
Igor Stasenko -
Marcus Denker -
Mariano Martinez Peck -
phil＠highoctane.be -
Sebastian Tleye -
Stéphane Ducasse