September 2013 - Pharo-dev - lists.pharo.org

Cog code compaction crash when stepping in the debugger

by Eliot Miranda

Hi All, I'm seeing an occasional crash in Cog when stepping the simulator when working on Spur. The crash comes about when the system executes primitiveStoreStackp (primitive 76) as part of ContextPart>>push:, and a code compaction occurs within the primitive. The crash.dmp file looks like the following (eliding for brevity): Bus error Sat Sep 21 06:03:12 2013 ... C stack backtrace: 0 Squeak 0x000700a1 reportStackState + 145 1 Squeak 0x00070a32 sigsegv + 306 2 libSystem.B.dylib 0x99fa105b _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 Squeak 0x00101d9a interpret + 2970 ... Smalltalk stack dump: 0xbffe2ae8 M MethodContext(ContextPart)>push: 0x1d95abac: a(n) MethodContext 0xbffe2b0c M MethodContext(ContextPart)>return:from: 0x1d95ab50: a(n) MethodContext 0xbffe2b34 I MethodContext(ContextPart)>methodReturnReceiver 0x1d95ab50: a(n) MethodContext 0xbffe2b5c M MethodContext(InstructionStream)>interpretNextInstructionFor: 0x1d95ab50: a(n) MethodContext 0xbffe2b78 M MethodContext(ContextPart)>step 0x1d95ab50: a(n) MethodContext ... Most recent primitives ... primitiveWait at:put: signal @ basicNew shallowCopy findSubstring:in:startingAt:matchTable: indexOfAscii:inString:startingAt: perform: objectAt: at: findNextUnwindContextUpTo: at:put: at:put: stackp: **CompactCode** But this isn't telling me enough. Firstly I've just committed changes to http://www.squeakvm.org/svn/squeak/branches/Cog/platforms/Mac%20OS/vm/sqMac… http://www.squeakvm.org/svn/squeak/branches/Cog/platforms/unix/vm/sqUnixMai… also print the register state when the VM segfaults or gets sent SGUSR1 etc. I can't test on FreeBSD. If anyone builds with these changes on Free BSD can they please let me know if they work or not? Secondly perhaps someone has a reproducible case coming from running e.g. ContextPart>>runAtEachStep: type code? If so, please can I have a copy? Lastly, if anyone has a crash that matches the above, but with the new crash dump info, I'd love to see the crash.dmp file. Thanks, Eliot

Sept. 25, 2013

Re: [Pharo-dev] [Vm-dev] [NB] Trying to implement a ReadStream on NBExternalAddress

by Eliot Miranda

Hi Tim, Hi All, On Wed, Sep 25, 2013 at 12:46 PM, tim Rowledge <tim(a)rowledge.org> wrote: > > > On 25-09-2013, at 11:36 AM, Eliot Miranda <eliot.miranda(a)gmail.com> wrote: > > > On Wed, Sep 25, 2013 at 10:39 AM, tim Rowledge <tim(a)rowledge.org> wrote: > > > > > > On 25-09-2013, at 9:30 AM, Eliot Miranda <eliot.miranda(a)gmail.com> > wrote: > > > > > Off the top of my head it may need the memory manager to add a > "sliver" object type, an 8-byte header with no fields, that is collected by > coallescing with adjacent free blocks, that can fill in the 8-byte gaps > aligning pinned objects on 16 byte boundaries would create. I'll think > about this. > > > > > > > Wild-ass suggestion; would it work to allocate the relevant object > (which I'm assuming here is essentially an UninterpretedBytes) with an > 'extra' 8 bytes and then store the 'real' bits at the right place to have > the 16byte boundary? Yes, there would have to be magic to signify where the > real start of data is. Yes, it would potentially change on scavenge, but > since these are largely pinned, not such a big issue maybe? > > > > In general that's a bad idea because it loads the frequent path > (accessing the object) with the work, unloading the infrequent path > (pinning the object). It can't happen during scavenge because by > definition pinned objects are not in new space. hence I think the time to > take the hit is on pinning (an infrequent operation). Make sense? > > Almost always. But it's worth throwing wild ideas around occasionally just > to see if they stick to the blanket. > Yes!! I was almost going to post something on just this point. Thanks for the prompt. I want to encourage everyone to throw ideas out there without fear of their being proved wrong. Discussing the ideas has great value whether or not they;re right. The other day Clement had a good idea about become. I'd not thought about the issue he brought up before, and his suggestion, even though I don't think it'll work, made me think about the issue and helped clarify my thinking. So yes, please keep throwing out those ideas. And don't get discouraged by critical responses. > How about two subclasses - one for each possible 8byte alignment? The FFI > code only gets a ptr to the right place anyway, so it won't care. Accessor > methods would be minimally different for the two subclasses and handle the > offset for ST code. Compacting, if it ever touched instances, would swap > the class if required. How's that for adaptive optimisation ;-) > That could work, but offends my sense of the separation between the system and the VM. So I don't feel like going there :-) > Or how about simply not allocating the actual memory in object space? I > know it can be a pain but perhaps it's less of a pain in the end. > That one can always do. The FFI will always provide some sort of interface to malloc and/or valloc (even if it is as primitive as actually calling those functions). But the question for Spur is what facilities it should provide and I want to provide something much easier to use (i.e. pinned ByteArrays and the like). -- cheers, Eliot

Sept. 25, 2013

Re: [Pharo-dev] [Pharo-users] [ANN] Launching Pharo on Ubuntu

by kilon

YEAH I DID IT !!! HAHAHAHA I am one of you now :D I Implemented the progress bar. Well it displays 2 progress bars. I assume the first one is for unzipping the file though it does not progress , could be something else. But the second one works like a charm , even displays the percentage of download and progress with each 1%. Beautiful and way way way easier than I expected , I just copied a method from monticello and had to add signalProgress: True to PHDownloader method that downloads the file via Zinc. So happy :D So now I am off to improve it, see if I can add progress also for unzipping the file and further improve the GUI. Ready or not here I come :D Thanks Sven for helping me out. I committed to the smalltalkhub repo, I have not added it to the Configuration because I want you guys to test it first to make sure I dont mess things up though I should not since I have not touched the existing methods apart from adding that simple message. So I dont know if you get the enhancement if you simply download the image. So go to monticello and get latest commit, you should see my name in there. Dammien , Sven if you have any advice as always I am open to suggestions :) -- View this message in context: http://forum.world.st/ANN-Launching-Pharo-on-Ubuntu-tp4709757p4710415.html Sent from the Pharo Smalltalk Developers mailing list archive at Nabble.com.

Sept. 25, 2013

Re: [Pharo-dev] latest builds with FileSystem problem?

by Esteban Lorenzano

yeah, same vm with a 2.0 version with filetree works fine On Wed, Sep 25, 2013 at 9:36 PM, Camillo Bruni <camillobruni(a)gmail.com>wrote: > I doubt, I only use the VM from the 6.September, with later versions I have > troubles with the keybinding :/. I can try with the latest version and see. > thoug this sounds strange to me... > > On 2013-09-25, at 16:24, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: > > mmm... I think MC is doing some forked stuff. > > Could that be interfering? > > but if so... why I didn't have the problem before? > > > > > > On Wed, Sep 25, 2013 at 9:20 PM, Camillo Bruni <camillobruni(a)gmail.com > >wrote: > >> some random thoughts: > >> - do you have problems in parallel with other file operations? > >> - are you sure you do not have an overlap with uppercase / lowercase > files > >> > >> > >> On 2013-09-25, at 16:14, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: > >> > >>> I cannot save filetree directories. Some times work, but most of teh > >> time it gives me > >>> > >>> MacStore(DiskStore)>>basicEntry:path:nodesDo: > >>> MacStore(FileSystemStore)>>directoryAt:ifAbsent:nodesDo: in Block: > >> FileSystemError: Path / 'Users' / 'MAC' / 'Desktop' / 'Dev' / 'Pharo' / > >> 'ib2' > >>> > >>> :( > >>> > >>> and no clue of what can be happening. > >>> > >>> > >>> On Sep 25, 2013, at 8:43 PM, Camillo Bruni <camillobruni(a)gmail.com> > >> wrote: > >>> > >>>> what kind of issues? > >>>> > >>>> On 2013-09-25, at 15:36, Esteban Lorenzano <estebanlm(a)gmail.com> > wrote: > >>>> > >>>>> Hi, > >>>>> > >>>>> I'm experiencing some problems with FileSystem in last Pharo3 > >> builds... can someone confirm you have also the problem or just happens > in > >> my machine so far? > >>>>> > >>>>> thanks, > >>>>> Esteban >

Sept. 25, 2013

Re: [Pharo-dev] [Vm-dev] [NB] Trying to implement a ReadStream on NBExternalAddress

by Eliot Miranda

Hi Henry, On Wed, Sep 25, 2013 at 1:14 AM, Henrik Johansen < henrik.s.johansen(a)veloxit.no> wrote: > > > On Sep 24, 2013, at 9:58 , Eliot Miranda <eliot.miranda(a)gmail.com> wrote: > > > > > On Mon, Sep 23, 2013 at 3:10 PM, Nicolas Cellier < > nicolas.cellier.aka.nice(a)gmail.com> wrote: > >> Isn't Eliot just implementing this feature, having a segment of non >> relocatable objects? >> > > Sort of. Spur will allow any object in old space to stay still, and > through become can move any object to old space very simply. So instead of > having a special fixed space segment it has a best-bit compaction algorithm > that doesn't slide objects, but moves them into holes. With this kind of > compaction it is very easy to leave objects put. > > A further advantage of Spur is that objects have 64-bit alignment so > passing arrays to e.g. code using sse instructions, won't cause potential > alignment faults. > > > Not to be a drag, but SSE operations have 16-byte alignment requirement. > With 8-byte aligmnent of first indexable slot, you'd still need to use > aligned loads/stores. > Talking out-of-line with someone who has lots of experience with Smalltalk memory management it came to me that the pinning primitive could (and should) take an aligmnet argument). So one says e.g. buffer := (ByteArray new: 1024) pinWithByteAlignment: 16 -- best, Eliot

Sept. 25, 2013

Re: [Pharo-dev] latest builds with FileSystem problem?

by Camillo Bruni

I doubt, I only use the VM from the 6.September, with later versions I have troubles with the keybinding :/. I can try with the latest version and see. thoug this sounds strange to me... On 2013-09-25, at 16:24, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: > mmm... I think MC is doing some forked stuff. > Could that be interfering? > but if so... why I didn't have the problem before? > > > On Wed, Sep 25, 2013 at 9:20 PM, Camillo Bruni <camillobruni(a)gmail.com>wrote: >> some random thoughts: >> - do you have problems in parallel with other file operations? >> - are you sure you do not have an overlap with uppercase / lowercase files >> >> >> On 2013-09-25, at 16:14, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: >> >>> I cannot save filetree directories. Some times work, but most of teh >> time it gives me >>> >>> MacStore(DiskStore)>>basicEntry:path:nodesDo: >>> MacStore(FileSystemStore)>>directoryAt:ifAbsent:nodesDo: in Block: >> FileSystemError: Path / 'Users' / 'MAC' / 'Desktop' / 'Dev' / 'Pharo' / >> 'ib2' >>> >>> :( >>> >>> and no clue of what can be happening. >>> >>> >>> On Sep 25, 2013, at 8:43 PM, Camillo Bruni <camillobruni(a)gmail.com> >> wrote: >>> >>>> what kind of issues? >>>> >>>> On 2013-09-25, at 15:36, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: >>>> >>>>> Hi, >>>>> >>>>> I'm experiencing some problems with FileSystem in last Pharo3 >> builds... can someone confirm you have also the problem or just happens in >> my machine so far? >>>>> >>>>> thanks, >>>>> Esteban

Sept. 25, 2013

Re: [Pharo-dev] JQueryWidgetBox now on STHub + CI

by StÃ©phane Ducasse

thanks this is a great initiative. On Sep 25, 2013, at 8:07 PM, Torsten Bergmann <astares(a)gmx.de> wrote: > Hi, > > we moved JQueryWidgetBox also over to STHub. Thanks go to PaulDeBruicker for > changes in the config, I now also: > > - left version 2.7 of JQueryWidgetBox for old Seaside30 (Seaside 3.0.7) > - created 2.8 of JQueryWidgetBox for the new Seaside3 that is on STHub (Seaside 3.0.8) > - created some markdown docu on the ConfigurationOfJQueryWidgetBox (class comment and > a pragma method to make it visible in PharoOnlineHelp (if loaded) > - updated the docu on http://smalltalkhub.com/#!/~Seaside/JQueryWidgetBox > - created a CI job on https://ci.inria.fr/pharo-contribution/job/JQueryWidgetBox/ which is GREEN > > For details check out the project page: http://smalltalkhub.com/#!/~Seaside/JQueryWidgetBox > > Bye > T. >

Sept. 25, 2013

Re: [Pharo-dev] latest builds with FileSystem problem?

by Esteban Lorenzano

mmm... I think MC is doing some forked stuff. Could that be interfering? but if so... why I didn't have the problem before? On Wed, Sep 25, 2013 at 9:20 PM, Camillo Bruni <camillobruni(a)gmail.com>wrote: > some random thoughts: > - do you have problems in parallel with other file operations? > - are you sure you do not have an overlap with uppercase / lowercase files > > > On 2013-09-25, at 16:14, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: > > > I cannot save filetree directories. Some times work, but most of teh > time it gives me > > > > MacStore(DiskStore)>>basicEntry:path:nodesDo: > > MacStore(FileSystemStore)>>directoryAt:ifAbsent:nodesDo: in Block: > FileSystemError: Path / 'Users' / 'MAC' / 'Desktop' / 'Dev' / 'Pharo' / > 'ib2' > > > > :( > > > > and no clue of what can be happening. > > > > > > On Sep 25, 2013, at 8:43 PM, Camillo Bruni <camillobruni(a)gmail.com> > wrote: > > > >> what kind of issues? > >> > >> On 2013-09-25, at 15:36, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: > >> > >>> Hi, > >>> > >>> I'm experiencing some problems with FileSystem in last Pharo3 > builds... can someone confirm you have also the problem or just happens in > my machine so far? > >>> > >>> thanks, > >>> Esteban > >> > > > > > >

Sept. 25, 2013

Re: [Pharo-dev] latest builds with FileSystem problem?

by Camillo Bruni

some random thoughts: - do you have problems in parallel with other file operations? - are you sure you do not have an overlap with uppercase / lowercase files On 2013-09-25, at 16:14, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: > I cannot save filetree directories. Some times work, but most of teh time it gives me > > MacStore(DiskStore)>>basicEntry:path:nodesDo: > MacStore(FileSystemStore)>>directoryAt:ifAbsent:nodesDo: in Block: FileSystemError: Path / 'Users' / 'MAC' / 'Desktop' / 'Dev' / 'Pharo' / 'ib2' > > :( > > and no clue of what can be happening. > > > On Sep 25, 2013, at 8:43 PM, Camillo Bruni <camillobruni(a)gmail.com> wrote: > >> what kind of issues? >> >> On 2013-09-25, at 15:36, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: >> >>> Hi, >>> >>> I'm experiencing some problems with FileSystem in last Pharo3 builds... can someone confirm you have also the problem or just happens in my machine so far? >>> >>> thanks, >>> Esteban >> > >

Sept. 25, 2013

Re: [Pharo-dev] VM repos on Gitorious

by Luc Fabresse

2013/9/25 Sean P. DeNigris <sean(a)clipperadams.com> > EstebanLM wrote > > Sorry for the mess. > > Evolution is never pretty. All we can do is act and error correct. Thank > you > (all the core devs) for being consistently available to clear up the > inevitable confusion :) > yes thanks ;-) and I will try with this repo. Luc > > > > ----- > Cheers, > Sean > -- > View this message in context: > http://forum.world.st/VM-repos-on-Gitorious-tp4710346p4710360.html > Sent from the Pharo Smalltalk Developers mailing list archive at > Nabble.com. > >

Sept. 25, 2013