December 2015 - Pharo-dev - lists.pharo.org

Re: [Pharo-dev] Fuel materialization on spur

by Denis Kudriashov

Hi. 2015-12-16 13:33 GMT+01:00 Sven Van Caekenberghe <sven(a)stfx.eu>: > > On 16 Dec 2015, at 13:24, ClÃ©ment Bera <bera.clement(a)gmail.com> wrote: > > > > I don't know if SqueakV3 - Spur32 support is needed, however, I think it > is really important to be able to serialize and materialize objects between > 32 bits spur images and 64bits spur images. > > I don't know. > > Yes it would be nice, but since Fuel cannot even exchange data between > different version itself (If I understand the situation correctly), why > should that have to work ? It is needed to use fuel as communication format between services which run on different platforms. For example you can exchange data between 64bits server and 32bits android phone.

Dec. 16, 2015

Re: [Pharo-dev] Fuel materialization on spur

by Sven Van Caekenberghe

> On 16 Dec 2015, at 13:24, ClÃ©ment Bera <bera.clement(a)gmail.com> wrote: > > I don't know if SqueakV3 - Spur32 support is needed, however, I think it is really important to be able to serialize and materialize objects between 32 bits spur images and 64bits spur images. I don't know. Yes it would be nice, but since Fuel cannot even exchange data between different version itself (If I understand the situation correctly), why should that have to work ? >From my POV FUEL is only compatible with its own version, a sacrifice made to gain performance. IIUC it is not a stable external format for long lived data with backward/forward compatibility. > 2015-12-16 10:34 GMT+01:00 Esteban Lorenzano <estebanlm(a)gmail.com>: > Hi, > >> On 16 Dec 2015, at 08:21, Eliot Miranda <eliot.miranda(a)gmail.com> wrote: >> >> Hi Esteban, >> >> On Dec 15, 2015, at 5:06 AM, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: >> >>> >>>> On 15 Dec 2015, at 13:18, Norbert Hartl <norbert(a)hartl.name> wrote: >>>> >>>> We have a test build for pharo5 that checks if we need to do stuff for future migrations. Since yesterday it fails, of course. >>>> I have a fueled out object graph stored as byte array in a method. The fuel bytes are serialized using a non-spur image. Now when the spur image reads the bytes I get an exception. Has this something to do with immediate characters? Is there a way to fix that or will it just not be possible to exchange objects between spur and non-spur using fuel? >>> >>> I think is not possible, but I will let fuel maintainers to have the last word :) >> >> >> Of course it's possible; in VW we exchanged objects between 32- & 64-but images using a format much like fuel and in 32-bits all floats are arrays of 32-bit bit objects whereas in 64-bits a range of floats are immediate. > > Oh wellâ¦ of course is possible. What I meant is that I think current implementation of Fuel does not support it, just that :) > but again, Iâm not sure: Martin and Mariano can for sure say something more detailed about :) > (problem is Martin is on vacations after getting his PhD and Mariano didnât followed in close the spur migration) > > cheers, > Esteban > >> >> In spur characters are immediate (Max, "primitive" is not the right term) whereas in v3 they're objects with a single isn't var. So at least fuel needs to be modified to read characters specially. One way to architect this is to ask the class (SmallInteger, Character, Float etc) to materialize, and then the class can decide how to represent its instances. The question is whether characters in spur should serialize themselves using the same wire format as v3 or whether fuel should modify its wire format to serialize immediate characters specially and have v3 materialize characters as serialized by spur. The issue is whether it's important to preserve object identity of characters with code >= 256 or not. >> >>> >>> Esteban >>> >>>> >>>> thanks, >>>> >>>> Norbert >>>> >>>> >>>> primitive #value: in Character class failed >>>> Stacktrace >>>> >>>> Character class(Object)>>primitiveFailed: >>>> Character class(Object)>>primitiveFailed >>>> Character class>>value: >>>> Character class>>materializeFrom: >>>> FLHookPrimitiveCluster>>materializeInstanceWith: >>>> FLHookPrimitiveCluster(FLIteratingCluster)>>materializeInstancesStepWith: >>>> FLMaterialization>>clusterInstancesStep >>>> [ self clusterInstancesStep ] in FLMaterialization>>instancesStep >>>> SmallInteger(Integer)>>timesRepeat: >>>> FLMaterialization>>instancesStep >>>> FLMaterialization>>run >>>> [ :aDecoder | >>>> (FLMaterialization with: aDecoder) >>>> run; >>>> yourself ] in FLMaterializer>>setDefaultMaterialization >>>> FLMaterializer>>materializeFrom: >>>> FLMaterializer class>>materializeFromByteArray: >>>> MAPExampleModels class>>readModelFromSelector: >>>> MAPExampleModels class>>readModelNamed: >>>> [ self readModelNamed: aString ] in MAPExampleModels class>>named: >>>> [ self at: key put: aBlock value ] in Dictionary>>at:ifAbsentPut: >>>> Dictionary>>at:ifAbsent: >>>> Dictionary>>at:ifAbsentPut: >>>> MAPExampleModels class>>named: >>>> MAPTest>>model >>>> MAPTest>>tcapModule >>>> MAPTest>>testInsertSubscriberDataBitStringAccess >>>> [ testMethod perform: testMethod selector ] in Given>>produceReturnValueAt: >>>> [ self at: key put: aBlock value ] in Dictionary>>at:ifAbsentPut: >>>> Dictionary>>at:ifAbsent: >>>> Dictionary>>at:ifAbsentPut: >>>> Given>>produceReturnValueAt: >>>> MAPTest(Phexample)>>performTest >>>> >>>> >>>> >>> > >

Dec. 16, 2015

Re: [Pharo-dev] Fuel materialization on spur

by ClÃ©ment Bera

I don't know if SqueakV3 - Spur32 support is needed, however, I think it is really important to be able to serialize and materialize objects between 32 bits spur images and 64bits spur images. 2015-12-16 10:34 GMT+01:00 Esteban Lorenzano <estebanlm(a)gmail.com>: > Hi, > > On 16 Dec 2015, at 08:21, Eliot Miranda <eliot.miranda(a)gmail.com> wrote: > > Hi Esteban, > > On Dec 15, 2015, at 5:06 AM, Esteban Lorenzano <estebanlm(a)gmail.com> > wrote: > > > On 15 Dec 2015, at 13:18, Norbert Hartl <norbert(a)hartl.name> wrote: > > We have a test build for pharo5 that checks if we need to do stuff for > future migrations. Since yesterday it fails, of course. > I have a fueled out object graph stored as byte array in a method. The > fuel bytes are serialized using a non-spur image. Now when the spur image > reads the bytes I get an exception. Has this something to do with immediate > characters? Is there a way to fix that or will it just not be possible to > exchange objects between spur and non-spur using fuel? > > > I think is not possible, but I will let fuel maintainers to have the last > word :) > > > > Of course it's possible; in VW we exchanged objects between 32- & 64-but > images using a format much like fuel and in 32-bits all floats are arrays > of 32-bit bit objects whereas in 64-bits a range of floats are immediate. > > > Oh wellâ¦ of course is possible. What I meant is that I think current > implementation of Fuel does not support it, just that :) > but again, Iâm not sure: Martin and Mariano can for sure say something > more detailed about :) > (problem is Martin is on vacations after getting his PhD and Mariano > didnât followed in close the spur migration) > > cheers, > Esteban > > > In spur characters are immediate (Max, "primitive" is not the right term) > whereas in v3 they're objects with a single isn't var. So at least fuel > needs to be modified to read characters specially. One way to architect > this is to ask the class (SmallInteger, Character, Float etc) to > materialize, and then the class can decide how to represent its instances. > The question is whether characters in spur should serialize themselves > using the same wire format as v3 or whether fuel should modify its wire > format to serialize immediate characters specially and have v3 materialize > characters as serialized by spur. The issue is whether it's important to > preserve object identity of characters with code >= 256 or not. > > > Esteban > > > thanks, > > Norbert > > > primitive #value: in Character class failed > > Stacktrace > > Character class(Object)>>primitiveFailed: > Character class(Object)>>primitiveFailed > Character class>>value: > Character class>>materializeFrom: > FLHookPrimitiveCluster>>materializeInstanceWith: > FLHookPrimitiveCluster(FLIteratingCluster)>>materializeInstancesStepWith: > FLMaterialization>>clusterInstancesStep > [ self clusterInstancesStep ] in FLMaterialization>>instancesStep > SmallInteger(Integer)>>timesRepeat: > FLMaterialization>>instancesStep > FLMaterialization>>run > [ :aDecoder | > (FLMaterialization with: aDecoder) > run; > yourself ] in FLMaterializer>>setDefaultMaterialization > FLMaterializer>>materializeFrom: > FLMaterializer class>>materializeFromByteArray: > MAPExampleModels class>>readModelFromSelector: > MAPExampleModels class>>readModelNamed: > [ self readModelNamed: aString ] in MAPExampleModels class>>named: > [ self at: key put: aBlock value ] in Dictionary>>at:ifAbsentPut: > Dictionary>>at:ifAbsent: > Dictionary>>at:ifAbsentPut: > MAPExampleModels class>>named: > MAPTest>>model > MAPTest>>tcapModule > MAPTest>>testInsertSubscriberDataBitStringAccess > [ testMethod perform: testMethod selector ] in Given>>produceReturnValueAt: > [ self at: key put: aBlock value ] in Dictionary>>at:ifAbsentPut: > Dictionary>>at:ifAbsent: > Dictionary>>at:ifAbsentPut: > Given>>produceReturnValueAt: > MAPTest(Phexample)>>performTest > > > > > >

Dec. 16, 2015

[pharo-project/pharo-core]

by GitHub

Branch: refs/tags/50502 Home: https://github.com/pharo-project/pharo-core

Dec. 16, 2015

[pharo-project/pharo-core] 1c8126: 50502

by GitHub

Branch: refs/heads/5.0 Home: https://github.com/pharo-project/pharo-core Commit: 1c8126fb073c0b8322f9a6238e45bfb07936e713 https://github.com/pharo-project/pharo-core/commit/1c8126fb073c0b8322f9a623… Author: Jenkins Build Server <board(a)pharo-project.org> Date: 2015-12-16 (Wed, 16 Dec 2015) Changed paths: R ScriptLoader50.package/ScriptLoader.class/instance/pharo - scripts/script50501.st A ScriptLoader50.package/ScriptLoader.class/instance/pharo - scripts/script50502.st R ScriptLoader50.package/ScriptLoader.class/instance/pharo - updates/update50501.st A ScriptLoader50.package/ScriptLoader.class/instance/pharo - updates/update50502.st M ScriptLoader50.package/ScriptLoader.class/instance/public/commentForCurrentUpdate.st M Traits.package/TBehavior.class/instance/accessing instances and variables/allInstances.st M Traits.package/TBehavior.class/instance/accessing/typeOfClass.st M Traits.package/TBehavior.class/instance/enumerating/allInstancesDo_.st M Traits.package/TBehavior.class/instance/private/indexIfCompact.st M Traits.package/TBehavior.class/instance/testing class hierarchy/kindOfSubclass.st M Traits.package/TBehavior.class/instance/testing/instSpec.st M Traits.package/TBehavior.class/instance/testing/isBits.st M Traits.package/TBehavior.class/instance/testing/isBytes.st M Traits.package/TBehavior.class/instance/testing/isVariable.st Log Message: ----------- 50502 17250 copy methods from Behavior to TBehavior (spur migration) https://pharo.fogbugz.com/f/cases/17250 http://files.pharo.org/image/50/50502.zip

Dec. 16, 2015

Re: [Pharo-dev] [Vm-dev] Re: [squeak-dev] Re: [Cuis] Sorting Unicode strings (Re: [Unicode] collation sequences (Re: Unicode Support))

by Ben Coman

On Wed, Dec 16, 2015 at 6:22 PM, H. Hirzel <hannes.hirzel(a)gmail.com> wrote: > > On 12/16/15, Eliot Miranda <eliot.miranda(a)gmail.com> wrote: >> Hi Todd, >> >> On Tue, Dec 15, 2015 at 3:46 PM, Todd Blanchard <tblanchard(a)mac.com> wrote: >> >>> Hi Eliot, >>> >>> On Dec 15, 2015, at 13:46, Eliot Miranda <eliot.miranda(a)gmail.com> wrote: >>> >>> Just so you know, I will dig my heels in as deeply as I am able to >>> prevent >>> the use of C++ libraries in the VM. It destroys the simulator, which is >>> the most important thing we have for VM development productivity. As far >>> as I'm concerned any use of external libraries to implement core >>> functionality kills the VM-in-Smalltalk concept that Squeak (and Pharo) >>> are >>> built upon. >>> >>> >>> OK, I defer to you because you certainly know more about the VM internals >>> and what does and doesn't work well than anyone else. >>> >>> So I guess I would like to know your recommendation for 1) how best to >>> store strings - byte arrays (UTF8), - 2-byte word arrays (UTF16 - now we >>> get to worry about endian). >>> >> >> Raw Unicode, either as 8-bit, 16-bit or 32-bit. When creating a String it >> should start as an 8-bit-per-Unicode-character string. Attempts to store >> Character values that won't fit cause the String to become a String whose >> element size is large enough to accommodate the character. > > This is the case: see tests here http://wiki.squeak.org/squeak/6316 > > In Spur, >> become: is cheap so this growth pays only for the reallocation and copying >> of the at a, not for an expensive heap scan necessary to do the become:. > > Could you elaborate on this please? https://hal.inria.fr/hal-01152610/file/partialReadBarrier.pdf cheers -ben >> >> >>> Bearing in mind that both representations are variable length and so >>> while >>> accessing the n'th byte/word is O(1), accessing the n'th character is >>> necessarily O(n) unless you know you have no surrogates in your string. >>> >> >> Right, so UTF-8 and UTF-16 are not convenient representations and to be >> provided only for interchange. > > +1 > > Squeak/Pharo uses 8bit/32bit (UTF-32) internally and UTF-8 externally. > There are converters for UTF-8 and UTF-16. > > > >> >>> >>> Also...since NSString has been mentioned...it is worth noting that >>> NSString is built atop CFString (source code here: >>> https://www.opensource.apple.com/source/CF/CF-855.11/CFString.c) which >>> does a fair job of optimizing memory by using bytes where it can and >>> shorts >>> where it cannot. It is also worth noting that characterAt: actually does >>> the wrong thing, since it assumes characters are no bigger than FFFF >>> rather >>> than 10FFFF. >>> >> >> Yes, and Squeak (and AFAIA, Pharo) has been doing this for ages. If one >> has become: it is very easy to manage. Now with Spur not only do we have >> become:, we have a fairly fast become:. >> >> Does this make sense? >> >> >>> Also...I'll just toss in this very nice article on unicode and how >>> NSString deals with it. >>> https://www.objc.io/issues/9-strings/unicode/ >>> >>> -Todd Blanchard >>> >> >> _,,,^..^,,,_ >> best, Eliot >>

Dec. 16, 2015

Re: [Pharo-dev] [Moose-dev] Where to get Spur?

by Esteban Lorenzano

> On 16 Dec 2015, at 12:01, Alexandre Bergel <alexandre.bergel(a)me.com> wrote: > >> I will update the links in the pharo page as soon as I have resumed the CI process. > > Ok. This is importantâ¦ done > > Cheers, > Alexandre > >> >> Esteban >> >>> On 16 Dec 2015, at 11:47, Alexandre Bergel <alexandre.bergel(a)me.com> wrote: >>> >>> Hi! >>> >>> The Pharo 5.0 (and therefore Moose) cannot be open with the last VM available on pharo.org. >>> I think that if the image can only be run on Spur, Spur should be available. >>> >>> So, where to get Spur? >>> Here: ? >>> https://ci.inria.fr/pharo/view/5.0-VM-Spur/job/PharoVM-spur32/375/Architect… >>> >>> I have tried Roassal on Spur, and text cannot be displayed properly. >>> >>> Cheers, >>> Alexandre >>> -- >>> _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: >>> Alexandre Bergel http://www.bergel.eu >>> ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. >>> >>> >>> >>> _______________________________________________ >>> Moose-dev mailing list >>> Moose-dev(a)list.inf.unibe.ch >>> https://www.list.inf.unibe.ch/listinfo/moose-dev >> > > -- > _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: > Alexandre Bergel http://www.bergel.eu > ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. > > > >

Dec. 16, 2015

Re: [Pharo-dev] [Moose-dev] Where to get Spur?

by Alexandre Bergel

> I will update the links in the pharo page as soon as I have resumed the CI process. Ok. This is importantâ¦ Cheers, Alexandre > > Esteban > >> On 16 Dec 2015, at 11:47, Alexandre Bergel <alexandre.bergel(a)me.com> wrote: >> >> Hi! >> >> The Pharo 5.0 (and therefore Moose) cannot be open with the last VM available on pharo.org. >> I think that if the image can only be run on Spur, Spur should be available. >> >> So, where to get Spur? >> Here: ? >> https://ci.inria.fr/pharo/view/5.0-VM-Spur/job/PharoVM-spur32/375/Architect… >> >> I have tried Roassal on Spur, and text cannot be displayed properly. >> >> Cheers, >> Alexandre >> -- >> _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: >> Alexandre Bergel http://www.bergel.eu >> ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. >> >> >> >> _______________________________________________ >> Moose-dev mailing list >> Moose-dev(a)list.inf.unibe.ch >> https://www.list.inf.unibe.ch/listinfo/moose-dev > -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

Dec. 16, 2015

Re: [Pharo-dev] [Moose-dev] Where to get Spur?

by Esteban Lorenzano

wget -O- get.pharo.org/50+vm <http://get.pharo.org/50+vm> wget -O- get.pharo.org/vm50 <http://get.pharo.org/vm50> wget -O- get.pharo.org/50 <http://get.pharo.org/50> zeroconf already downloads correct VM :) files.pharo.org/vm/pharo-spur32 <http://files.pharo.org/vm/pharo-spur32> has the compiled VMs I will update the links in the pharo page as soon as I have resumed the CI process. Esteban > On 16 Dec 2015, at 11:47, Alexandre Bergel <alexandre.bergel(a)me.com> wrote: > > Hi! > > The Pharo 5.0 (and therefore Moose) cannot be open with the last VM available on pharo.org. > I think that if the image can only be run on Spur, Spur should be available. > > So, where to get Spur? > Here: ? > https://ci.inria.fr/pharo/view/5.0-VM-Spur/job/PharoVM-spur32/375/Architect… > > I have tried Roassal on Spur, and text cannot be displayed properly. > > Cheers, > Alexandre > -- > _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: > Alexandre Bergel http://www.bergel.eu > ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. > > > > _______________________________________________ > Moose-dev mailing list > Moose-dev(a)list.inf.unibe.ch > https://www.list.inf.unibe.ch/listinfo/moose-dev

Dec. 16, 2015

Where to get Spur?

by Alexandre Bergel

Hi! The Pharo 5.0 (and therefore Moose) cannot be open with the last VM available on pharo.org. I think that if the image can only be run on Spur, Spur should be available. So, where to get Spur? Here: ? https://ci.inria.fr/pharo/view/5.0-VM-Spur/job/PharoVM-spur32/375/Architect… I have tried Roassal on Spur, and text cannot be displayed properly. Cheers, Alexandre -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

Dec. 16, 2015