June 2014 - Pharo-dev - lists.pharo.org

Some assembly for a friday afternoon
by Henrik Johansen June 27, 2014

June 27, 2014

Soo, I started dabbling with the thing I talked about before last summer, letting String parameters in NB calls have an encoding: option. (Thereâs already a slice in inbox to allow optional values other than true/false) Thought Iâd start with decoding; hereâs a small preview of the part which does the actual decoding, after needed string class has has been determined and instantiated. While itâs a fallback path for when the platform doesnât support SSE or other batch operations, itâs still using some neat tricks (imho) I thought others might enjoy on a Friday afternoon :) emitStandardDecodeUTF8CharactersFrom: aSource to: aDestination withCharSize: aCharSize scratchReg: scratchReg using: aGenerator "Emit decoding using only standard x86 ops" "We have already found what String class is needed for decoding aSource, and created an instance of the proper size" "This implementation focuses on minimizing jumps and register usage, at the cost of loading from source one byte at a time. "Input: aSource - memory pointer to C-string with UTF8 bytes aDestination - memoryPointer to first var field of String instance scratchReg - a register which will be modified while decoding aCharSize - The size in bytes of each character in our destination string, known at emission time Clobbers: scratchReg aSource and aDestination will end up pointing to end of strings" | asm scratch32 sLowByte sHighByte loop done oneByte twoBytes threeBytes | asm := aGenerator asm. loop := asm uniqueLabelName: 'utf8DecodeLoop'. done := asm uniqueLabelName: 'utf8DecodingDone'. scratch32 := scratchReg as32. sLowByte := scratch32 as8. sHighByte := sLowByte asHighByte. asm label: loop. "Unroll the inner loop as many times as we want, or, well, at least as many times as the backwards jump will allow us to" 8 timesRepeat:[ oneByte := asm uniqueLabelName: 'utf8OneByteDecode'. twoBytes := asm uniqueLabelName: 'utf8TwoByteDecode'. threeBytes := asm uniqueLabelName: 'utf8ThreeByteDecode'. asm xor: scratch32 with:scratch32. asm or: sLowByte with: aSource ptr8. asm cmp: sLowByte with: 0. asm je: done. asm add: aSource with: 1. asm test: sLowByte with: 2r10000000 asUImm8. asm jz: oneByte. "We have a header, place its data bits as initial high byte value" asm shl: scratch32 with: 8. asm xor: sHighByte with: 2r11000000 asUImm8. "Strip 2 byte header" asm test: sHighByte with: 2r00100000. asm jz: twoBytes. aCharSize > 1 ifTrue: [ asm xor: sHighByte with: 2r00100000. "Strip 3 byte header" asm test: sHighByte with: 2r000100000. asm jz: threeBytes. "This is a 4-byte character" asm xor: sHighByte with:2r00010000."Strip 4 byte header" "Read one trailing byte, remove the header, and shift the data out of low byte" asm or: sLowByte with: aSource ptr8. asm shl: sLowByte with:2. asm shl: scratch32 with: 6. asm add: aSource with: 1. asm label: threeBytes. "Read one trailing byte, remove the header, and shift the data out of low byte" asm or: sLowByte with: aSource ptr8. asm shl: sLowByte with:2. asm shl: scratch32 with: 6. asm add: aSource with: 1. ]. asm label: twoBytes. "Read last trailing byte, remove header, and shift the data bits into proper place" asm or: sLowByte with: aSource ptr8. asm shl: sLowByte with:2. asm shr: scratch32 with: 2. asm add: aSource with: 1. asm label: oneByte. asm mov: (aDestination ptr size: aCharSize) with: (scratch32 as: aCharSize). asm add: aDestination with: aCharSize.]. asm jmp: loop. asm label: done. And the relevant test code for that: testStandardDecodeWide | bytes string | "bytes := (ZnUTF8Encoder new encodeString: 'Cash, like â¬, is king'), #[0]." bytes := #[67 97 115 104 44 32 108 105 107 101 32 226 130 172 44 32 105 115 32 107 105 110 103 0]. string := WideString new: bytes size - 1. self testStandardDecode: bytes toWideString: string. ^ string testStandardDecode: utf8Bytes toWideString:aString <primitive: #primitiveNativeCall module: #NativeBoostPlugin> ^ self nbCallout function: #(void #(char* utf8Bytes, char* aString )) emit: [ :gen :proxy :asm | asm pop: asm EBX; pop: asm ECX. self emitStandardDecodeUTF8CharactersFrom: asm EBX to: asm ECX withCharSize: 4 scratchReg: asm EAX using: gen. asm mov: EAX with: gen proxy nilObject ] Which, though itâs currently cheating by pre-knowledn string class/size, isnât alot of overhead: ext := NBExternalString new. [ext testStandardDecodeWide] bench '5,030,000 per second.' '5,080,000 per second.' '5,190,000 per second.â Compared to an equivalent to testStandardDecodeWide, with emitStandardâ¦ removed from the primitive: [ext testEmptyDecode] bench '5,850,000 per second.' '5,800,000 per second.' '5,640,000 per second.' â¦ or compared to doing the decoding in image after the call: int := ZnUTF8Encoder new. [int decodeBytes:#[67 97 115 104 44 32 108 105 107 101 32 226 130 172 44 32 105 115 32 107 105 110 103 0]] bench '130,000 per second.' '131,000 per second.' '132,000 per second.â Cheers, Henry

4 3

[pharo-project/pharo-core]
by GitHub June 27, 2014

June 27, 2014

Branch: refs/tags/40051 Home: https://github.com/pharo-project/pharo-core

1 0

[pharo-project/pharo-core] 661e32: 40051
by GitHub June 27, 2014

June 27, 2014

Branch: refs/heads/4.0 Home: https://github.com/pharo-project/pharo-core Commit: 661e3292a610f67f3a2d796ff1239899e7063c39 https://github.com/pharo-project/pharo-core/commit/661e3292a610f67f3a2d796f… Author: Jenkins Build Server <board(a)pharo-project.org> Date: 2014-06-27 (Fri, 27 Jun 2014) Changed paths: R RecentSubmissions.package/AbstractMethodReferenceConverter.class/class/as yet unclassified/methodReference_referencesList_.st A RecentSubmissions.package/AbstractMethodReferenceConverter.class/class/instance creation/methodReference_referencesList_.st R RecentSubmissions.package/MessageList.class/class/toBeRemovedWithStringHolder/isPseudoSelector_.st M RecentSubmissions.package/MessageList.class/definition.st M RecentSubmissions.package/MessageList.class/instance/initialization/initialize.st R RecentSubmissions.package/MessageListBrowser.class/class/deprecated/byClassOn_.st R RecentSubmissions.package/MessageListBrowser.class/class/deprecated/byDateDescendingOn_.st M RecentSubmissions.package/MessageListBrowser.class/instance/items addition/addAllItems_.st M RecentSubmissions.package/MessageListBrowser.class/instance/private/format_.st M RecentSubmissions.package/MessageListBrowser.class/instance/t - accessing/rootItems.st M RecentSubmissions.package/MessageListBrowser.class/instance/tree/getMethod_ifAbsent_.st R RecentSubmissions.package/VersionMethodReferenceConverter.class/instance/initialization/handleStringSearch.st A ScriptLoader40.package/ScriptLoader.class/instance/pharo - scripts/script51.st A ScriptLoader40.package/ScriptLoader.class/instance/pharo - updates/update40051.st M ScriptLoader40.package/ScriptLoader.class/instance/public/commentForCurrentUpdate.st R Tools.package/AbstractMethodConverter.class/instance/initialization/canCompile.st R Tools.package/AbstractMethodConverter.class/instance/initialization/handleStringSearch.st M Tools.package/AbstractTool.class/instance/class/moveInNewPackage_.st M Tools.package/Browser.class/instance/drag and drop/dragPassengerFor_inMorph_.st M Tools.package/Browser.class/instance/message functions/shiftedMessageListMenu_.st R Tools.package/CodeHolder.class/class/as yet unclassified/decorateBrowserButtons.st R Tools.package/CodeHolder.class/class/as yet unclassified/decorateBrowserButtons_.st A Tools.package/CodeHolder.class/class/settings/decorateBrowserButtons.st A Tools.package/CodeHolder.class/class/settings/decorateBrowserButtons_.st M Tools.package/CodeHolder.class/instance/traits/spawnHierarchy.st R Tools.package/DynamicMessageImplementor.class/instance/evaluating-private/argumentNamePrefixOf_.st R Tools.package/SourceMethodConverter.class/instance/initialization/canCompile.st R Tools.package/TimeStampMethodConverter.class/instance/initialization/handleStringSearch.st Log Message: ----------- 40051 13428 Small code critique cleanup of RecentSubmissions https://pharo.fogbugz.com/f/cases/13428 13427 Small code critique clean of Tools https://pharo.fogbugz.com/f/cases/13427 http://files.pharo.org/image/40/40051.zip

1 0

[pharo-project/pharo-core]
by GitHub June 27, 2014

June 27, 2014

Branch: refs/tags/40050 Home: https://github.com/pharo-project/pharo-core

1 0

[pharo-project/pharo-core] e27de7: 40050
by GitHub June 27, 2014

June 27, 2014

Branch: refs/heads/4.0 Home: https://github.com/pharo-project/pharo-core Commit: e27de7acf459cb390e88020abf7927270579f02e https://github.com/pharo-project/pharo-core/commit/e27de7acf459cb390e88020a… Author: Jenkins Build Server <board(a)pharo-project.org> Date: 2014-06-27 (Fri, 27 Jun 2014) Changed paths: M MonticelloGUI.package/MCCodeTool.class/instance/menus/browseVersions.st R NECompletion.package/extension/VersionsBrowser/instance/contentsChanged.st M Polymorph-Tools-Diff.package/PSMCPatchMorph.class/instance/actions/browseVersions.st A ScriptLoader40.package/ScriptLoader.class/instance/pharo - scripts/script50.st A ScriptLoader40.package/ScriptLoader.class/instance/pharo - updates/update40050.st M ScriptLoader40.package/ScriptLoader.class/instance/public/commentForCurrentUpdate.st M Spec-Debugger.package/SpecDebuggerStack.class/instance/actions browsing/browseVersions.st M Spec-Tools.package/NewVersionBrowser.class/class/protocol/browseVersionsForClass_selector_.st R Spec-Tools.package/NewVersionBrowser.class/class/protocol/browseVersionsOf_.st A Spec-Tools.package/NewVersionBrowser.class/class/tool registry/registerToolsOn_.st M Tools.package/AbstractTool.class/instance/method/browseVersionsFrom_.st M Tools.package/FileContentsBrowser.class/instance/other/browseVersions.st R Tools.package/VersionsBrowser.class/README.md R Tools.package/VersionsBrowser.class/class/instance creation/browseVersionsForClass_selector_.st R Tools.package/VersionsBrowser.class/class/instance creation/browseVersionsOf_class_meta_category_selector_.st R Tools.package/VersionsBrowser.class/class/menu/versionsBrowserListMenu_.st R Tools.package/VersionsBrowser.class/class/tools registry/registerToolsOn_.st R Tools.package/VersionsBrowser.class/class/window color/patchworkUIThemeColor.st R Tools.package/VersionsBrowser.class/definition.st R Tools.package/VersionsBrowser.class/instance/diffs/showDiffs_.st R Tools.package/VersionsBrowser.class/instance/diffs/showRegularDiffs_.st R Tools.package/VersionsBrowser.class/instance/init %26 update/addedChangeRecord.st R Tools.package/VersionsBrowser.class/instance/init %26 update/addedChangeRecord_.st R Tools.package/VersionsBrowser.class/instance/init %26 update/changeListButtonSpecs.st R Tools.package/VersionsBrowser.class/instance/init %26 update/reformulateList.st R Tools.package/VersionsBrowser.class/instance/init %26 update/scanVersionsOf_class_meta_category_selector_.st R Tools.package/VersionsBrowser.class/instance/init %26 update/updateListsAndCodeIn_.st R Tools.package/VersionsBrowser.class/instance/initialization-release/wantsPrettyDiffOption.st R Tools.package/VersionsBrowser.class/instance/items creation/buildDefaultCodePane_.st R Tools.package/VersionsBrowser.class/instance/items creation/buildDiffCodePane.st R Tools.package/VersionsBrowser.class/instance/items creation/shoutAboutToStyle_.st R Tools.package/VersionsBrowser.class/instance/menu actions/buildMorphicCodePaneWith_.st R Tools.package/VersionsBrowser.class/instance/menu actions/compareToCurrentVersion.st R Tools.package/VersionsBrowser.class/instance/menu actions/compareToOtherVersion.st R Tools.package/VersionsBrowser.class/instance/menu/changeListKey_from_.st R Tools.package/VersionsBrowser.class/instance/menu/fileInSelections.st R Tools.package/VersionsBrowser.class/instance/menu/offerVersionsHelp.st R Tools.package/VersionsBrowser.class/instance/menu/removeMethodFromChanges.st R Tools.package/VersionsBrowser.class/instance/menu/versionsHelpString.st R Tools.package/VersionsBrowser.class/instance/menu/versionsMenu_.st R Tools.package/VersionsBrowser.class/instance/misc/addPriorVersionsCountForSelector_ofClass_to_.st R Tools.package/VersionsBrowser.class/instance/misc/selectedClass.st R Tools.package/VersionsBrowser.class/instance/misc/selectedClassOrMetaClass.st R Tools.package/VersionsBrowser.class/instance/misc/selectedMessageName.st R Tools.package/VersionsBrowser.class/instance/misc/showsVersions.st R Tools.package/VersionsBrowser.class/instance/private/buildDiffMorphFromOldString_toNewString_contextClass_.st R Tools.package/VersionsBrowser.class/instance/viewing access/contents.st Log Message: ----------- 40050 13425 Simplify API of VersionsBrowser https://pharo.fogbugz.com/f/cases/13425 13426 retire old VersionsBrowser https://pharo.fogbugz.com/f/cases/13426 http://files.pharo.org/image/40/40050.zip

1 0

[Tutorial] Rediscovering the UX of the legendary HP-35 Scientific Pocket Calculator
by Sven Van Caekenberghe June 27, 2014

June 27, 2014

Hi, I have written a new, extensive, long form, introductory article about Pharo. Rediscovering the UX of the legendary HP-35 Scientific Pocket Calculator A tutorial on Pharo, test and specification based immersive programming https://medium.com/@svenvc/rediscovering-the-ux-of-the-legendary-hp-35-scie… It is a bit different because - it is based on a non-trivial example - it uses a backdrop story unrelated to Pharo - it uses several multimedia elements - it is published on medium.com which is a general publishing platform The appendix describes several ways you can get the code. I think building both a Spec and Seaside UI from the same specification as well as reusing functional tests in different contexts is cool. Anyway, I hope you enjoy it. Sven -- Sven Van Caekenberghe Proudly supporting Pharo http://pharo.org http://association.pharo.org http://consortium.pharo.org

9 20

[pharo-project/pharo-core]
by GitHub June 27, 2014

June 27, 2014

Branch: refs/tags/40049 Home: https://github.com/pharo-project/pharo-core

1 0

[pharo-project/pharo-core] af0c62: 40049
by GitHub June 27, 2014

June 27, 2014

Branch: refs/heads/4.0 Home: https://github.com/pharo-project/pharo-core Commit: af0c62731c255f8d7b1a5520b77c6f9b9cadb3e7 https://github.com/pharo-project/pharo-core/commit/af0c62731c255f8d7b1a5520… Author: Jenkins Build Server <board(a)pharo-project.org> Date: 2014-06-27 (Fri, 27 Jun 2014) Changed paths: R MonticelloGUI.package/extension/ChangeList/class/recentLogOn_startingFrom_.st R MonticelloGUI.package/extension/ChangeList/class/recent_on_.st R MonticelloGUI.package/extension/ChangeList/instance/changeTo_.st R NautilusCommon.package/AnnotationRequest.class/instance/requests/priorTimeStamp.st M NautilusCommon.package/AnnotationRequest.class/instance/requests/priorVersionsCount.st A ScriptLoader40.package/ScriptLoader.class/instance/pharo - scripts/script49.st A ScriptLoader40.package/ScriptLoader.class/instance/pharo - updates/update40049.st M ScriptLoader40.package/ScriptLoader.class/instance/public/commentForCurrentUpdate.st R Tools.package/ChangeList.class/instance/accessing/setLostMethodPointer_.st M Tools.package/CodeHolder.class/instance/annotation/addPriorVersionsCountForSelector_ofClass_to_.st M Tools.package/CodeHolder.class/instance/annotation/annotationForSelector_ofClass_.st M Tools.package/VersionsBrowser.class/class/instance creation/browseVersionsOf_class_meta_category_selector_.st R Tools.package/VersionsBrowser.class/class/instance creation/browseVersionsOf_class_meta_category_selector_lostMethodPointer_.st R Tools.package/VersionsBrowser.class/class/instance creation/timeStampFor_class_reverseOrdinal_.st R Tools.package/VersionsBrowser.class/class/instance creation/versionCountForSelector_class_.st Log Message: ----------- 40049 13424 Clean up #priorTimeStamp https://pharo.fogbugz.com/f/cases/13424 13423 VersionBrowser>>#versionCountForSelector:class: not needed https://pharo.fogbugz.com/f/cases/13423 http://files.pharo.org/image/40/40049.zip

1 0

Nautilus memory leak/hog crashing Pharo
by Johan Brichau June 27, 2014

June 27, 2014

Hi, It seems that when even a single Nautilus system browser is open and you do a load (using Metacello), there is a huge amount of objects that get created and persisted in the image. This even leads to the point that the image crashes when I try to load our code using a ConfigurationOf. After some time, the Pharo process is stuck at 100%, image size is over 500MB and the entire image becomes unresponsive, finally crashing after an hour or so. I have not yet found which objects or why, but I just wrestled with this all day to find out what was going on. I first thought that Metacello was in an infinite loop but after noticing that the image was so large (500MB) and that it got reduced to 20% of its size after closing the browser window, I can say that Nautilus is gathering garbage. It is definitely not Metacello because I can trigger the same problem doing a load via Monticello only. When I load the ConfigurationOf without a single browser open, it loads 5x faster and the image size stays reasonable. Is this a known issue? Any thoughts on what may be causing this? regards! Johan

6 14

[pharo-project/pharo-core]
by GitHub June 27, 2014

June 27, 2014

Branch: refs/tags/40048 Home: https://github.com/pharo-project/pharo-core

1 0