December 2009 - Pharo-dev - lists.pharo.org

[Pharo-project] A reengineering the CompiledMethod trailers
by Igor Stasenko Dec. 13, 2009

Dec. 13, 2009

Hello guys, please take a look at changeset i just uploaded: http://bugs.squeak.org/view.php?id=7428 There is an initial implementation of CompiledMethodTrailer with some test coverage. My motivation behind this is simple: 1. no more poking with raw bytes, like this: holdsTempNames "Are tempNames stored in trailer bytes" | flagByte | flagByte := self last. (flagByte = 0 or: [flagByte = 251 "some source-less methods have flag = 251, rest = 0" and: [(1 to: 3) allSatisfy: [:i | (self at: self size - i) = 0]]]) ifTrue: [^ false]. "No source pointer & no temp names" flagByte < 252 ifTrue: [^ true]. "temp names compressed" ^ false "Source pointer" or this: endPC "Answer the index of the last bytecode." | size flagByte | "Can't create a zero-sized CompiledMethod so no need to use last for the errorEmptyCollection check. We can reuse size." size := self size. flagByte := self at: size. flagByte = 0 ifTrue: ["If last byte = 0, may be either 0, 0, 0, 0 or just 0" 1 to: 4 do: [:i | (self at: size - i) = 0 ifFalse: [^size - i]]]. flagByte < 252 ifTrue: ["Magic sources (temp names encoded in last few bytes)" ^flagByte <= 127 ifTrue: [size - flagByte - 1] ifFalse: [size - (flagByte - 128 * 128) - (self at: size - 1) - 2]]. "Normal 4-byte source pointer" ^size - 4 2. method's trailer can be used for storing a variety of stuff, not just source pointer or temps names. And it will be easy to add new kinds of trailers. A most useful, as to me, and which i've added initially is: - being able to embed the source code in trailer, so a compiled method and its source lives together in image. Some of you have expressed this idea before, so here it is. - being able to retrieve the method's source using other way, than through SourceFiles or embedded in trailer. I added two kinds of trailers for that: - get method's source by class+selector where it installed to. - get method's source by class+some string identifier - yours. Please tell me, what kind you want to have in addition. 3. a source pointer could surpass the 32Mb limit. A CompiledMethod already can encode a source pointer value of any size. Its now only a matter of fixing the source pointer encoding logic to enable having .source and .changes files above 32Mb. Please, review my code and send me your comments and wishes. At next stage i will create a changeset which will put this stuff in use, as well as cleanup lots of places in CompiledMethod and compiler/decompiler. -- Best regards, Igor Stasenko AKA sig.

1 0

[Pharo-project] Fwd: [ANN] Mason 1.0
by Lukas Renggli Dec. 13, 2009

Dec. 13, 2009

---------- Forwarded message ---------- From: Colin Putney <cputney(a)wiresong.ca> Date: 2009/12/13 Subject: [squeak-dev] [ANN] Mason 1.0 To: The general-purpose Squeak developers list <squeak-dev(a)lists.squeakfoundation.org> Hi folks, As I mentioned yesterday, here's the release version of Mason, a Squeak build system. It relies on OSProcess to build images, but it should be possible to build other artifacts, such as directory trees, zip files, SAR files etc without OSProcess. The download is available here: http://www.wiresong.ca/downloads/Mason-1.0.0.sar There's no documentation yet, but I've pasted below a brief description that I sent to the Pharo folks a little while ago. Cheers, Colin --- The core model is a hierarchy of targets. Targets represent the artifacts that Mason can produce, such as files, directories, images, packages etc, and the hierarchy represents the desired state, which Mason will work to create. There's a Canvas-like API for creating target hierarchies, and Products are objects that know how to specify targets using that API. A Product is an abstract thing, which represents a high-level concept such as "the latest version of a given package" or "the HTML documentation for a project." The role of a Product is to reduce that abstraction to a set of concrete targets which it specifies using the canvas API. A Product probably has to examine the environment to decide what targets to specify - it might scan a repository to determine the latest version of a package or scan a directory of creole files to determine which HTML files need to be generated. Given a target hierarchy, Mason can generate a Build. A Build contains a number of jobs, which collectively create the artifacts specified by the targets. Jobs essentially MethodObjects, and each do small amounts of work. The Build is responsible for running the jobs and managing dependencies between them. The build runs the jobs in parallel where possible, and since many jobs involve IO or spawning other processes via OSProcess, so there's actually a pretty decent performance advantage. Those are the broad outlines. There's a few issues here still, both architectural and with the current implementation. One is that building a target tree may be an unnecessary intermediate step. It would feasible to have targets just be transient entities the way TagBrushes are in Seaside - Products would specify a Build directly. Another is that I haven't tried to do any optimization along the lines of make - everything is built fresh every time. The targets -> build converter could try to examine the disk and see if it could avoid building things that are already up to date. I have an idea to address both these issues by having a step that walks over the target tree and optimizes it before the Build is created. This could involve identifying and merging common intermediate steps, and then doing the make trick of eliminating any targets that already exist and are up-to-date. For now though, I've been quite happy with even the unoptimized version. I've used it to build distribution SAR archives for OB, MC2 and Filesystem, development images, load-order and package dependency testing etc.

1 0

[Pharo-project] [update 1.1] #11097
by Marcus Denker Dec. 13, 2009

Dec. 13, 2009

11097 ----- Issue 1577: clean isSpecialWriteBinding (again) Issue 1585: More random dead code removal (76 unsent method removed)

3 10

[Pharo-project] SqueakMap code into Pharo?
by Monty Kamath Dec. 13, 2009

Dec. 13, 2009

How do I load code that is in SqueakMap into a Pharo Image? Specifically I'm interested in Sixx and SoapCore but it would be good to know if there is a general way to load code from SqueakMap into a Pharo image. Thanks, Monty -- View this message in context: http://n2.nabble.com/SqueakMap-code-into-Pharo-tp4157808p4157808.html Sent from the Pharo Smalltalk mailing list archive at Nabble.com.

4 4

[Pharo-project] Regarding the shortcuts
by Mariano Martinez Peck Dec. 13, 2009

Dec. 13, 2009

Now that you are discussing this in another thread..I remember that in August I opened this ticket: http://code.google.com/p/pharo/issues/detail?id=1042 For those you have ever seen the list of shortcut, here they are (I am not sure 100% are working now). Cheers, Mariano Lower-case command keys (use with Cmd key on Mac and Alt key on other platforms) a Select all b Browse it (selection is a class name or cursor is over a class-list or message-list) c Copy selection d Do it (selection is a valid expression) e Exchange selection with prior selection f Find g Find again h Set selection as search string for find again i Inspect it (selection is a valid expression, or selection is over an inspect-ilst) j Again once (do the last text-related operation again) k Set font l Cancel m Implementors of it (selection is a message selector or cursor is over a class-list or message-list) n Senders of it (selection is a message selector or cursor is over a class-list or message-list) o Spawn current method p Print it (selection is a valid expression) q Query symbol (toggle all possible completion for a given prefix) r Recognizer s Save (i.e. accept) t Finds a Transcript (when cursor is over the desktop) u Toggle alignment v Paste w Delete preceding word (over text); Close-window (over morphic desktop) x Cut selection y Swap characters z Undo Note: for Do it, Senders of it, etc., a null selection will be expanded to a word or to the current line in an attempt to do what you want. Also note that Senders/Implementors of it will find the outermost keyword selector in a large selection, as when you have selected a bracketed expression or an entire line. Finally note that the same cmd-m and cmd-n (and cmd-v for versions) work in the message pane of most browsers. Upper-case command keys (use with Shift-Cmd, or Ctrl on Mac or Shift-Alt on other platforms; sometimes Ctrl works too) A Advance argument B Browse it in this same browser (in System browsers only) C Compare argument to clipboard D Duplicate E Method strings containing it F Insert 'ifFalse:' G fileIn from it (a file name) H cursor TopHome: I Inspect via Object Explorer J Again many (apply the previous text command repeatedly until the end of the text) K Set style L Outdent (move selection one tab-stop left) M Select current type-in N References to it (selection is a class name, or cursor is over a class-list or message-list) O Open single-message browser (in message lists) P Make project link R Indent (move selection one tab-stap right) S Search T Insert 'ifTrue:' U Convert linefeeds to carriage returns in selection V Paste author's initials W Selectors containing it (in text); show-world-menu (when issued with cursor over desktop) X Force selection to lowercase Y Force selection to uppercase Z Capitalize all words in selection Other special keys Backspace Backward delete character Del Forward delete character Shift-Bksp Backward delete word Shift-Del Forward delete word Esc Pop up the Desktop Menu \ Send top window to back Cursor keys left, right, up, down Move cursor left, right, up or down Ctrl-left Move cursor left one word Ctrl-right Move cursor right one word Home Move cursor to begin of line or begin of text End Move cursor to end of line or end of text PgUp, Ctrl-up Move cursor up one page PgDown, Ctrl-Dn Move cursor down one page Note all these keys can be used together with Shift to define or enlarge the selection. You cannot however shrink that selection again, as in some other systems. Other Cmd-key combinations (not available on all platforms) Return Insert return followed by as many tabs as the previous line (with a further adjustment for additional brackets in that line) Space Select the current word as with double clicking Enclose the selection in a kind of bracket. Each is a toggle. (not available on all platforms) Ctrl-( Enclose within ( and ), or remove enclosing ( and ) Ctrl-[ Enclose within [ and ], or remove enclosing [ and ] Crtl-{ Enclose within { and }, or remove enclosing { and } Ctrl-< Enclose within < and >, or remove enclosing < and > Ctrl-' Enclose within ' and ', or remove enclosing ' and ' Ctrl-" Enclose within " and ", or remove enclosing " and " Note also that you can double-click just inside any of the above delimiters, or at the beginning or end of a line, to select the text enclosed. Text Emphasis (not available on all platforms) Cmd-1 10 point font Cmd-2 12 point font Cmd-3 18 point font Cmd-4 24 point font Cmd-5 36 point font Cmd-6 color, action-on-click, link to class comment, link to method, url Brings up a menu. To remove these properties, select more than the active part and then use command-0. Cmd-7 bold Cmd-8 italic Cmd-9 narrow (same as negative kern) Cmd-0 plain text (resets all emphasis) Cmd-- underlined (toggles it) Cmd-= struck out (toggles it) Shift-Cmd-- (aka :=) negative kern (letters 1 pixel closer) Shift-Cmd-+ positive kern (letters 1 pixel larger spread)

3 3

[Pharo-project] Unsent selectors in CompiledMethod
by Igor Stasenko Dec. 13, 2009

Dec. 13, 2009

Hello guys, there are few unsent messages on class side of CompiledMethod, primitive: primNum numArgs: numArgs numTemps: numTemps stackSize: stackSize literals: literals bytecodes: bytecodes trailer: trailerBytes and newBytes: numberOfBytes trailerBytes: trailer nArgs: nArgs nTemps: nTemps nStack: stackSize nLits: nLits primitive: primitiveIndex flag: flag I checked both in Pharo 1.1-core and in Trunk images, both of them seem having no senders. Any insights if it safe to wipe them out? -- Best regards, Igor Stasenko AKA sig.

1 0

[Pharo-project] Where's the beef? (Was: Re: [Newbies] [semi-OT] (fwd) Re: What Killed Smalltalk?)
by Lawson English Dec. 12, 2009

Dec. 12, 2009

To continue and extend my rant in response to this thread, here are examples of Books I'd Like to See for Squeak/Pharo: Books like these: http://www.greenteapress.com/semaphores/downey05semaphores.pdf http://www.greenteapress.com/compmod/ http://beej.us/guide/bgnet/ Articles like these: http://www.amk.ca/python/howto/sockets/ http://nehe.gamedev.net/ http://rubylearning.com/satishtalim/ruby_threads.html and http://rubylearning.com/satishtalim/ruby_socket_programming.html http://www.boddie.org.uk/python/XML_intro.html interfaces like these: http://www.spiderland.org/ etc. Without these kinds of materials available specifically oriented towards squeak/pharo use, your average beginning/intermediate programmer is NOT going to find squeak/pharo all that attractive. Another area lacking (where squeak should shine above all others) is in the voice-over demo/tutorial on youtube arena. A youtube video of VNC-based pair-programming on a beginning/intermediate level problem using squeak could be very compelling, I think. This would be the poor man's version of my idea about a web-cast of a live pair-programming session. Actually doing the live webcast, complete with mutli-channel chat/feedback/comments/questions and then making it available the way Metanomics interviews are, would be a very good teaching/marketing tool for Smalltalk. A primitive example of this is found about 2 minutes into this science friday video: http://www.youtube.com/watch?v=4fWPwOLJFA8 People have devised web-page playback of the video synced with the local chat discussion without the distracting superposition of the text chat on top of the video image, which could be very useful in a teachingseminar context, I believe. Lawson Lawson English wrote: > Steve Wessels wrote: >> That's right. Smalltalk hasn't died. I am fortunate enough to be >> part of a team developing financial software for many years using >> Smalltalk. >> >> People have predicted Smalltalk's death about as often as Apple's death. >> >> I think comparisons between Smalltalk and Java have to take marketing >> into account. >> >> Paying Smalltalk work is harder to find. Here's an interesting >> twist. Companies looking for skilled Object Oriented developers, if >> they understand what they need, will seek programmers with Smalltalk >> experience. >> >> > > Speaking as a long-term script kiddie who likes to collect languages, > I can tell you that the main reason(s) why *I* find Smalltalk > difficult to use involve(s): lack of documentation, lack of > well-documented example code, lack of compsci teaching materials > written with Smalltalk for the example code, etc. Notice a trend? > > Smalltalk may have been designed to be easy to learn and use, but it > has never been adopted by the pedagogical community of teachers and > how-to book-writers, so naturally new programmers (from whom > experienced programmers grow) are never attracted to it. > > The main issue is lack of ways for new programmers (experienced in > other languages or otherwise) to learn not just the syntax of the > language, but how to DO stuff with it. > > E.G.: I can't grab the Unix Programming or Unix Network Programming > books by Stevens and work through Smalltalk equivalents of the example > code. There's no Data Structures in Smalltalk books, nor Algorithm > Analysis in Smalltalk books, nor build your own virtual world from > scratch using Smalltalk and OpenGL, or Game AI in Smalltalk, or... > There IS a Numerical Methods book in Smalltalk, but that's hardly > beginner/intermediate level, IMHO. > > You get the idea. All the reference material for Smalltalk is geared > for complete beginners, or for people who are exceedingly experienced. > No middle ground. > > > And some of the most interesting (sounding) aspects of Smalltalk, such > as the Teatime architecture, are hardly covered in ways that relative > newcomers can understand (speaking as a relative newcomer with a 2 > year AAS degree and a couple decades intermittent experience > programming). > > Smalltalk (e.g. Squeak) may not be fast enough to be used in high-end > production implementations, but surely it could be the > language-of-choice for learning new aspects of compsci and > programming. After all, many of these "new aspects" of compsci and > programming were originally developed/matured using Smalltalk. Why > should people have to go to a less versatile language in order to > actually learn to use the results of Smalltalk-based research? > > > > Lawson > _______________________________________________ > Beginners mailing list > Beginners(a)lists.squeakfoundation.org > http://lists.squeakfoundation.org/mailman/listinfo/beginners >

2 1

[Pharo-project] The method trailer format
by Igor Stasenko Dec. 12, 2009

Dec. 12, 2009

Here is my proposal for changing the method trailer in order to be able to encode various stuff to trailer. Any corrections, suggestions are welcome. The kind of compiled method trailer is determined by the last byte of compiled method. The format is following: "2rkkkkkkdd" where 'k' bits stands for 'kind' , allowing totally 2^6 different kinds of method trailer and 'd' bits is data. The following is description of defined trailer kinds: k = 000000, dd = 00 method has no trailer, and total trailer size bytes is 1 (just for last byte) k = 000001, method has cleared trailer (it was set to something else, but then cleared) dd+1 determines the number of bytes for size field, and size is a total length of trailer bytes So a total length of trailer is: 1 + (dd + 1) + size k = 000010 the trailer contains a list of method temp names, compressed using qCompress: method. dd+1 determines the number of bytes for size field, and size is a number of bytes of compressed buffer. So a total length of trailer is: 1 + (dd + 1) + size k = 000011 the trailer contains a list of method temp names, compressed using GZIP compression method. dd+1 determines the number of bytes for size field, and size is a number of bytes of compressed buffer So a total length of trailer is: 1 + (dd + 1) + size k = 000100 the trailer indicates , that method source is determined by a class + selector where it is installed to. Trailer size = 1. k = 000101 the trailer indicates , that method source is determined by a class + some ByteString identifier. dd+1 determines the number of bytes for size field, denoting the length of ByteString identifier. A total length of trailer is: 1 + (dd + 1) + size k = 000110 the trailer contains an utf-8 encoded method source code, compressed using qCompress: method. dd+1 determines the number of bytes for size field, denoting the length of compressed buffer A total length of trailer is: 1 + (dd + 1) + size k = 000111 the trailer contains an utf-8 encoded method source code, comressed using GZIP dd+1 determines the number of bytes for size field, denoting the length of compressed buffer A total length of trailer is: 1 + (dd + 1) + size k = 111111 the trailer is encoded source pointer. Total trailer size is 4-bytes (this is backwards compatible with most of currently existing compiled methods) k = 111110 the trailer is encoded source pointer. Total trailer size is 5-bytes k = 111101 the trailer is encoded source pointer. Total trailer size is 6-bytes k = 111100 the trailer is encoded source pointer. Total trailer size is 7-bytes k = 111011 the trailer is encoded source pointer. Total trailer size is 8-bytes -- Best regards, Igor Stasenko AKA sig.

1 0

[Pharo-project] [update 1.1] #11096
by Marcus Denker Dec. 12, 2009

Dec. 12, 2009

11096 ----- Issue 1584: ifEmpty: should not return nil if not empty Issue 1588: remove Compressed Sources Issue 1586: clean FileList Issue 1587: clean visitFutureNode:

1 0

[Pharo-project] MetaSource (was: A centralized repository (Going a step forward Gofer and Metacello))
by Torsten Bergmann Dec. 12, 2009

Dec. 12, 2009

Esteban Lorenzano wrote: >I will start work on a first version of tools needed Have a look at MetaSource, started as a SqueakSource successor based on newer Squeak/Pharo/Seaside with possible Metacello integration in the future. http://www.squeaksource.com/MetaSource Attached is a screenshot. Use one of Damiens latest Pharo dev-images and use the package "MetaSource-ImageBuilder" to load all. (it loads Seaside, FFI, Widgetbox, MetaSource ...) and prepares a full image with the webapp ready to start. It was discussed offlist and progress is very slow but could be a start. Outcome of the offlist discussion was to (maybe) wait until the next Monticello version is out and a stable Metacello is ready... Bye T. -- GRATIS fÃ¼r alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01

2 1