April 2013 - Pharo-dev - lists.pharo.org

Re: [Pharo-project] [Ann] TxText. New text editor done!

by Denis Kudriashov

2013/4/28 stephane ducasse <stephane.ducasse(a)free.fr> > Hi denis > > Alain is gone on vacation but it told me that if you code scale he will > throw away what he did :) > May be the decorators that alain wrote can be merged. > In any case this is excellent to get a better system. > Yes. This is why I work on this project. But my first proposals was not make editor for large text. I actually not think about it at all. My main idea is make clean and extendible text editor. So anybody can understand how layout built, where text insertion happens, how it processed, how cursor wors and etc. I want text editor which is not required hacks to simple tasks like allow only numbers, hide cursor, disable text selection, make masked input, make smart completions and etc. > Stef > > > On Apr 27, 2013, at 5:17 PM, Denis Kudriashov <dionisiydk(a)gmail.com> > wrote: > > > I should say it is not difficult to do with current design. I were > > think about it and current layout building logic requires little > > changes, maybe just one spesific method. > > > > But there is cases where any text change required rebuilding full > > layout. Fo example, single line text with wrapping mode. > > > > > > 2013/4/27, Igor Stasenko <siguctua(a)gmail.com>: > >> Very impressive progress, Denis! :) > >> > >> I going to finish low-level stuff in Athens (path approximation / > >> point location) > >> and then go straight to text rendering with existing Text. > >> Next stage will be to take TxText model and provide rendering for it > >> with Athens, > >> as well as review the code. > >> > >> About text editing and re-layout. > >> It should be possible that any local update (which affecting only > >> single character span or multiple adjusted character spans will > >> require only local recalculations of text layout). Otherwise there is > >> no reason why in our model we don't keep whole text in single big > >> buffer (like Text does). > >> Splitting text on multiple spans was the reason to make local layout > >> updates possible. > >> But i know it is not that easy to do :) > >> > >> > >> -- > >> Best regards, > >> Igor Stasenko. > >> > >> > > > > >

April 28, 2013

Re: [Pharo-project] Trying to understand DateAndTime

by stephane ducasse

thanks a lot! Friday we have an official sprint so I'm sure that this issue will be addressed. Stef > See https://pharo.fogbugz.com/default.asp?10425# and corresponding SLICE in 3.0 inbox > Note: I don't know what is the policy with the labels/states of these bug tracker, and it rather bothers me, but the SLICE is ready for tests/reviews. > > > 2013/4/27 Nicolas Cellier <nicolas.cellier.aka.nice(a)gmail.com> > There is more: > > 1) hasEqualTicks: use julianDayNumber instead of julianDayNumberUTC > 2) (Time dateAndTime now) interprets the (Time localSeconds) which are from the wrong primitive (seconds ellapsed since squeak epoch translated to local time) as seconds ellapsed since squeak Epoch (UTC time). > > We should really ban the old primitive 137 and only use the new one (240 which works with UTC microseconds). > > I think Camillo did a good job, but he stopped cleaning too soon. > Ah, young guys are so impatient to invent the future ;) > > > 2013/4/27 stephane ducasse <stephane.ducasse(a)free.fr> > > On Apr 27, 2013, at 6:33 PM, Nicolas Cellier <nicolas.cellier.aka.nice(a)gmail.com> wrote: > > > Since DateAndTime comment is out of date (sic !) and current implementation seems not free of bug, here is an effort to summarize and understand the whole thing, let's call this a review. > > Thanks this is a great initiative! > > > > Please tell me where my interpretations are wrong. > > > > 1) The DateAndTime is stored internally as > > - a point in UTC time (julianDayNumber, seconds, nanos) > > - an offset from UTC (a Duration) denoting the local time zone > > > > 2) The ticks method returns the UTC part {julianDayNumber. seconds. nanos} > > > > 3) DateAndTime print themselves in local time using the offset > > > > 4) other methods (with some exceptions) return the local dateAndTime parts (year month day hours minutes seconds) > > > > Exceptions are: > > - secondsSinceMidnight (which should be renamed secondsSinceMidnightUTC IMO, even if the method is classified private) > > - julianDayNumberUTC as the name tells > > > > So far so good (but secondsSinceMidnight which is error prone) > > > > What I find strange: > > - #hash uses the offset... Why ??? > > > > d1 := DateAndTime now. > > d2 := d1 offset: d1 offset + 1 hours. > > { > > d1 = d2. > > d1 hash = d2 hash. > > } > > gives #(true false), a clue? > > > > - #< compares julianDayNumber (the UTC inst. var.) with otherDate julianDayNumber (with otherDate local offset) which seems wrong, it should better use julianDayNumberUTC or (normalized) ticks. > > > > - #= could be simplified and accelerated if using #hasEqualTicks: (if the ticks are correctly normalized though which would be the case since #ticks:offset: does, unfortunately #setJdn:seconds:nanos:offset: does not). > > > > Some senders of #setJdn:seconds:nanos:offset: don't normalize the day/seconds/nanos, though it should be their responsibility (DateAndTime todayAtMilliSeconds: xxx) (DateAndTime todayAtNanoSeconds: xxx), not counting year:month:day:hour:minute:second:nanoSecond:offset: which does not either (many senders...). > > Maybe we should better let the normalization responsibility to #setJdn:seconds:nanos:offset:. > > > > It remain to analyze the conversion protocol (asYear etc...) which seems to use the local time year, but I don't understand the whole Timespan thing right now (why DateAndTime now asYear starts now, and not on january 1st?). > > > > Nicolas > > > > > > > >

April 28, 2013

Re: [Pharo-project] [Ann] TxText. New text editor done!

by Denis Kudriashov

Hi 2013/4/27 Sean P. DeNigris <sean(a)clipperadams.com> > Sean P. DeNigris wrote > > You're my new best friend :) > > The cursor is an actual Morph (TxCursorMorph) instead of magic conjured up > my Paragraph!!! All my other friends are fired, they've never given me a > present this nice :) > :) > > Also, please add me to the repo. I have a small fix (TxCursorMorph should > show cursorColor instead of defaultColor) > > I not have permissions for that. Igor can you add Sean as contributor? I were make another fixes and I added your find too. > > > ----- > Cheers, > Sean > -- > View this message in context: > http://forum.world.st/Ann-TxText-New-text-editor-done-tp4683876p4683990.html > Sent from the Pharo Smalltalk mailing list archive at Nabble.com. > >

April 28, 2013

Re: [Pharo-project] Trying to understand DateAndTime

by Sean P. DeNigris

Nicolas Cellier wrote > Note: I don't know what is the policy with the labels/states of these bug > tracker, and it rather bothers me, but the SLICE is ready for > tests/reviews. I was a bit confused at first too. You have to click "Resolved" and then you get a whole other set of states, including "fix review needed". I've done it for this issue... ----- Cheers, Sean -- View this message in context: http://forum.world.st/Trying-to-understand-DateAndTime-tp4683997p4684063.ht… Sent from the Pharo Smalltalk mailing list archive at Nabble.com.

April 28, 2013

Re: [Pharo-project] Trying to understand DateAndTime

by Nicolas Cellier

See https://pharo.fogbugz.com/default.asp?10425# and corresponding SLICE in 3.0 inbox Note: I don't know what is the policy with the labels/states of these bug tracker, and it rather bothers me, but the SLICE is ready for tests/reviews. 2013/4/27 Nicolas Cellier <nicolas.cellier.aka.nice(a)gmail.com> > There is more: > > 1) hasEqualTicks: use julianDayNumber instead of julianDayNumberUTC > 2) (Time dateAndTime now) interprets the (Time localSeconds) which are > from the wrong primitive (seconds ellapsed since squeak epoch translated to > local time) as seconds ellapsed since squeak Epoch (UTC time). > > We should really ban the old primitive 137 and only use the new one (240 > which works with UTC microseconds). > > I think Camillo did a good job, but he stopped cleaning too soon. > Ah, young guys are so impatient to invent the future ;) > > > 2013/4/27 stephane ducasse <stephane.ducasse(a)free.fr> > >> >> On Apr 27, 2013, at 6:33 PM, Nicolas Cellier < >> nicolas.cellier.aka.nice(a)gmail.com> wrote: >> >> > Since DateAndTime comment is out of date (sic !) and current >> implementation seems not free of bug, here is an effort to summarize and >> understand the whole thing, let's call this a review. >> >> Thanks this is a great initiative! >> >> >> > Please tell me where my interpretations are wrong. >> > >> > 1) The DateAndTime is stored internally as >> > - a point in UTC time (julianDayNumber, seconds, nanos) >> > - an offset from UTC (a Duration) denoting the local time zone >> > >> > 2) The ticks method returns the UTC part {julianDayNumber. seconds. >> nanos} >> > >> > 3) DateAndTime print themselves in local time using the offset >> > >> > 4) other methods (with some exceptions) return the local dateAndTime >> parts (year month day hours minutes seconds) >> > >> > Exceptions are: >> > - secondsSinceMidnight (which should be renamed secondsSinceMidnightUTC >> IMO, even if the method is classified private) >> > - julianDayNumberUTC as the name tells >> > >> > So far so good (but secondsSinceMidnight which is error prone) >> > >> > What I find strange: >> > - #hash uses the offset... Why ??? >> > >> > d1 := DateAndTime now. >> > d2 := d1 offset: d1 offset + 1 hours. >> > { >> > d1 = d2. >> > d1 hash = d2 hash. >> > } >> > gives #(true false), a clue? >> > >> > - #< compares julianDayNumber (the UTC inst. var.) with otherDate >> julianDayNumber (with otherDate local offset) which seems wrong, it should >> better use julianDayNumberUTC or (normalized) ticks. >> > >> > - #= could be simplified and accelerated if using #hasEqualTicks: (if >> the ticks are correctly normalized though which would be the case since >> #ticks:offset: does, unfortunately #setJdn:seconds:nanos:offset: does not). >> > >> > Some senders of #setJdn:seconds:nanos:offset: don't normalize the >> day/seconds/nanos, though it should be their responsibility (DateAndTime >> todayAtMilliSeconds: xxx) (DateAndTime todayAtNanoSeconds: xxx), not >> counting year:month:day:hour:minute:second:nanoSecond:offset: which does >> not either (many senders...). >> > Maybe we should better let the normalization responsibility to >> #setJdn:seconds:nanos:offset:. >> > >> > It remain to analyze the conversion protocol (asYear etc...) which >> seems to use the local time year, but I don't understand the whole Timespan >> thing right now (why DateAndTime now asYear starts now, and not on january >> 1st?). >> > >> > Nicolas >> > >> > >> >> >> >

April 28, 2013

Re: [Pharo-project] Pharo 3.0 TestRunner results

by Benoit St-Jean

Here are the results with Pharo 3.0, update 30068). See attached file. I'm on Windows XP SP3. Â ----------------- Benoit St-Jean Yahoo! Messenger: bstjean Blogue: endormitoire.wordpress.com A standpoint is an intellectual horizon of radius zero. (Albert Einstein)

April 27, 2013

Re: [Pharo-project] Trying to understand DateAndTime

by Nicolas Cellier

There is more: 1) hasEqualTicks: use julianDayNumber instead of julianDayNumberUTC 2) (Time dateAndTime now) interprets the (Time localSeconds) which are from the wrong primitive (seconds ellapsed since squeak epoch translated to local time) as seconds ellapsed since squeak Epoch (UTC time). We should really ban the old primitive 137 and only use the new one (240 which works with UTC microseconds). I think Camillo did a good job, but he stopped cleaning too soon. Ah, young guys are so impatient to invent the future ;) 2013/4/27 stephane ducasse <stephane.ducasse(a)free.fr> > > On Apr 27, 2013, at 6:33 PM, Nicolas Cellier < > nicolas.cellier.aka.nice(a)gmail.com> wrote: > > > Since DateAndTime comment is out of date (sic !) and current > implementation seems not free of bug, here is an effort to summarize and > understand the whole thing, let's call this a review. > > Thanks this is a great initiative! > > > > Please tell me where my interpretations are wrong. > > > > 1) The DateAndTime is stored internally as > > - a point in UTC time (julianDayNumber, seconds, nanos) > > - an offset from UTC (a Duration) denoting the local time zone > > > > 2) The ticks method returns the UTC part {julianDayNumber. seconds. > nanos} > > > > 3) DateAndTime print themselves in local time using the offset > > > > 4) other methods (with some exceptions) return the local dateAndTime > parts (year month day hours minutes seconds) > > > > Exceptions are: > > - secondsSinceMidnight (which should be renamed secondsSinceMidnightUTC > IMO, even if the method is classified private) > > - julianDayNumberUTC as the name tells > > > > So far so good (but secondsSinceMidnight which is error prone) > > > > What I find strange: > > - #hash uses the offset... Why ??? > > > > d1 := DateAndTime now. > > d2 := d1 offset: d1 offset + 1 hours. > > { > > d1 = d2. > > d1 hash = d2 hash. > > } > > gives #(true false), a clue? > > > > - #< compares julianDayNumber (the UTC inst. var.) with otherDate > julianDayNumber (with otherDate local offset) which seems wrong, it should > better use julianDayNumberUTC or (normalized) ticks. > > > > - #= could be simplified and accelerated if using #hasEqualTicks: (if > the ticks are correctly normalized though which would be the case since > #ticks:offset: does, unfortunately #setJdn:seconds:nanos:offset: does not). > > > > Some senders of #setJdn:seconds:nanos:offset: don't normalize the > day/seconds/nanos, though it should be their responsibility (DateAndTime > todayAtMilliSeconds: xxx) (DateAndTime todayAtNanoSeconds: xxx), not > counting year:month:day:hour:minute:second:nanoSecond:offset: which does > not either (many senders...). > > Maybe we should better let the normalization responsibility to > #setJdn:seconds:nanos:offset:. > > > > It remain to analyze the conversion protocol (asYear etc...) which seems > to use the local time year, but I don't understand the whole Timespan thing > right now (why DateAndTime now asYear starts now, and not on january 1st?). > > > > Nicolas > > > > > > >

April 27, 2013

Re: [Pharo-project] Opal Decompiler status

by stephane ducasse

On Apr 27, 2013, at 8:00 PM, Nicolas Cellier <nicolas.cellier.aka.nice(a)gmail.com> wrote: > Right, if you embed source along with CompiledMethod (to handle the case when the CompiledMethod has been replaced but one of its block of code is still used), then you don't need Decompiler in the first place. > > Nonetheless, I would remove the .sources but not the .changes. The .changes is not only a source code repository (that feature can go away if you want), it's before all a change log, an insurance to retrieve some change when everything else failed (image crashed or worse corrupted image won't restart). You can make the insurance optional if you want, but please continue to provide an equivalent service. A change file is the most simple thing that could possibly work IMO. But this is another thread. I agree, we have been discussing (and I do not like much the idea to have the changes inside the image as objects because now we have a nice literal object parser/writer and making sure that we can never lose source code is cool). In any case we are working on a new change format recording more high-level entity (such refactoring). We looked again at the model that veronica did, and Ezequiel and we looked again at DeltaStreams. We should digest all that and come up with a new alternate changes model file. I was about to contact goran to see if he wants to participate/ read a paper but we should write the paper first :) > Concerning the temp mapping, I agree, we should not compete with Eliot, he's very tough at tedious tasks, our only weapon is lazyness, lazyness often leads to efficiency ;) I'm curious to check how you handled this complex part with AST when I'll have more time to dig. > > > 2013/4/27 Marcus Denker <marcus.denker(a)inria.fr> > > On Apr 27, 2013, at 6:42 PM, Nicolas Cellier <nicolas.cellier.aka.nice(a)gmail.com> wrote: > > > Thanks Marcus. > > I'm among the skepticals concerning the AST, but I'd like to be proven wrong, because AST level would certainly simplify things a lot. > > My main reserve is that interruption can occur at BC level, so for debugging purpose, what are your plans? > > Will you move the PC at some AST node boundary (if it is possible given side effects of some BC)? > > > For the Debugger, everything stays as it is (until Pharo 4 or so)â¦ if you look at it, the current Debugger never decompiles if there is source available. > It *compiles* to get > -> the mapping BC -> text > -> the information how temporary variables in the byte code are actually related to temps in the source. > (this is very complex, temps can be e.g. stored on the heap if they are written to in a closure, and when they are just > read they have a different offset in each closure they are in. Conversely, some temps in the byte code are used > to store the array that hold the variables that are on the heapâ¦) > > The old compiler recorded mappings while compiling that where encodedâ¦ quite complex, at least for my tiny brain. > > So the new just keeps the AST annotated with all the needed infos, this is much easier to debug (and we do have the > memory these days, and as we cache the AST, it's even fast). > > So the debugger needs the compiler. The decompiler now exists just to make text so that we can call the compiler > in the case there is no .sources. The debugger *always* compiles to get the mappings, as soon as there is source code > the decompiler will never be used. (and even if the decompiler is used, the compiler is called right after on it's results so > one can record the mappings). > > So if you make sure there is always source-code (or a representation with the right amount of meta data), you don't need the decompiler. > > So at the start it will be the source code. And yes, this takes memory. But we are in 2013 and if we have one thing than it's memory. > (the $25 Raspi comes with 256MB, the $35 with 512MBâ¦). > > We could have shipped 2.0 with 8MB of useless Monticello meta data and nobody would have even realized it. (like we > have now megabytes of fonts in the imageâ¦). Yet the source is specialâ¦ I really wonder why. > > (And yes, there should be solutions to not need unused data in main memory and solutions to share across multiple images > data that is the sameâ¦ but for all kinds of stuff, not just source code). > > Marcus >

April 27, 2013

Re: [Pharo-project] Opal Decompiler status

by stephane ducasse

> Thanks Marcus. > I'm among the skepticals concerning the AST, but I'd like to be proven wrong, because AST level would certainly simplify things a lot. Me too :) But marcus knows it since the end of his PhD :D. This is why I really want to see AST compression. > My main reserve is that interruption can occur at BC level, so for debugging purpose, what are your plans? > Will you move the PC at some AST node boundary (if it is possible given side effects of some BC)? > > > 2013/4/27 Marcus Denker <marcus.denker(a)inria.fr> > > On Apr 27, 2013, at 5:59 PM, Marcus Denker <marcus.denker(a)inria.fr> wrote:. > > > >> Could we have a primer on what remains to do on the Opal front? > >> > > > > > > -> debug BC-IR->AST->text mapping more (lots of it working already) > > -> debug temp variable lookup in optimized blocks in the debugger (almost there, too) > > -> Go through all the test for the old Compiler and port them to the new. > > -> Better compiler API and refactor the whole system to use it > > (but keep a backward compatible API at least to some extend) > > > All the TODOs are in the bug tracker, Project "Compiler (Opal)". > > There are right now 29 Issues. > > Marcus >

April 27, 2013

Re: [Pharo-project] Opal Decompiler status

by stephane ducasse

But I would like that we finish first all the other cool tasks for 3.0 before opening something new. Finishing is difficult so let us focus on it. Stef On Apr 27, 2013, at 8:13 PM, Marcus Denker <marcus.denker(a)inria.fr> wrote: > > On Apr 27, 2013, at 8:01 PM, Nicolas Cellier <nicolas.cellier.aka.nice(a)gmail.com> wrote: > >> Right, if you embed source along with CompiledMethod (to handle the case when the CompiledMethod has been replaced but one of its block of code is still used), then you don't need Decompiler in the first place. >> >> Nonetheless, I would remove the .sources but not the .changes. The .changes is not only a source code repository (that feature can go away if you want), it's before all a change log, an insurance to retrieve some change when everything else failed (image crashed or worse corrupted image won't restart). You can make the insurance optional if you want, but please continue to provide an equivalent service. A change file is the most simple thing that could possibly work IMO. But this is another thread. >> > Yes, we have a solution for thatâ¦ > > the thing is that the .changes has 3 roles. In the 1978, it was very clever to design one extremely memory efficient mechanism to kill all three: > > 1) keep a history of all the accepted method sources in the image (see "versions") > 2) store the code on disk efficiently with no duplications (They counted those extremely expensive disks in the one-diget Megabytes back then). > 3) have transaction log for the source code in case of image crash. > > Now today, we can solve all three using three different methods: > > 1) we will just keep the accepted methods in memory until you commit to monticello/git > (in case of git one can even commit all the intermediates, for MC one would just commit the latest). > after the in-image history is pruned (like it is now eventually anyway when you start with a fresh image). > 2) We don't need to store the *current* version on disk. Compressed in memory. Yes, that is what progress bringsâ¦ > 3) Disk space is so cheap it is not even funny. > -> we will just have a dedicated log. And we can even store Objectsâ¦ > > And then we can leverage the extreme simplicity of the resulting scheme.. simplicity is an amazing thing. (Or the > contrary: I think people understate the effects of complexity). > > Marcus

April 27, 2013