June 2017 - Pharo-users - lists.pharo.org

Re: [Pharo-users] [Pharo-dev] [ANN] Pharo Consortium New Bronze Member: Palantir Solutions

by Tudor Girba

Excellent news! Doru > On Jun 6, 2017, at 2:53 PM, Marcus Denker <marcus.denker(a)inria.fr> wrote: > > The Pharo Consortium is very happy to announce that Palantir Solutions > has joined the Consortium as a Bronze Member. > > About > - Palantir Solutions: https://www.petrovr.com > - Pharo Consortium: http://consortium.pharo.org > > The goal of the Pharo Consortium is to allow companies and institutions to > support the ongoing development and future of Pharo. > > Individuals can support Pharo via the Pharo Association: > > - http://association.pharo.org > -- www.tudorgirba.com www.feenk.com "Every thing should have the right to be different."

June 6, 2017

[ANN] Pharo Consortium New Bronze Member: Palantir Solutions

by Marcus Denker

The Pharo Consortium is very happy to announce that Palantir Solutions has joined the Consortium as a Bronze Member. About - Palantir Solutions: https://www.petrovr.com - Pharo Consortium: http://consortium.pharo.org The goal of the Pharo Consortium is to allow companies and institutions to support the ongoing development and future of Pharo. Individuals can support Pharo via the Pharo Association: - http://association.pharo.org

June 6, 2017

Re: [Pharo-users] Porting Transducers to Pharo

by phil＠highoctane.be

Check https://medium.com/@i.oleks/interface-for-selecting-data-from-a-dataset-d7c… https://medium.com/@i.oleks/an-example-of-test-driven-development-c9ce033f0… Loading a dataframe from a dataset and then using transducers for a transformation pipeline would be great. DataFrame is part of Polymath. https://github.com/PolyMathOrg/PolyMath http://www.smalltalkhub.com/#!/~PolyMath/PolyMath Phil On Tue, Jun 6, 2017 at 1:09 PM, Steffen MÃ¤rcker <merkste(a)web.de> wrote: > Hi Phil, > > Coupling this with Olek's work on the DataFrame could really come handy. >> > > I am new to this list. Could you please elaborate? > > Cheers! > Steffen > > > > On Mon, Jun 5, 2017 at 9:14 AM, Stephane Ducasse <stepharo.self(a)gmail.com> >> wrote: >> >> Hi Steffen >>> >>> >>> > The short answer is that the compact notation turned out to work much >>> better >>> > for me in my code, especially, if multiple transducers are involved. >>> But >>> > that's my personal taste. You can choose which suits you better. In >>> fact, >>> > >>> > 1000 take. >>> > >>> > just sits on top and simply calls >>> > >>> > Take number: 1000. >>> >>> To me this is much much better. >>> >>> >>> > If the need arises, we could of course factor the compact notation out >>> into >>> > a separate package. >>> Good idea >>> >>> Btw, would you prefer (Take n: 1000) over (Take number: >>> > 1000)? >>> >>> I tend to prefer explicit selector :) >>> >>> >>> > Damien, you're right, I experimented with additional styles. Right now, >>> we >>> > already have in the basic Transducer package: >>> > >>> > (collection transduce: #squared map * 1000 take. "which is equal to" >>> > (collection transduce: #squared map) transduce: 1000 take. >>> > >>> > Basically, one can split #transduce:reduce:init: into single calls of >>> > #transduce:, #reduce:, and #init:, depending on the needs. >>> > I also have an (unfinished) extension, that allows to write: >>> > >>> > (collection transduce map: #squared) take: 1000. >>> >>> To me this is much mre readable. >>> I cannot and do not want to use the other forms. >>> >>> >>> > This feels familiar, but becomes a bit hard to read if more than two >>> steps >>> > are needed. >>> > >>> > collection transduce >>> > map: #squared; >>> > take: 1000. >>> >>> Why this is would hard to read. We do that all the time everywhere. >>> >>> >>> > I think, this alternative would reads nicely. But as the message chain >>> has >>> > to modify the underlying object (an eduction), very snaky side effects >>> may >>> > occur. E.g., consider >>> > >>> > eduction := collection transduce. >>> > squared := eduction map: #squared. >>> > take := squared take: 1000. >>> > >>> > Now, all three variables hold onto the same object, which first squares >>> all >>> > elements and than takes the first 1000. >>> >>> This is because the programmer did not understand what he did. No? >>> >>> >>> >>> Stef >>> >>> PS: I played with infinite stream and iteration back in 1993 in CLOS. >>> Now I do not like to mix things because it breaks my flow of thinking. >>> >>> >>> > >>> > Best, >>> > Steffen >>> > >>> > >>> > >>> > >>> > >>> > Am .06.2017, 21:28 Uhr, schrieb Damien Pollet >>> > <damien.pollet+pharo(a)gmail.com>: >>> > >>> >> If I recall correctly, there is an alternate protocol that looks more >>> like >>> >> xtreams or the traditional select/collect iterations. >>> >> >>> >> On 2 June 2017 at 21:12, Stephane Ducasse <stepharo.self(a)gmail.com> >>> wrote: >>> >> >>> >>> I have a design question >>> >>> >>> >>> why the library is implemented in functional style vs messages? >>> >>> I do not see why this is needed. To my eyes the compact notation >>> >>> goes against readibility of code and it feels ad-hoc in Smalltalk. >>> >>> >>> >>> >>> >>> I really prefer >>> >>> >>> >>> square := Map function: #squared. >>> >>> take := Take number: 1000. >>> >>> >>> >>> Because I know that I can read it and understand it. >>> >>> From that perspective I prefer Xtreams. >>> >>> >>> >>> Stef >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> On Wed, May 31, 2017 at 2:23 PM, Steffen MÃ¤rcker <merkste(a)web.de> >>> wrote: >>> >>> >>> >>>> Hi, >>> >>>> >>> >>>> I am the developer of the library 'Transducers' for VisualWorks. It >>> was >>> >>>> formerly known as 'Reducers', but this name was a poor choice. I'd >>> like >>> >>>> to >>> >>>> port it to Pharo, if there is any interest on your side. I hope to >>> learn >>> >>>> more about Pharo in this process, since I am mainly a VW guy. And >>> most >>> >>>> likely, I will come up with a bunch of questions. :-) >>> >>>> >>> >>>> Meanwhile, I'll cross-post the introduction from VWnc below. I'd be >>> very >>> >>>> happy to hear your optinions, questions and I hope we can start a >>> >>>> fruitful >>> >>>> discussion - even if there is not Pharo port yet. >>> >>>> >>> >>>> Best, Steffen >>> >>>> >>> >>>> >>> >>>> >>> >>>> Transducers are building blocks that encapsulate how to process >>> elements >>> >>>> of a data sequence independently of the underlying input and output >>> >>>> source. >>> >>>> >>> >>>> >>> >>>> >>> >>>> # Overview >>> >>>> >>> >>>> ## Encapsulate >>> >>>> Implementations of enumeration methods, such as #collect:, have the >>> >>>> logic >>> >>>> how to process a single element in common. >>> >>>> However, that logic is reimplemented each and every time. >>> Transducers >>> >>>> make >>> >>>> it explicit and facilitate re-use and coherent behavior. >>> >>>> For example: >>> >>>> - #collect: requires mapping: (aBlock1 map) >>> >>>> - #select: requires filtering: (aBlock2 filter) >>> >>>> >>> >>>> >>> >>>> ## Compose >>> >>>> In practice, algorithms often require multiple processing steps, >>> e.g., >>> >>>> mapping only a filtered set of elements. >>> >>>> Transducers are inherently composable, and hereby, allow to make the >>> >>>> combination of steps explicit. >>> >>>> Since transducers do not build intermediate collections, their >>> >>>> composition >>> >>>> is memory-efficient. >>> >>>> For example: >>> >>>> - (aBlock1 filter) * (aBlock2 map) "(1.) filter and (2.) map >>> elements" >>> >>>> >>> >>>> >>> >>>> ## Re-Use >>> >>>> Transducers are decoupled from the input and output sources, and >>> hence, >>> >>>> they can be reused in different contexts. >>> >>>> For example: >>> >>>> - enumeration of collections >>> >>>> - processing of streams >>> >>>> - communicating via channels >>> >>>> >>> >>>> >>> >>>> >>> >>>> # Usage by Example >>> >>>> >>> >>>> We build a coin flipping experiment and count the occurrence of >>> heads >>> >>>> and >>> >>>> tails. >>> >>>> >>> >>>> First, we associate random numbers with the sides of a coin. >>> >>>> >>> >>>> scale := [:x | (x * 2 + 1) floor] map. >>> >>>> sides := #(heads tails) replace. >>> >>>> >>> >>>> Scale is a transducer that maps numbers x between 0 and 1 to 1 and >>> 2. >>> >>>> Sides is a transducer that replaces the numbers with heads an tails >>> by >>> >>>> lookup in an array. >>> >>>> Next, we choose a number of samples. >>> >>>> >>> >>>> count := 1000 take. >>> >>>> >>> >>>> Count is a transducer that takes 1000 elements from a source. >>> >>>> We keep track of the occurrences of heads an tails using a bag. >>> >>>> >>> >>>> collect := [:bag :c | bag add: c; yourself]. >>> >>>> >>> >>>> Collect is binary block (reducing function) that collects events in >>> a >>> >>>> bag. >>> >>>> We assemble the experiment by transforming the block using the >>> >>>> transducers. >>> >>>> >>> >>>> experiment := (scale * sides * count) transform: collect. >>> >>>> >>> >>>> From left to right we see the steps involved: scale, sides, count >>> and >>> >>>> collect. >>> >>>> Transforming assembles these steps into a binary block (reducing >>> >>>> function) >>> >>>> we can use to run the experiment. >>> >>>> >>> >>>> samples := Random new >>> >>>> reduce: experiment >>> >>>> init: Bag new. >>> >>>> >>> >>>> Here, we use #reduce:init:, which is mostly similar to >>> #inject:into:. >>> >>>> To execute a transformation and a reduction together, we can use >>> >>>> #transduce:reduce:init:. >>> >>>> >>> >>>> samples := Random new >>> >>>> transduce: scale * sides * count >>> >>>> reduce: collect >>> >>>> init: Bag new. >>> >>>> >>> >>>> We can also express the experiment as data-flow using #<~. >>> >>>> This enables us to build objects that can be re-used in other >>> >>>> experiments. >>> >>>> >>> >>>> coin := sides <~ scale <~ Random new. >>> >>>> flip := Bag <~ count. >>> >>>> >>> >>>> Coin is an eduction, i.e., it binds transducers to a source and >>> >>>> understands #reduce:init: among others. >>> >>>> Flip is a transformed reduction, i.e., it binds transducers to a >>> >>>> reducing >>> >>>> function and an initial value. >>> >>>> By sending #<~, we draw further samples from flipping the coin. >>> >>>> >>> >>>> samples := flip <~ coin. >>> >>>> >>> >>>> This yields a new Bag with another 1000 samples. >>> >>>> >>> >>>> >>> >>>> >>> >>>> # Basic Concepts >>> >>>> >>> >>>> ## Reducing Functions >>> >>>> >>> >>>> A reducing function represents a single step in processing a data >>> >>>> sequence. >>> >>>> It takes an accumulated result and a value, and returns a new >>> >>>> accumulated >>> >>>> result. >>> >>>> For example: >>> >>>> >>> >>>> collect := [:col :e | col add: e; yourself]. >>> >>>> sum := #+. >>> >>>> >>> >>>> A reducing function can also be ternary, i.e., it takes an >>> accumulated >>> >>>> result, a key and a value. >>> >>>> For example: >>> >>>> >>> >>>> collect := [:dic :k :v | dict at: k put: v; yourself]. >>> >>>> >>> >>>> Reducing functions may be equipped with an optional completing >>> action. >>> >>>> After finishing processing, it is invoked exactly once, e.g., to >>> free >>> >>>> resources. >>> >>>> >>> >>>> stream := [:str :e | str nextPut: each; yourself] completing: >>> >>>> #close. >>> >>>> absSum := #+ completing: #abs >>> >>>> >>> >>>> A reducing function can end processing early by signaling Reduced >>> with a >>> >>>> result. >>> >>>> This mechanism also enables the treatment of infinite sources. >>> >>>> >>> >>>> nonNil := [:res :e | e ifNil: [Reduced signalWith: res] ifFalse: >>> >>>> [res]]. >>> >>>> >>> >>>> The primary approach to process a data sequence is the reducing >>> protocol >>> >>>> with the messages #reduce:init: and #transduce:reduce:init: if >>> >>>> transducers >>> >>>> are involved. >>> >>>> The behavior is similar to #inject:into: but in addition it takes >>> care >>> >>>> of: >>> >>>> - handling binary and ternary reducing functions, >>> >>>> - invoking the completing action after finishing, and >>> >>>> - stopping the reduction if Reduced is signaled. >>> >>>> The message #transduce:reduce:init: just combines the transformation >>> and >>> >>>> the reducing step. >>> >>>> >>> >>>> However, as reducing functions are step-wise in nature, an >>> application >>> >>>> may >>> >>>> choose other means to process its data. >>> >>>> >>> >>>> >>> >>>> ## Reducibles >>> >>>> >>> >>>> A data source is called reducible if it implements the reducing >>> >>>> protocol. >>> >>>> Default implementations are provided for collections and streams. >>> >>>> Additionally, blocks without an argument are reducible, too. >>> >>>> This allows to adapt to custom data sources without additional >>> effort. >>> >>>> For example: >>> >>>> >>> >>>> "XStreams adaptor" >>> >>>> xstream := filename reading. >>> >>>> reducible := [[xstream get] on: Incomplete do: [Reduced >>> signal]]. >>> >>>> >>> >>>> "natural numbers" >>> >>>> n := 0. >>> >>>> reducible := [n := n+1]. >>> >>>> >>> >>>> >>> >>>> ## Transducers >>> >>>> >>> >>>> A transducer is an object that transforms a reducing function into >>> >>>> another. >>> >>>> Transducers encapsulate common steps in processing data sequences, >>> such >>> >>>> as >>> >>>> map, filter, concatenate, and flatten. >>> >>>> A transducer transforms a reducing function into another via >>> #transform: >>> >>>> in order to add those steps. >>> >>>> They can be composed using #* which yields a new transducer that >>> does >>> >>>> both >>> >>>> transformations. >>> >>>> Most transducers require an argument, typically blocks, symbols or >>> >>>> numbers: >>> >>>> >>> >>>> square := Map function: #squared. >>> >>>> take := Take number: 1000. >>> >>>> >>> >>>> To facilitate compact notation, the argument types implement >>> >>>> corresponding >>> >>>> methods: >>> >>>> >>> >>>> squareAndTake := #squared map * 1000 take. >>> >>>> >>> >>>> Transducers requiring no argument are singletons and can be accessed >>> by >>> >>>> their class name. >>> >>>> >>> >>>> flattenAndDedupe := Flatten * Dedupe. >>> >>>> >>> >>>> >>> >>>> >>> >>>> # Advanced Concepts >>> >>>> >>> >>>> ## Data flows >>> >>>> >>> >>>> Processing a sequence of data can often be regarded as a data flow. >>> >>>> The operator #<~ allows define a flow from a data source through >>> >>>> processing steps to a drain. >>> >>>> For example: >>> >>>> >>> >>>> squares := Set <~ 1000 take <~ #squared map <~ (1 to: 1000). >>> >>>> fileOut writeStream <~ #isSeparator filter <~ fileIn readStream. >>> >>>> >>> >>>> In both examples #<~ is only used to set up the data flow using >>> reducing >>> >>>> functions and transducers. >>> >>>> In contrast to streams, transducers are completely independent from >>> >>>> input >>> >>>> and output sources. >>> >>>> Hence, we have a clear separation of reading data, writing data and >>> >>>> processing elements. >>> >>>> - Sources know how to iterate over data with a reducing function, >>> e.g., >>> >>>> via #reduce:init:. >>> >>>> - Drains know how to collect data using a reducing function. >>> >>>> - Transducers know how to process single elements. >>> >>>> >>> >>>> >>> >>>> ## Reductions >>> >>>> >>> >>>> A reduction binds an initial value or a block yielding an initial >>> value >>> >>>> to >>> >>>> a reducing function. >>> >>>> The idea is to define a ready-to-use process that can be applied in >>> >>>> different contexts. >>> >>>> Reducibles handle reductions via #reduce: and #transduce:reduce: >>> >>>> For example: >>> >>>> >>> >>>> sum := #+ init: 0. >>> >>>> sum1 := #(1 1 1) reduce: sum. >>> >>>> sum2 := (1 to: 1000) transduce: #odd filter reduce: sum. >>> >>>> >>> >>>> asSet := [:set :e | set add: e; yourself] initializer: [Set >>> new]. >>> >>>> set1 := #(1 1 1) reduce: asSet. >>> >>>> set2 := #(1 to: 1000) transduce: #odd filter reduce: asSet. >>> >>>> >>> >>>> By combining a transducer with a reduction, a process can be further >>> >>>> modified. >>> >>>> >>> >>>> sumOdds := sum <~ #odd filter >>> >>>> setOdds := asSet <~ #odd filter >>> >>>> >>> >>>> >>> >>>> ## Eductions >>> >>>> >>> >>>> An eduction combines a reducible data sources with a transducer. >>> >>>> The idea is to define a transformed (virtual) data source that needs >>> not >>> >>>> to be stored in memory. >>> >>>> >>> >>>> odds1 := #odd filter <~ #(1 2 3) readStream. >>> >>>> odds2 := #odd filter <~ (1 to 1000). >>> >>>> >>> >>>> Depending on the underlying source, eductions can be processed once >>> >>>> (streams, e.g., odds1) or multiple times (collections, e.g., odds2). >>> >>>> Since no intermediate data is stored, transducers actions are lazy, >>> >>>> i.e., >>> >>>> they are invoked each time the eduction is processed. >>> >>>> >>> >>>> >>> >>>> >>> >>>> # Origins >>> >>>> >>> >>>> Transducers is based on the same-named Clojure library and its >>> ideas. >>> >>>> Please see: >>> >>>> http://clojure.org/transducers >>> >>>> >>> >>>> >>> > >>> >>> >>> > >

June 6, 2017

Re: [Pharo-users] Porting Transducers to Pharo

by phil＠highoctane.be

Hi Steffen, I am willing to help you create the package in SmalltalkHub or Github based on your files/changeset. Do you have a github and/or SmalltalkHub account? Best, Phil On Tue, Jun 6, 2017 at 1:08 PM, Steffen MÃ¤rcker <merkste(a)web.de> wrote: > Hi! > > If the need arises, we could of course factor the compact notation out into >>> a separate package. >>> >> Good idea >> [...] I do not want to help promoting a syntax that alienates me (and >> others because other people reported the saem to me). >> > > I understand. Btw, I'd really, really appreciate if others post their > thoughts and feedback here as well. Discussion helps moving things forward. > =) > > > (collection transduce map: #squared) take: 1000. >>> >> >> To me this is much more readable. >> > > Well, I'll provide that extension once it is finished. > > I cannot and do not want to use the other forms. >> > > > collection transduce >>> map: #squared; >>> take: 1000. >>> >>> But as the message chain has to modify the underlying object >>> (an eduction), very snaky side effects my occur. E.g., consider >>> >>> eduction := collection transduce. >>> squared := eduction map: #squared. >>> take := squared take: 1000. >>> >>> Now, all three variables hold onto the same object, which first squares >>> all elements and than takes the first 1000. >>> >> >> This is because the programmer did not understand what he did. No? >> > > Sure. ;-) Nevertheless, it would be very hard to debug. All of which are > the reasons I wouldn't implement that variant. ;-) > > > PS: I played with infinite stream and iteration back in 1993 in CLOS. >> Now I do not like to mix things because it breaks my flow of thinking. >> > > > I am not sure whether I understand what your mean by mixing. Concerning > transducers, the ability to handle infinite sources in only a (natural) > side-effect of the ability to finish reductions before all elements are > processed, e.g., like #detect: and such. > > Best, Steffen > > > > > >

June 6, 2017

Re: [Pharo-users] Creating a BaselineOf from a ConfigurationOf>>#baselineXyz:

by Nicolai Hess

Hi Sean, 2017-06-04 5:48 GMT+02:00 Sean P. DeNigris <sean(a)clipperadams.com>: > I'm trying to write a rewrite rule, but can't quite get it. > > I first want to remove `spec blessing: #baseline.` > > I tried the following with no effect: > > RBParseTreeRewriter new > replace: '`@expr blessing: `#lit' > with: ''; > executeTree: methodTree; > tree. > This works for me, but ... > > NB: If I try to edit the expression instead of remove, by passing something > like '`@expr assert: `#lit' for #with:, it works > > What am I missing here? > > Thanks! > > keep in mind some odds about the caching on ast nodes. Working with the tree rewriter directly on the method ast (MyClass>>#myMethod) ast - will modify the "cached" method ast, that means, on code browser, you do not see the change. - the #source method of the ast, again only shows a cached source (MyClass>>#myMethod) ast source -> "old source" - printing the formatted code will finally step into the (modified) method source nodes (MyClass>>#myMethod) ast formattedCode -> "new source code" > > > ----- > Cheers, > Sean > -- > View this message in context: http://forum.world.st/ > Creating-a-BaselineOf-from-a-ConfigurationOf-baselineXyz-tp4949192.html > Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. > >

June 6, 2017

Re: [Pharo-users] Analyzing Fuel Problem

by Mariano Martinez Peck

Hi Sean, Sorry for the delay on the answer. Yes, that's a good spot. Another thing I usually do is to put a halt in FLSerialization >> run. Just after #analysisStep for example, and then inspect the local variables. Also, if you want to understand WHY an object is getting in, then you can also halt in #trace and #privateTrace: from FLAnalysis. That way you monitor which objects gets pushed into the analysis stack. You can do something like self haltIf: [ anObject whateverConditionToHaltOnDesiredObject = true ]. Finally, there are more tools for debugging this kind of issue, but I don't know their state. You can read more about them here [1]. Best regards, [1] https://rmod.inria.fr/web/software/Fuel/Version1.9/Documentation/Debugging On Fri, Jun 2, 2017 at 10:26 PM, Sean P. DeNigris <sean(a)clipperadams.com> wrote: > I had an object graph that was pulling in all sorts of unrelated classes > when > serialized with Fuel. I was trying to find the offending object, and came > up > with the following: > ``` > (FLAnalyzer newDefault analysisFor: root) clusterization globalsBucket > ``` > > This worked, but I was wondering if that's "the right way" to do it... > > Thanks. > > > > ----- > Cheers, > Sean > -- > View this message in context: http://forum.world.st/ > Analyzing-Fuel-Problem-tp4949104.html > Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. > > -- Mariano http://marianopeck.wordpress.com

June 6, 2017

Re: [Pharo-users] Porting Transducers to Pharo - Name Clash

by Steffen MÃ¤rcker

Hi, I found some name clash with the message #reduce: in Pharo. It is already declared in SequencableCollection. Additionally, Collection>>fold: just calls #reduce:, which makes the difference between folding and reducing a bit unclear. How should I handle this situation? I see the following options: - I could simply solve the situation at runtime depending on the argument (e.g., using double-dispatching). - I could check whether it might be possible to separate #fold: and #reduce: with the semantics: - reduce: starts with an initial value and the first collection item. - fold: uses no initial value and starts with the first two items. In the Transducers library, there are two variants of reduce: - #reduce:init: reduce using a block and an intial value - #reduce: reduce using a block that carries an intial value or an initializer block. Ciao, Steffen Am .05.2017, 14:23 Uhr, schrieb Steffen MÃ¤rcker <merkste(a)web.de>: > Hi, > > I am the developer of the library 'Transducers' for VisualWorks. It was > formerly known as 'Reducers', but this name was a poor choice. I'd like > to port it to Pharo, if there is any interest on your side. I hope to > learn more about Pharo in this process, since I am mainly a VW guy. And > most likely, I will come up with a bunch of questions. :-) > > Meanwhile, I'll cross-post the introduction from VWnc below. I'd be very > happy to hear your optinions, questions and I hope we can start a > fruitful discussion - even if there is not Pharo port yet. > > Best, Steffen > > > > Transducers are building blocks that encapsulate how to process elements > of a data sequence independently of the underlying input and output > source. > > > > # Overview > > ## Encapsulate > Implementations of enumeration methods, such as #collect:, have the logic > how to process a single element in common. > However, that logic is reimplemented each and every time. Transducers > make > it explicit and facilitate re-use and coherent behavior. > For example: > - #collect: requires mapping: (aBlock1 map) > - #select: requires filtering: (aBlock2 filter) > > > ## Compose > In practice, algorithms often require multiple processing steps, e.g., > mapping only a filtered set of elements. > Transducers are inherently composable, and hereby, allow to make the > combination of steps explicit. > Since transducers do not build intermediate collections, their > composition > is memory-efficient. > For example: > - (aBlock1 filter) * (aBlock2 map) "(1.) filter and (2.) map elements" > > > ## Re-Use > Transducers are decoupled from the input and output sources, and hence, > they can be reused in different contexts. > For example: > - enumeration of collections > - processing of streams > - communicating via channels > > > > # Usage by Example > > We build a coin flipping experiment and count the occurrence of heads and > tails. > > First, we associate random numbers with the sides of a coin. > > scale := [:x | (x * 2 + 1) floor] map. > sides := #(heads tails) replace. > > Scale is a transducer that maps numbers x between 0 and 1 to 1 and 2. > Sides is a transducer that replaces the numbers with heads an tails by > lookup in an array. > Next, we choose a number of samples. > > count := 1000 take. > > Count is a transducer that takes 1000 elements from a source. > We keep track of the occurrences of heads an tails using a bag. > > collect := [:bag :c | bag add: c; yourself]. > > Collect is binary block (reducing function) that collects events in a > bag. > We assemble the experiment by transforming the block using the > transducers. > > experiment := (scale * sides * count) transform: collect. > > From left to right we see the steps involved: scale, sides, count and > collect. > Transforming assembles these steps into a binary block (reducing > function) > we can use to run the experiment. > > samples := Random new > reduce: experiment > init: Bag new. > > Here, we use #reduce:init:, which is mostly similar to #inject:into:. > To execute a transformation and a reduction together, we can use > #transduce:reduce:init:. > > samples := Random new > transduce: scale * sides * count > reduce: collect > init: Bag new. > > We can also express the experiment as data-flow using #<~. > This enables us to build objects that can be re-used in other > experiments. > > coin := sides <~ scale <~ Random new. > flip := Bag <~ count. > > Coin is an eduction, i.e., it binds transducers to a source and > understands #reduce:init: among others. > Flip is a transformed reduction, i.e., it binds transducers to a reducing > function and an initial value. > By sending #<~, we draw further samples from flipping the coin. > > samples := flip <~ coin. > > This yields a new Bag with another 1000 samples. > > > > # Basic Concepts > > ## Reducing Functions > > A reducing function represents a single step in processing a data > sequence. > It takes an accumulated result and a value, and returns a new accumulated > result. > For example: > > collect := [:col :e | col add: e; yourself]. > sum := #+. > > A reducing function can also be ternary, i.e., it takes an accumulated > result, a key and a value. > For example: > > collect := [:dic :k :v | dict at: k put: v; yourself]. > > Reducing functions may be equipped with an optional completing action. > After finishing processing, it is invoked exactly once, e.g., to free > resources. > > stream := [:str :e | str nextPut: each; yourself] completing: > #close. > absSum := #+ completing: #abs > > A reducing function can end processing early by signaling Reduced with a > result. > This mechanism also enables the treatment of infinite sources. > > nonNil := [:res :e | e ifNil: [Reduced signalWith: res] ifFalse: > [res]]. > > The primary approach to process a data sequence is the reducing protocol > with the messages #reduce:init: and #transduce:reduce:init: if > transducers > are involved. > The behavior is similar to #inject:into: but in addition it takes care > of: > - handling binary and ternary reducing functions, > - invoking the completing action after finishing, and > - stopping the reduction if Reduced is signaled. > The message #transduce:reduce:init: just combines the transformation and > the reducing step. > > However, as reducing functions are step-wise in nature, an application > may > choose other means to process its data. > > > ## Reducibles > > A data source is called reducible if it implements the reducing protocol. > Default implementations are provided for collections and streams. > Additionally, blocks without an argument are reducible, too. > This allows to adapt to custom data sources without additional effort. > For example: > > "XStreams adaptor" > xstream := filename reading. > reducible := [[xstream get] on: Incomplete do: [Reduced signal]]. > > "natural numbers" > n := 0. > reducible := [n := n+1]. > > > ## Transducers > > A transducer is an object that transforms a reducing function into > another. > Transducers encapsulate common steps in processing data sequences, such > as > map, filter, concatenate, and flatten. > A transducer transforms a reducing function into another via #transform: > in order to add those steps. > They can be composed using #* which yields a new transducer that does > both > transformations. > Most transducers require an argument, typically blocks, symbols or > numbers: > > square := Map function: #squared. > take := Take number: 1000. > > To facilitate compact notation, the argument types implement > corresponding > methods: > > squareAndTake := #squared map * 1000 take. > > Transducers requiring no argument are singletons and can be accessed by > their class name. > > flattenAndDedupe := Flatten * Dedupe. > > > > # Advanced Concepts > > ## Data flows > > Processing a sequence of data can often be regarded as a data flow. > The operator #<~ allows define a flow from a data source through > processing steps to a drain. > For example: > > squares := Set <~ 1000 take <~ #squared map <~ (1 to: 1000). > fileOut writeStream <~ #isSeparator filter <~ fileIn readStream. > > In both examples #<~ is only used to set up the data flow using reducing > functions and transducers. > In contrast to streams, transducers are completely independent from input > and output sources. > Hence, we have a clear separation of reading data, writing data and > processing elements. > - Sources know how to iterate over data with a reducing function, e.g., > via #reduce:init:. > - Drains know how to collect data using a reducing function. > - Transducers know how to process single elements. > > > ## Reductions > > A reduction binds an initial value or a block yielding an initial value > to > a reducing function. > The idea is to define a ready-to-use process that can be applied in > different contexts. > Reducibles handle reductions via #reduce: and #transduce:reduce: > For example: > > sum := #+ init: 0. > sum1 := #(1 1 1) reduce: sum. > sum2 := (1 to: 1000) transduce: #odd filter reduce: sum. > > asSet := [:set :e | set add: e; yourself] initializer: [Set new]. > set1 := #(1 1 1) reduce: asSet. > set2 := #(1 to: 1000) transduce: #odd filter reduce: asSet. > > By combining a transducer with a reduction, a process can be further > modified. > > sumOdds := sum <~ #odd filter > setOdds := asSet <~ #odd filter > > > ## Eductions > > An eduction combines a reducible data sources with a transducer. > The idea is to define a transformed (virtual) data source that needs not > to be stored in memory. > > odds1 := #odd filter <~ #(1 2 3) readStream. > odds2 := #odd filter <~ (1 to 1000). > > Depending on the underlying source, eductions can be processed once > (streams, e.g., odds1) or multiple times (collections, e.g., odds2). > Since no intermediate data is stored, transducers actions are lazy, i.e., > they are invoked each time the eduction is processed. > > > > # Origins > > Transducers is based on the same-named Clojure library and its ideas. > Please see: > http://clojure.org/transducers

June 6, 2017

Re: [Pharo-users] Porting Transducers to Pharo

by Steffen MÃ¤rcker

Hi Phil, > Coupling this with Olek's work on the DataFrame could really come handy. I am new to this list. Could you please elaborate? Cheers! Steffen > On Mon, Jun 5, 2017 at 9:14 AM, Stephane Ducasse > <stepharo.self(a)gmail.com> > wrote: > >> Hi Steffen >> >> >> > The short answer is that the compact notation turned out to work much >> better >> > for me in my code, especially, if multiple transducers are involved. >> But >> > that's my personal taste. You can choose which suits you better. In >> fact, >> > >> > 1000 take. >> > >> > just sits on top and simply calls >> > >> > Take number: 1000. >> >> To me this is much much better. >> >> >> > If the need arises, we could of course factor the compact notation out >> into >> > a separate package. >> Good idea >> >> Btw, would you prefer (Take n: 1000) over (Take number: >> > 1000)? >> >> I tend to prefer explicit selector :) >> >> >> > Damien, you're right, I experimented with additional styles. Right >> now, >> we >> > already have in the basic Transducer package: >> > >> > (collection transduce: #squared map * 1000 take. "which is equal to" >> > (collection transduce: #squared map) transduce: 1000 take. >> > >> > Basically, one can split #transduce:reduce:init: into single calls of >> > #transduce:, #reduce:, and #init:, depending on the needs. >> > I also have an (unfinished) extension, that allows to write: >> > >> > (collection transduce map: #squared) take: 1000. >> >> To me this is much mre readable. >> I cannot and do not want to use the other forms. >> >> >> > This feels familiar, but becomes a bit hard to read if more than two >> steps >> > are needed. >> > >> > collection transduce >> > map: #squared; >> > take: 1000. >> >> Why this is would hard to read. We do that all the time everywhere. >> >> >> > I think, this alternative would reads nicely. But as the message chain >> has >> > to modify the underlying object (an eduction), very snaky side effects >> may >> > occur. E.g., consider >> > >> > eduction := collection transduce. >> > squared := eduction map: #squared. >> > take := squared take: 1000. >> > >> > Now, all three variables hold onto the same object, which first >> squares >> all >> > elements and than takes the first 1000. >> >> This is because the programmer did not understand what he did. No? >> >> >> >> Stef >> >> PS: I played with infinite stream and iteration back in 1993 in CLOS. >> Now I do not like to mix things because it breaks my flow of thinking. >> >> >> > >> > Best, >> > Steffen >> > >> > >> > >> > >> > >> > Am .06.2017, 21:28 Uhr, schrieb Damien Pollet >> > <damien.pollet+pharo(a)gmail.com>: >> > >> >> If I recall correctly, there is an alternate protocol that looks more >> like >> >> xtreams or the traditional select/collect iterations. >> >> >> >> On 2 June 2017 at 21:12, Stephane Ducasse <stepharo.self(a)gmail.com> >> wrote: >> >> >> >>> I have a design question >> >>> >> >>> why the library is implemented in functional style vs messages? >> >>> I do not see why this is needed. To my eyes the compact notation >> >>> goes against readibility of code and it feels ad-hoc in Smalltalk. >> >>> >> >>> >> >>> I really prefer >> >>> >> >>> square := Map function: #squared. >> >>> take := Take number: 1000. >> >>> >> >>> Because I know that I can read it and understand it. >> >>> From that perspective I prefer Xtreams. >> >>> >> >>> Stef >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> On Wed, May 31, 2017 at 2:23 PM, Steffen MÃ¤rcker <merkste(a)web.de> >> wrote: >> >>> >> >>>> Hi, >> >>>> >> >>>> I am the developer of the library 'Transducers' for VisualWorks. It >> was >> >>>> formerly known as 'Reducers', but this name was a poor choice. I'd >> like >> >>>> to >> >>>> port it to Pharo, if there is any interest on your side. I hope to >> learn >> >>>> more about Pharo in this process, since I am mainly a VW guy. And >> most >> >>>> likely, I will come up with a bunch of questions. :-) >> >>>> >> >>>> Meanwhile, I'll cross-post the introduction from VWnc below. I'd be >> very >> >>>> happy to hear your optinions, questions and I hope we can start a >> >>>> fruitful >> >>>> discussion - even if there is not Pharo port yet. >> >>>> >> >>>> Best, Steffen >> >>>> >> >>>> >> >>>> >> >>>> Transducers are building blocks that encapsulate how to process >> elements >> >>>> of a data sequence independently of the underlying input and output >> >>>> source. >> >>>> >> >>>> >> >>>> >> >>>> # Overview >> >>>> >> >>>> ## Encapsulate >> >>>> Implementations of enumeration methods, such as #collect:, have the >> >>>> logic >> >>>> how to process a single element in common. >> >>>> However, that logic is reimplemented each and every time. >> Transducers >> >>>> make >> >>>> it explicit and facilitate re-use and coherent behavior. >> >>>> For example: >> >>>> - #collect: requires mapping: (aBlock1 map) >> >>>> - #select: requires filtering: (aBlock2 filter) >> >>>> >> >>>> >> >>>> ## Compose >> >>>> In practice, algorithms often require multiple processing steps, >> e.g., >> >>>> mapping only a filtered set of elements. >> >>>> Transducers are inherently composable, and hereby, allow to make >> the >> >>>> combination of steps explicit. >> >>>> Since transducers do not build intermediate collections, their >> >>>> composition >> >>>> is memory-efficient. >> >>>> For example: >> >>>> - (aBlock1 filter) * (aBlock2 map) "(1.) filter and (2.) map >> elements" >> >>>> >> >>>> >> >>>> ## Re-Use >> >>>> Transducers are decoupled from the input and output sources, and >> hence, >> >>>> they can be reused in different contexts. >> >>>> For example: >> >>>> - enumeration of collections >> >>>> - processing of streams >> >>>> - communicating via channels >> >>>> >> >>>> >> >>>> >> >>>> # Usage by Example >> >>>> >> >>>> We build a coin flipping experiment and count the occurrence of >> heads >> >>>> and >> >>>> tails. >> >>>> >> >>>> First, we associate random numbers with the sides of a coin. >> >>>> >> >>>> scale := [:x | (x * 2 + 1) floor] map. >> >>>> sides := #(heads tails) replace. >> >>>> >> >>>> Scale is a transducer that maps numbers x between 0 and 1 to 1 and >> 2. >> >>>> Sides is a transducer that replaces the numbers with heads an >> tails by >> >>>> lookup in an array. >> >>>> Next, we choose a number of samples. >> >>>> >> >>>> count := 1000 take. >> >>>> >> >>>> Count is a transducer that takes 1000 elements from a source. >> >>>> We keep track of the occurrences of heads an tails using a bag. >> >>>> >> >>>> collect := [:bag :c | bag add: c; yourself]. >> >>>> >> >>>> Collect is binary block (reducing function) that collects events >> in a >> >>>> bag. >> >>>> We assemble the experiment by transforming the block using the >> >>>> transducers. >> >>>> >> >>>> experiment := (scale * sides * count) transform: collect. >> >>>> >> >>>> From left to right we see the steps involved: scale, sides, count >> and >> >>>> collect. >> >>>> Transforming assembles these steps into a binary block (reducing >> >>>> function) >> >>>> we can use to run the experiment. >> >>>> >> >>>> samples := Random new >> >>>> reduce: experiment >> >>>> init: Bag new. >> >>>> >> >>>> Here, we use #reduce:init:, which is mostly similar to >> #inject:into:. >> >>>> To execute a transformation and a reduction together, we can use >> >>>> #transduce:reduce:init:. >> >>>> >> >>>> samples := Random new >> >>>> transduce: scale * sides * count >> >>>> reduce: collect >> >>>> init: Bag new. >> >>>> >> >>>> We can also express the experiment as data-flow using #<~. >> >>>> This enables us to build objects that can be re-used in other >> >>>> experiments. >> >>>> >> >>>> coin := sides <~ scale <~ Random new. >> >>>> flip := Bag <~ count. >> >>>> >> >>>> Coin is an eduction, i.e., it binds transducers to a source and >> >>>> understands #reduce:init: among others. >> >>>> Flip is a transformed reduction, i.e., it binds transducers to a >> >>>> reducing >> >>>> function and an initial value. >> >>>> By sending #<~, we draw further samples from flipping the coin. >> >>>> >> >>>> samples := flip <~ coin. >> >>>> >> >>>> This yields a new Bag with another 1000 samples. >> >>>> >> >>>> >> >>>> >> >>>> # Basic Concepts >> >>>> >> >>>> ## Reducing Functions >> >>>> >> >>>> A reducing function represents a single step in processing a data >> >>>> sequence. >> >>>> It takes an accumulated result and a value, and returns a new >> >>>> accumulated >> >>>> result. >> >>>> For example: >> >>>> >> >>>> collect := [:col :e | col add: e; yourself]. >> >>>> sum := #+. >> >>>> >> >>>> A reducing function can also be ternary, i.e., it takes an >> accumulated >> >>>> result, a key and a value. >> >>>> For example: >> >>>> >> >>>> collect := [:dic :k :v | dict at: k put: v; yourself]. >> >>>> >> >>>> Reducing functions may be equipped with an optional completing >> action. >> >>>> After finishing processing, it is invoked exactly once, e.g., to >> free >> >>>> resources. >> >>>> >> >>>> stream := [:str :e | str nextPut: each; yourself] completing: >> >>>> #close. >> >>>> absSum := #+ completing: #abs >> >>>> >> >>>> A reducing function can end processing early by signaling Reduced >> with a >> >>>> result. >> >>>> This mechanism also enables the treatment of infinite sources. >> >>>> >> >>>> nonNil := [:res :e | e ifNil: [Reduced signalWith: res] >> ifFalse: >> >>>> [res]]. >> >>>> >> >>>> The primary approach to process a data sequence is the reducing >> protocol >> >>>> with the messages #reduce:init: and #transduce:reduce:init: if >> >>>> transducers >> >>>> are involved. >> >>>> The behavior is similar to #inject:into: but in addition it takes >> care >> >>>> of: >> >>>> - handling binary and ternary reducing functions, >> >>>> - invoking the completing action after finishing, and >> >>>> - stopping the reduction if Reduced is signaled. >> >>>> The message #transduce:reduce:init: just combines the >> transformation >> and >> >>>> the reducing step. >> >>>> >> >>>> However, as reducing functions are step-wise in nature, an >> application >> >>>> may >> >>>> choose other means to process its data. >> >>>> >> >>>> >> >>>> ## Reducibles >> >>>> >> >>>> A data source is called reducible if it implements the reducing >> >>>> protocol. >> >>>> Default implementations are provided for collections and streams. >> >>>> Additionally, blocks without an argument are reducible, too. >> >>>> This allows to adapt to custom data sources without additional >> effort. >> >>>> For example: >> >>>> >> >>>> "XStreams adaptor" >> >>>> xstream := filename reading. >> >>>> reducible := [[xstream get] on: Incomplete do: [Reduced >> signal]]. >> >>>> >> >>>> "natural numbers" >> >>>> n := 0. >> >>>> reducible := [n := n+1]. >> >>>> >> >>>> >> >>>> ## Transducers >> >>>> >> >>>> A transducer is an object that transforms a reducing function into >> >>>> another. >> >>>> Transducers encapsulate common steps in processing data sequences, >> such >> >>>> as >> >>>> map, filter, concatenate, and flatten. >> >>>> A transducer transforms a reducing function into another via >> #transform: >> >>>> in order to add those steps. >> >>>> They can be composed using #* which yields a new transducer that >> does >> >>>> both >> >>>> transformations. >> >>>> Most transducers require an argument, typically blocks, symbols or >> >>>> numbers: >> >>>> >> >>>> square := Map function: #squared. >> >>>> take := Take number: 1000. >> >>>> >> >>>> To facilitate compact notation, the argument types implement >> >>>> corresponding >> >>>> methods: >> >>>> >> >>>> squareAndTake := #squared map * 1000 take. >> >>>> >> >>>> Transducers requiring no argument are singletons and can be >> accessed >> by >> >>>> their class name. >> >>>> >> >>>> flattenAndDedupe := Flatten * Dedupe. >> >>>> >> >>>> >> >>>> >> >>>> # Advanced Concepts >> >>>> >> >>>> ## Data flows >> >>>> >> >>>> Processing a sequence of data can often be regarded as a data flow. >> >>>> The operator #<~ allows define a flow from a data source through >> >>>> processing steps to a drain. >> >>>> For example: >> >>>> >> >>>> squares := Set <~ 1000 take <~ #squared map <~ (1 to: 1000). >> >>>> fileOut writeStream <~ #isSeparator filter <~ fileIn >> readStream. >> >>>> >> >>>> In both examples #<~ is only used to set up the data flow using >> reducing >> >>>> functions and transducers. >> >>>> In contrast to streams, transducers are completely independent from >> >>>> input >> >>>> and output sources. >> >>>> Hence, we have a clear separation of reading data, writing data and >> >>>> processing elements. >> >>>> - Sources know how to iterate over data with a reducing function, >> e.g., >> >>>> via #reduce:init:. >> >>>> - Drains know how to collect data using a reducing function. >> >>>> - Transducers know how to process single elements. >> >>>> >> >>>> >> >>>> ## Reductions >> >>>> >> >>>> A reduction binds an initial value or a block yielding an initial >> value >> >>>> to >> >>>> a reducing function. >> >>>> The idea is to define a ready-to-use process that can be applied in >> >>>> different contexts. >> >>>> Reducibles handle reductions via #reduce: and #transduce:reduce: >> >>>> For example: >> >>>> >> >>>> sum := #+ init: 0. >> >>>> sum1 := #(1 1 1) reduce: sum. >> >>>> sum2 := (1 to: 1000) transduce: #odd filter reduce: sum. >> >>>> >> >>>> asSet := [:set :e | set add: e; yourself] initializer: [Set >> new]. >> >>>> set1 := #(1 1 1) reduce: asSet. >> >>>> set2 := #(1 to: 1000) transduce: #odd filter reduce: asSet. >> >>>> >> >>>> By combining a transducer with a reduction, a process can be >> further >> >>>> modified. >> >>>> >> >>>> sumOdds := sum <~ #odd filter >> >>>> setOdds := asSet <~ #odd filter >> >>>> >> >>>> >> >>>> ## Eductions >> >>>> >> >>>> An eduction combines a reducible data sources with a transducer. >> >>>> The idea is to define a transformed (virtual) data source that >> needs >> not >> >>>> to be stored in memory. >> >>>> >> >>>> odds1 := #odd filter <~ #(1 2 3) readStream. >> >>>> odds2 := #odd filter <~ (1 to 1000). >> >>>> >> >>>> Depending on the underlying source, eductions can be processed once >> >>>> (streams, e.g., odds1) or multiple times (collections, e.g., >> odds2). >> >>>> Since no intermediate data is stored, transducers actions are lazy, >> >>>> i.e., >> >>>> they are invoked each time the eduction is processed. >> >>>> >> >>>> >> >>>> >> >>>> # Origins >> >>>> >> >>>> Transducers is based on the same-named Clojure library and its >> ideas. >> >>>> Please see: >> >>>> http://clojure.org/transducers >> >>>> >> >>>> >> > >> >>

June 6, 2017

Re: [Pharo-users] Porting Transducers to Pharo

by Steffen MÃ¤rcker

Hi! >> If the need arises, we could of course factor the compact notation out >> into >> a separate package. >Good idea >[...] I do not want to help promoting a syntax that alienates me (and > others because other people reported the saem to me). I understand. Btw, I'd really, really appreciate if others post their thoughts and feedback here as well. Discussion helps moving things forward. =) >> (collection transduce map: #squared) take: 1000. > > To me this is much more readable. Well, I'll provide that extension once it is finished. > I cannot and do not want to use the other forms. >> collection transduce >> map: #squared; >> take: 1000. >> >> But as the message chain has to modify the underlying object >> (an eduction), very snaky side effects my occur. E.g., consider >> >> eduction := collection transduce. >> squared := eduction map: #squared. >> take := squared take: 1000. >> >> Now, all three variables hold onto the same object, which first squares >> all elements and than takes the first 1000. > > This is because the programmer did not understand what he did. No? Sure. ;-) Nevertheless, it would be very hard to debug. All of which are the reasons I wouldn't implement that variant. ;-) > PS: I played with infinite stream and iteration back in 1993 in CLOS. > Now I do not like to mix things because it breaks my flow of thinking. I am not sure whether I understand what your mean by mixing. Concerning transducers, the ability to handle infinite sources in only a (natural) side-effect of the ability to finish reductions before all elements are processed, e.g., like #detect: and such. Best, Steffen

June 6, 2017

Re: [Pharo-users] Porting Transducers to Pharo

by Steffen MÃ¤rcker

I assumed so. I used file-outs only to get something working quickly. =) Properly published code will follow as soon as I am more familiar with code management in Pharo. Am .06.2017, 09:05 Uhr, schrieb Stephane Ducasse <stepharo.self(a)gmail.com>: > We do not work with fileouts :) > You should produce packages with also a configuration and published them > on > smalltalkhub or git and > in the MetaRepository. > You can also add package comments > > On Sat, Jun 3, 2017 at 10:29 PM, Steffen MÃ¤rcker <merkste(a)web.de> wrote: > >> Dear all, >> >> attached are updated file-outs. I fixed a couple of annoyances that >> slipped through yesterday evening. Most notable: >> >> 1) Random generator now works. >> 2) Early termination via Reduced exception does MNU anymore. >> 3) Printing a transducer holding a block does not MNU anymore. >> >> Please, give it a spin and tell me your impressions. (At least) The >> coin-flipping the example from the package comment works now: >> >> scale := [:x | (x * 2 + 1) floor] map. >> sides := #(heads tails) replace. >> count := 1000 take. >> collect := [:bag :c | bag add: c; yourself]. >> experiment := (scale * sides * count) transform: collect. >> "experiment cannot be re-used" >> samples := Random new >> reduce: experiment >> init: Bag new. >> "transform and reduce in one step" >> samples := Random new >> transduce: scale * sides * count >> reduce: collect >> init: Bag new. >> "assemble coin (eduction) and flip (reduction) objects" >> coin := sides <~ scale <~ Random new. >> flip := Bag <~ count. >> "flip coin =)" >> samples := flip <~ coin. >> >> Cheers! >> Steffen >> >> >> >> Am .06.2017, 23:08 Uhr, schrieb Steffen MÃ¤rcker <merkste(a)web.de>: >> >> Thanks, this appears to work. Attached you'll find the file-out from >>> VisualWorks and the file-out from Pharo (includes package comment). >>> >>> Cheers! >>> Steffen >>> >>> >>> Am .06.2017, 20:06 Uhr, schrieb Yanni Chiu <yanni.code(a)gmail.com>: >>> >>> To get the extension methods into the Transducers package, the >>> following >>>> worked for me - edit the category to have the prefix '*Transducers-' >>>> >>>> 2710c2710 >>>> >>>> < !Number methodsFor: 'transforming' stamp: ' 2/6/17 15:38'! >>>> >>>> --- >>>> >>>> !Number methodsFor: '*Transducers-transforming' stamp: ' 2/6/17 >>>> 15:38'! >>>>> >>>> >>>> >>>> On Fri, Jun 2, 2017 at 11:05 AM, Steffen MÃ¤rcker <merkste(a)web.de> >>>> wrote: >>>> >>>> Dear all, >>>>> >>>>> thanks for the many suggestions. I didn't had time to test all >>>>> import/export ways yet. But for now, I can report on two: >>>>> >>>>> 1) NGFileOuter >>>>> Unfortunately It raised several MNUs in my image. I'll investigate >>>>> them >>>>> later. >>>>> >>>>> 2) FileOut30 (VW Contributed) >>>>> I was able to file out the code except for the package definition. >>>>> Replacing {category: ''} in the class definitions with {package: >>>>> 'Transducers'} fixed that. However, methods that extend existing >>>>> classes >>>>> did not end up in the Transducers package. Is there a similar easy >>>>> change >>>>> to the file-out making that happen? Also I'd like to add the package >>>>> comment if that's possible. >>>>> >>>>> Most things appear to work as far as I can see. Two exceptions: >>>>> 1) Random is a subclass of Stream in VW and in Pharo it is not. >>>>> Hence, >>>>> I'll have to copy some methods from Stream to Random. >>>>> 2) I used #beImmutable in VW but I couldn't yet figure out how to >>>>> make >>>>> objects immutable in Pharo. >>>>> >>>>> However, until the tests are ported, I cannot guarantee. Porting the >>>>> test >>>>> suite will be another beast, since I rely on the excellent >>>>> mocking/stubbing >>>>> library DoubleAgents by Randy Coulman. I am not sure how I will >>>>> handle >>>>> that. In general, I think it would be really worth the effort to be >>>>> ported >>>>> to Pharo, too. DoubleAgents is pretty powerful and produces easy to >>>>> read >>>>> and understand mocking/stubbing code. Personally, I prefer it >>>>> clearly, >>>>> e.g., over Mocketry (no offence intended!). >>>>> >>>>> Attached you'll find the file-out that I loaded into Pharo. The >>>>> issues >>>>> above are not addressed yet. However, the following example works: >>>>> >>>>> | scale sides count collect experiment random samples coin flip | >>>>> scale := [:x | (x * 2 + 1) floor] map. >>>>> sides := #(heads tails) replace. >>>>> count := 1000 take. >>>>> collect := [:bag :c | bag add: c; yourself]. >>>>> experiment := (scale * sides * count) transform: collect. >>>>> random := #(0.1 0.3 0.4 0.5 0.6 0.7 0.8 0.9). >>>>> >>>>> samples := random >>>>> reduce: experiment >>>>> init: Bag new. >>>>> >>>>> samples := random >>>>> transduce: scale * sides * count >>>>> reduce: collect >>>>> init: Bag new. >>>>> >>>>> coin := sides <~ scale <~ random. >>>>> flip := Bag <~ count. >>>>> >>>>> samples := flip <~ coin. >>>>> >>>>> >>>>> Best, Steffen >>>>> >>>>> >>>>> >>>>> Am .06.2017, 08:16 Uhr, schrieb Stephane Ducasse >>>>> <stepharo.self(a)gmail.com >>>>> >: >>>>> >>>>> There is a package for that NGFileOuter or something like that on >>>>> cincom >>>>> >>>>>> store. >>>>>> We used it for mobydic code. >>>>>> >>>>>> On Wed, May 31, 2017 at 6:35 PM, Alexandre Bergel < >>>>>> alexandre.bergel(a)me.com> >>>>>> wrote: >>>>>> >>>>>> If I remember correctly, there is a parcel in VisualWorks to export >>>>>> a >>>>>> file >>>>>> >>>>>>> out (Squeak format). >>>>>>> >>>>>>> @Milton, can you give a hand to Steffen? >>>>>>> >>>>>>> Alexandre >>>>>>> -- >>>>>>> _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: >>>>>>> Alexandre Bergel http://www.bergel.eu >>>>>>> ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. >>>>>>> >>>>>>> >>>>>>> >>>>>>> On May 31, 2017, at 10:32 AM, Steffen MÃ¤rcker <merkste(a)web.de> >>>>>>> wrote: >>>>>>> >>>>>>> Thanks for the encouraging response! First question: Which is the >>>>>>> recommended (friction free) way to exchange code between VW and >>>>>>> Pharo? >>>>>>> >>>>>>> Cheers! >>>>>>> Steffen >>>>>>> >>>>>>> Am .05.2017, 16:22 Uhr, schrieb Alexandre Bergel < >>>>>>> alexandre.bergel(a)me.com >>>>>>> >: >>>>>>> >>>>>>> I second Sven. This is very exciting! >>>>>>> >>>>>>> Let us know when you have something ready to be tested. >>>>>>> >>>>>>> Alexandre >>>>>>>

June 6, 2017

Re: [Pharo-users] Bloc/Brick/Spec

by Peter H. Meadows

What does 'Bloc Zeroconf Script' do? What is the difference between the 4 different metacello lines here? https://github.com/pharo-graphics/Brick

June 6, 2017

Re: [Pharo-users] Bloc/Brick/Spec

by Peter Uhnak

* Bloc - low level library (think basic shapes, rectangles, ...) * Brick - widget library on top of Bloc akin to the widget part of Morphic (buttons, checkboxes, ...) * Spec - UI framework with adaptable backend; currently using Morphic as a backend, however once Bloc/Brick matures, Bloc/Brick will be added as another backend (without affecting Spec users) (and below Bloc is Sparta, which is a vector canvas) Peter On Mon, Jun 05, 2017 at 06:20:47PM -0700, Brad Selfridge wrote: > I'm confused. I see the latest news and documentation about Bloc. Is Brick > now dead and Bloc the default? I thought Brick was a layer on top of Bloc > and Spec was layer on top on Brick? What is the direction now? > > Brad Selfridge > > > > ----- > Brad Selfridge > -- > View this message in context: http://forum.world.st/Bloc-Brick-Spec-tp4949591.html > Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. >

June 6, 2017

Slant question

by john pfersich

Slant has a question/poll out there It's at https://www.slant.co/topics/25/~best-programming-language-to-learn-first?ut… Let's pile on it! Sent from my iPhone

June 6, 2017

Re: [Pharo-users] [Pharo-dev] GSoC Week 3 update - Enhancing Pharo Command Line

by Ben Coman

On Thu, Jun 1, 2017 at 5:06 PM, Rajula Vineet <Vineet.Reddy(a)iiitb.org> wrote: > Hi all, > > It has been about three weeks, I started working on my GSoC project. The > first task I am working on is the new implementation for Current Working > Directory. I have written the new implementation. Currently, I am testing > the new code. Will soon share the work here. > Meanwhile, for the week three, I have written a blog post > <https://vineetreddy.wordpress.com/2017/05/29/cross-platform-with-pharo/> > on OSPlatfrom. Please do take a look and give your feedback. > > Thanks, > Rajula > > > Hi Rajula, Great to see an article on this subject. Probably its at a good level for pharo-users mail list as well, so I've copied there. Don't worry about the limited response. Many in pharo-dev probably know this subject well. It is still good to have it laid out like you did for newcomers to google when they need to know. cheers -ben

June 6, 2017

Bloc/Brick/Spec

by Brad Selfridge

I'm confused. I see the latest news and documentation about Bloc. Is Brick now dead and Bloc the default? I thought Brick was a layer on top of Bloc and Spec was layer on top on Brick? What is the direction now? Brad Selfridge ----- Brad Selfridge -- View this message in context: http://forum.world.st/Bloc-Brick-Spec-tp4949591.html Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.

June 6, 2017

Re: [Pharo-users] How to deploy headless app without changes and source files?

by Andreas Sunardi

I had my changes and sources files in the bundle but has their write permission removed, and that causes the error. Simply deploying the tool without the changes file seems to fix it. Pharo5 doesn't complain if the changes file isn't there. However, without the sources file, I get this warning that pharo cannot locate the sources file. Including the sources file in the deployed tool is fine with me. So, I think that's my solution. Thanks! On Mon, Jun 5, 2017 at 5:07 PM, Andreas Sunardi <a.sunardi(a)gmail.com> wrote: > I found this StackOverflow question: > https://stackoverflow.com/questions/14737695/is-it- > possible-to-deploy-a-pharo-image-without-changes-and- > sources-files/14747328 > > and this older forum thread: > https://www.mail-archive.com/pharo-project@lists.gforge. > inria.fr/msg21170.html > > I'm using Pharo5.0 and neither of these options is available anymore. What > is the new way to do this? > > -- > Andreas Sunardi >

June 6, 2017

Re: [Pharo-users] Wiring objects, IoC and Service Locator

by Ben Coman

On Tue, Jun 6, 2017 at 5:11 AM, Stephane Ducasse <stepharo.self(a)gmail.com> wrote: > Tx ben. > When I see all this complexity for something that looks not that complex: > I prefer to pass the class and get done. > May be I missed something obvious... but when I see something too complex > I start to get worried. > > I think that thinking about the contract between classes at runtime is > important and to me a MovieLister should be using at runtime and instance > of the *Finder* > Now needing an extra class just to set this should really be evaluated > with the tradeoff: "flexibility win" (our simple solution is still really > flexible - I decide when I want to pass the correct finder) vs. the code > and conceptual bloat. > > > I'm happy not to face the hyper super over engineering of Java "solutions". > > I like the "Of course this just shifts the burden a tad, we still have to > get the locator into the lister" > but the solution is super simple let us use another "Singleton and a > Factory...." :) > > Stef > > On Mon, Jun 5, 2017 at 8:43 PM, Ben Coman <btc(a)openinworld.com> wrote: > >> >> >> On Tue, Jun 6, 2017 at 1:26 AM, Vitor Medina Cruz <vitormcruz(a)gmail.com> >> wrote: >> >>> Thanks for the answer Ben and Stephane. >>> >>> I already read A Mentoring Course on Smalltalk, Valloud, there is >>> nothing there I could use in this case :( . I will look after for The >>> Design Patterns Smalltalk Companion. Most of the sources provided I already >>> know of or went in the same lines lines of what I have already found. >>> >>> About TDD, I am experienced with the discipline and have tested it on >>> Pharo living system already, but I could not understand how this is related >>> with object wiring, DI and service locator. >>> >> >> I guess I don't properly understand your need and those topics. That was >> my quick pass. Now if I take the time to actually read Fowler's long >> article >> >> "the inversion is about how they lookup a plugin implementation ... to >> ensure that any user of a plugin follows some convention that allows a >> separate assembler module to inject the implementation into the lister." >> >> "The basic idea of the Dependency Injection is to have a separate object, >> an assembler, that populates a field in the lister class with an >> appropriate implementation for the finder interface. There are three main >> styles of dependency injection. The names I'm using for them are >> Constructor Injection, Setter Injection, and Interface Injection." >> >> Now there was too much syntactical noise in those Java examples for me to >> think clearly, so I converted them all to Smalltalk. >> >> >> ##CONSTRUCTOR INJECTION >> >> Object subclass: MovieLister >> instanceVariables: 'finder' >> >> >> MovieLister class >> newWith: aFinder >> ^ self basicNew initializeWith: aFinder >> >> MovieLister >> initializeWith: aFinder >> finder := aFinder >> >> >> ColonMovieFinder class >> newWith: aFilename >> ^ self basicNew initializeWith: aFilename >> >> ColonMovieFinder >> initializeWith: aFilename >> filename := aFilename. >> >> >> ConstructorInjectionContainer >> new >> container := DefaultContainer new. "the article doesn't specify >> where this comes from" >> finderParams := ConstantParameter newWith: 'movies1.txt'. >> container registerComponentInterface: MovieFinderInterface >> implementation: ColonMovieFinder >> params: finderParams. >> container registerComponentImplementation: MovieLister >> ^container >> >> to be used like this... >> ConstructorInjectionTest >> testWithContainer >> container := ConstructorInjectionContainer new. >> lister := container getComponentInstance( MovieLister ). >> movies = lister moviesDirectedBy: 'Sergio Leone'. >> self assert: (movies includes: 'Once Upon a Time in the West') >> >> The article poorly defines registerComponentXXX: or getComponentInstance: >> methods, so I don't dwell on them. I presume its little relevant to the >> main theme. >> >> >> ##SETTER INJECTION >> >> MovieLister >> setFinder: aFinder >> finder := aFinder. >> >> ColonMovieFinder >> setFilename: aFilename >> filename := aFilename. >> >> SetterInjectionTest >> testWithConfigurationFile >> ctx := SomeXmlApplicationConfiguration on: 'config.xml'. >> lister := ctx getConfigOf: 'MovieLister'. >> movies = lister moviesDirectedBy: 'Sergio Leone'. >> self assert: (movies includes: 'Once Upon a Time in the West') >> >> >> ##INTERFACE INJECTION >> >> MovieLister >> injectFinder: aFinder >> finder := aFinder >> >> ColonMovieFinder >> injectFilename: aFilename >> filename := aFilename >> >> InterfaceInjectionTest >> configureContainer >> container := InterfaceInjectionContainer new. >> self registerComponents. >> self registerInjectors. >> container start. >> >> InterfaceInjectionTest >> registerComponents >> container registerComponent: 'MovieLister' with: MovieLister. >> container registerComponent: 'MovieFinder' with: ColonMovieFinder. >> >> InterfaceInjectionTest >> registerInjectors >> container registerInjector: Injector with: (container lookup: >> 'MovieFinder'). >> container registerInjector: InjectorFinderFilename with: >> FinderFilenameInjector new. >> >> ColonMovieFinder >> inject: anObject >> anObject injectFinder: self. >> >> FinderFilenameInjector >> inject: anObject >> anObject injectFilename: 'movies1.txt'. >> >> InterfaceInjectionTester >> testInterface >> self configureContainer. >> lister := container lookup: 'MovieLister'. >> movies = lister moviesDirectedBy: 'Sergio Leone'. >> self assert: (movies includes: 'Once Upon a Time in the West') >> >> The article doesn't define InterfaceInjectionContainer, but I guess it >> could look like this... >> >> InterfaceInjectionContainer >> registerComponent: componentName with: >> aComponent >> container ifNil: [ container := Dictionary new]. >> container at: componentName put: aComponent >> >> InterfaceInjectionContainer >> lookup: componentName >> ^ container at: componentName >> >> >> ##SERVICE LOCATOR >> >> "The basic idea behind a service locator is to have an object that knows >> how to get hold of all of the services that an application might need. So a >> service locator for this application would have a method that returns a >> movie finder when one is needed. Of course this just shifts the burden a >> tad, we still have to get the locator into the lister" >> >> MovieLister >> initialize >> finder := ServiceLocator movieFinder. >> >> >> Object subclass: ServiceLocator >> instanceVariable: 'movieFinder' >> classVariable: 'SoleInstance' >> >> ServiceLocator class >> load: aServiceLocator >> SoleInstance := aServiceLocator >> >> ServiceLocator class >> soleInstance >> ^ SoleInstance >> >> ServiceLocator class >> movieFinder >> ^ self soleInstance movieFinder >> >> ServiceLocator >> movieFinder >> ^movieFinder >> >> >> ServiceLocatorTest >> configure >> ServiceLocator load: (ServiceLocator newWith: (ColonMovieFinder >> newWith: 'movies1.txt')) >> >> >> ServiceLocator class >> newWith: aMovieFinder >> ^ self basicNew initializeWithFinder: aMovieFinder >> >> ServiceLocator >> initializeWithFinder: aMovieFinder >> movieFinder := aMovieFinder >> >> >> ServiceLocatorTest >> testSimple >> self configure. >> lister := MovieLister new. >> movies = lister moviesDirectedBy: 'Sergio Leone'. >> self assert: (movies includes: 'Once Upon a Time in the West') >> >> So it seems that a service locator is just a Singleton pattern having a >> class variable for each service of interest ?? >> > It was late and I mispoke here, of course this should have said... * a Singleton pattern having an instance variable for each service of interest * a Singleton pattern having a getter method (with hidden implementation) for each service of interest > So in good faith** I ask... "Is it any more complicated than that?" >> >> **Since its taken me a couple of hours to convert the Java to this point >> so I stopped reading to seek your feedback. >> > but I'll add, it was so much simpler to understand without all that Java typing boiler plate. cheers -ben > Is that enough insight to adapt to your needs, or is there something else >> further down the article that invalidates my analysis? >> >> >> >> >> >>> >>> From ben: >>> >>> "I'm not really familiar with IoC or DI patterns, so just taking your >>>> example at face value, in Pharo I'd do... >>>> >>>> MovieLister>>moviesDirectedBy: director >>>> allMovies := finder allMovies. >>>> ^ allMovies select: [ :movie | movie getDirector = director ]. >>>> "although typically #getDirector would be renamed #director" >>>> >>>> MovieLister>>finder: movieFinder >>>> finder := movieFinder. >>>> >>>> to be used like this... >>>> lister := MovieLister new finder: (ColonDelimitedMovieFinder on: >>>> 'movies1.txt'). >>>> movies := lister moviesDirectedBy: 'Tarantino'." >>> >>> >> >> So per Fowler, the above is equivalent to "Setter Injection with Spring" >> >> >>> >>> and Stephane: >>> >>> Why don't you simply pass the class and use that class in your >>>> MovieLister? >>>> >>>> MovieLister new >>>> finderClass: MySuperCoolFinderClass >>>> >>>> ... >>>> MovieLister finder >>>> finderClass new ..... >>>> >>>> What is wrong with that. >>> >>> >>> That was what I meant when I said: "I know that in Smalltalk I can make >>> MovieLister to receive, upon construction, a class representing MovieFinder >>> and call it construction message.". The code I had in mind is a bit of >>> mix from the one provided by you both: >>> >>> MovieLister>>moviesDirectedBy: director >>> allMovies := finder allMovies. >>> ^ allMovies select: [ :movie | movie getDirector = director ]. >>> "although typically #getDirector would be renamed #director" >>> >>> MovieLister>>finder: aMovieFinderBuilder >>> finder := aMovieFinderClass new. >>> >>> to be used like this... >>> lister := MovieLister new finder: (ColonDelimitedMovieFinder >>> builderOn: 'movies1.txt'). >>> movies := lister moviesDirectedBy: 'Tarantino'." >>> >>> But that means I will have to wire dependencies by hand whenever I >>> create a MovieLister and seek through code when and if those dependencies >>> change. When there are lot's of dependencies it's is a considerable and >>> tedious work. Let's see an image from Fowlers article: >>> >>> [image: Inline image 1] >>> >>> In this case, the service locator provides me with an instance and I >>> configure the instance in the assembler, the scheme is alike for an IoC, >>> and that would mean my implementation could be like this: >>> >>> >>> MovieLister>>moviesDirectedBy: director >>> allMovies := finder allMovies. >>> ^ allMovies select: [ :movie | movie getDirector = director ]. >>> "although typically #getDirector would be renamed #director" >>> >>> MovieLister>>initialize >>> finder := ServiceLocator locate: FinderClass <--- This would >>> bring the instance of finder class configured by the assembler >>> >> >> No, like this... >> finder := ServiceLocation movieFinder. >> >> Now if you want to store a class rather than an instance as I did higher >> up, you just do this... >> >> Object subclass: ServiceLocator >> instanceVariable: 'movieFinderClass' >> classVariable: 'SoleInstance' >> >> ServiceLocator class >> movieFinder >> ^ self soleInstance movieFinderClass new >> >> >> >>> >>> >>> to be used like this... >>> lister := MovieLister new. >>> movies := lister moviesDirectedBy: 'Tarantino'." >>> >>> and the assembler: >>> >>> Assember class>>configure: >>> aMap put: (ColonDelimitedMovieFinder builderOn: 'movies1.txt') at: >>> FinderClass >>> >> >> Assembler class>>configure >> ServiceLocator load: >> (ServiceLocator new >> movieFinder: (ColonMovieFinder newWith: 'movies1.txt') >> otherService: MyCustomService new) >> >> >>> >>> My assembler and service locator could be even more elaborated, and >>> provide a different MovieFinder in test scope, for different classes or >>> wharever. >>> >> >> Really, the test should not be updating the class variable global like >> this... >> ServiceLocatorTest >> configure >> ServiceLocator load: (ServiceLocator newWith: (ColonMovieFinder >> newWith: 'movies1.txt')) >> >> you probably want something like (its rough but shows the point...) >> Object subclass: #MovieLister >> instanceVariables: 'serviceLocator' >> >> MovieLister >> initialize >> serviceLocator ifNil: [ serviceLocator := ServiceLocator soleInstance >> ]. >> finder := serviceLocator movieFinder. >> >> MovieLister class >> newWithServiceLocator: aServiceLocator >> ^ (self basicNew initializeWithServiceLocator: aServiceLocator) >> initialize. >> >> MovieLister >> initializeWithServiceLocator: aServiceLocator >> serviceLocator := aServiceLocator >> >> ServiceLocatorTest >> testSimple2 >> lister := MovieLister newWithServiceLocator: (ServiceLocator newWith: >> (ColonMovieFinder newWith: 'movies1.txt')). >> movies = lister moviesDirectedBy: 'Sergio Leone'. >> self assert: (movies includes: 'Once Upon a Time in the West') >> >> >> cheers -ben >> >> >>> >>> It is a little convenience for Smalltalk, I will give that, but I was >>> wandering if there was something alike in Pharo, by your answers I assuming >>> there is nothing like that. >>> >>> >>> >>> On Mon, Jun 5, 2017 at 6:41 AM, Stephane Ducasse < >>> stepharo.self(a)gmail.com> wrote: >>> >>>> Why don't you simply pass the class and use that class in your >>>> MovieLister? >>>> >>>> MovieLister new >>>> finderClass: MySuperCoolFinderClass >>>> >>>> ... >>>> MovieLister finder >>>> finderClass new ..... >>>> >>>> What is wrong with that. >>>> >>>> If you do not want to have a reference at runtime to a Finder then you >>>> need to use announcement and registration. >>>> >>>> Stef >>>> >>>> >>>> >>>> On Sun, Jun 4, 2017 at 11:17 PM, Vitor Medina Cruz < >>>> vitormcruz(a)gmail.com> wrote: >>>> > Hello, >>>> > >>>> > I would like to know how people in Pharo ecosystem do to deal with >>>> object >>>> > wiring, as described by Marting Fowler in >>>> > https://martinfowler.com/articles/injection.html#FormsOfDepe >>>> ndencyInjection: >>>> > >>>> > "A common issue to deal with is how to wire together different >>>> elements: how >>>> > do you fit together this web controller architecture with that >>>> database >>>> > interface backing when they were built by different teams with little >>>> > knowledge of each other." >>>> > >>>> > He gives an example, I will leave it in java as it is simple enough to >>>> > understand: >>>> > >>>> > "class MovieLister... >>>> > >>>> > public Movie[] moviesDirectedBy(String arg) { >>>> > List allMovies = finder.findAll(); >>>> > for (Iterator it = allMovies.iterator(); it.hasNext();) { >>>> > Movie movie = (Movie) it.next(); >>>> > if (!movie.getDirector().equals(arg)) it.remove(); >>>> > } >>>> > return (Movie[]) allMovies.toArray(new Movie[allMovies.size()]); >>>> > >>>> > }" >>>> > >>>> > The question is how to provide the finder object in a decoupled >>>> matter, a >>>> > naive approach would be: >>>> > >>>> > " private MovieFinder finder; >>>> > >>>> > public MovieLister() { >>>> > finder = new ColonDelimitedMovieFinder("movies1.txt"); >>>> > >>>> > }" >>>> > >>>> > Which couples the MovieLister to the specific >>>> ColonDelimitedMovieFinder >>>> > class. >>>> > >>>> > Fowler explains how to decouple using an IoC framework or a Service >>>> Locator. >>>> > In Java and .Net IoC is used most of the time. I Googled how this >>>> problem is >>>> > approached in Smalltalk/Pharo, and I generally I found answers "that >>>> is easy >>>> > to do in Smalltalk, so there is no need of a framework", what I miss >>>> is a >>>> > description on *how* to do that: >>>> > >>>> > https://stackoverflow.com/questions/243905/smalltalk-and-ioc >>>> > https://stackoverflow.com/questions/2684326/is-there-a-depen >>>> dency-injection-framework-for-smalltalk >>>> > https://stackoverflow.com/questions/243905/smalltalk-and-ioc >>>> /347477#347477 >>>> > >>>> > I know that in Smalltalk I can make MovieLister to receive, upon >>>> > construction, a class representing MovieFinder and call it >>>> construction >>>> > message. As long an object that responds to this message is provided, >>>> I can >>>> > create as many derivations I want and the MovieLister will be >>>> decoupled from >>>> > the MovieFinder. That way, however, I still have to wire things by >>>> hand, and >>>> > I am not sure if this is what I am supposed to do in order to solve >>>> the >>>> > decouple problem. >>>> > >>>> > Can you explain me how this is done in Pharo? It's is usually wiring >>>> by >>>> > hand? Is there a simple construction that deals with the wiring >>>> problem that >>>> > I cannot foresee? >>>> > >>>> > Thanks in advance, >>>> > Vitor >>>> > >>>> > >>>> > >>>> >>>> >>> >> >

June 6, 2017

Re: [Pharo-users] XPath has unresolved dependencies

by monty

June 6, 2017

How to deploy headless app without changes and source files?

by Andreas Sunardi

I found this StackOverflow question: https://stackoverflow.com/questions/14737695/is-it-possible-to-deploy-a-pha… and this older forum thread: https://www.mail-archive.com/pharo-project@lists.gforge.inria.fr/msg21170.h… I'm using Pharo5.0 and neither of these options is available anymore. What is the new way to do this? -- Andreas Sunardi

June 6, 2017

Re: [Pharo-users] Saving selected changes in Monticello

by Andreas Sunardi

I definitely will check Komitter and I can use and fallback to Ben's method. Thank you to all of you. On Mon, Jun 5, 2017 at 12:58 AM, Peter Uhnak <i.uhnak(a)gmail.com> wrote: > Komitter could indeed help you, see https://www.peteruhnak.com/ > blog/2016/08/12/fine-grained-committing-and-extending-nautilus/ > > Peter > > On Mon, Jun 05, 2017 at 08:27:23AM +0200, serge.stinckwich(a)gmail.com > wrote: > > Kommiter available in default image allows you do cherry pick quite > easily. > > > > EnvoyÃ© de mon iPhone > > > > > Le 5 juin 2017 Ã 07:14, Ben Coman <btc(a)openinworld.com> a Ã©crit : > > > > > > > > > > > >> On Mon, Jun 5, 2017 at 10:12 AM, Andreas Sunardi <a.sunardi(a)gmail.com> > wrote: > > >> I have a half done changes in my image, but I need to distribute the > other changes that are done. I thought I was going to do this all at once, > but now I realize I should split this into 2 commit versions. > > >> > > >> Is there a way in Monticello to say save my changes, but not this and > that changes? I can't seem to find it nor in books. How do people deal with > this situation? > > > > > > AFAIK, Monticello cannot cherry pick. One work around is probably > something like... > > > 1. Save the mcz locally > > > 2. Merge back into a fresh image selecting only the bits you want. > > > 3. Save as a second mcz. > > > One issue is that the second mcz will have the first mcz as an > ancestor, so before 2 you might create a new changeset to file out after 2, > and load that into a second new image. yuck! > > > > > > Another alternative might be to use Tools > ChangeSorter to move the > code you want to exclude from the mcz to a changeset, file that out and > then revert that code in the image. After save the package to a mcz, reload > the changeset. > > > > > > cheers -ben > >

June 5, 2017

Re: [Pharo-users] STON Question

by Offray Vladimir Luna CÃ¡rdenas

Ok Stef. Happy that we're exploring different paths ;-). Cheers, Offray On 05/06/17 13:56, Stephane Ducasse wrote: > Hi offray > > Thanks but pillar ha a conf since several years and it is working > well. Now I'm revisiting the implementation of cocoon > because I want to have it simpler independent of magritte and better > tested. > > Now I just want to add a new functionality to output a configuration > file from the > objects and in Pillar the configuration objects hold more complex > ***objects***. > So just taking the object and turning it in ston does not work. > > Stef > > On Mon, Jun 5, 2017 at 6:23 PM, Offray Vladimir Luna CÃ¡rdenas > <offray.luna(a)mutabit.com <mailto:offray.luna@mutabit.com>> wrote: > > Hi, > > Maybe what I'm doing in Grafoscopio could help. > > I have a %metadata node which contains all configuration options > for the production of the document (as shown in the image below). > Exporting a document consist in looking for these nodes while > traversing the notebook tree and applying that options in the > proper place. You can see the source code of the current notebook > STON file at [1], the exported markdown file at [2] and the > exported PDF at [3]. As you can see I have pretty good control of > the configuration of the document using this option (and a single > place to manage all, without endless small files and folders for a > document, but event that exporting options as split folders and > docs, could be added also). > > [1] > http://mutabit.com/repos.fossil/grafoscopio/artifact/fb25442038a0d4a1 > <http://mutabit.com/repos.fossil/grafoscopio/artifact/fb25442038a0d4a1> > [2] > http://mutabit.com/repos.fossil/grafoscopio/artifact?name=59245142cf93590b&… > <http://mutabit.com/repos.fossil/grafoscopio/artifact?name=59245142cf93590b&…> > [3] > http://mutabit.com/repos.fossil/grafoscopio/doc/tip/Docs/En/Books/Manual/ma… > <http://mutabit.com/repos.fossil/grafoscopio/doc/tip/Docs/En/Books/Manual/ma…> > > > > Cheers, > > Offray > > > On 05/06/17 01:58, Stephane Ducasse wrote: >> Sven I know what Ston is :) >> >> Now Pillar dev used Ston as input and it works. Then with some >> hooks they let the user convert the strings >> into specific objects and this is ok. >> Now I want to add export in Ston and for configurations I need to >> control for the application and not as a ston object the value saved. >> For example a file reference should not be just a file reference >> in Ston but >> a string relative the the baseDirectory of the configuration. >> >> So I thought that I can build a hook and control the call to Ston >> (convert the object before to the correct values) and export. >> It should be working now doing this I found myself redoing the >> output of Ston. >> So I will do it. Then I thought that may be I could reuse this >> logic. >> >> Stef >> >> >> >> On Sun, Jun 4, 2017 at 11:49 PM, Sven Van Caekenberghe >> <sven(a)stfx.eu <mailto:sven@stfx.eu>> wrote: >> >> Stef, >> >> STON is like FUEL, it can write any object to a stream and >> read it back. Although you can customise how this is done, >> only one way of doing so is supported (i.e. you cannot change >> the format for each application). >> >> People have used STON for various applications now, including >> for configuration stuff (because it is a textual format that >> is easy to read). >> >> I would suggest you just try to see what your config looks >> like once you have the objects in Pharo. >> >> STON toStringPretty: myConfig. >> >> Then we can see how to tune the representation. >> >> Sven >> >> > On 4 Jun 2017, at 22:58, Stephane Ducasse >> <stepharo.self(a)gmail.com <mailto:stepharo.self@gmail.com>> wrote: >> > >> > Hi sven >> > >> > I'm working on a new configuration frameworks similar to >> the one use pillar.conf. >> > >> > So basically I have >> > >> > ston := '{ >> > "newLine":#unix, >> > "separateOutputFiles":true >> > }'. >> > and I want to recreate it. >> > >> > So I did >> > >> > Object >> toConfigurationString >> > >> > ^ STON toString: self >> > >> > SimpleConfiguration >> exportStream >> > >> > ^ String streamContents: [ :str | >> > str << '{' . >> > self propertiesKeysAndValuesDo: [ :key :value| >> > str << key toConfigurationString. >> > str << ':'. >> > str << value toConfigurationString. >> > str << ','. >> > str lf. >> > ]. >> > str << '}'. >> > str contents >> > ] >> > >> > The idea is that for special configuration values people >> should be able to define >> > how to go from the object to configuration. >> > For example for some FileReference I want to have just the >> path up to the baseDirectory. >> > >> > Now I wonder if I could not better reuse ston. >> > I saw the stonOn: >> > but I did not look further because I was wondering how the >> writer where passed. >> > >> > Any feedback is welcome. >> > >> > Stef (now bed time). >> > >> >> >> > >

June 5, 2017

Re: [Pharo-users] Wiring objects, IoC and Service Locator

by Stephane Ducasse

Tx ben. When I see all this complexity for something that looks not that complex: I prefer to pass the class and get done. May be I missed something obvious... but when I see something too complex I start to get worried. I think that thinking about the contract between classes at runtime is important and to me a MovieLister should be using at runtime and instance of the *Finder* Now needing an extra class just to set this should really be evaluated with the tradeoff: "flexibility win" (our simple solution is still really flexible - I decide when I want to pass the correct finder) vs. the code and conceptual bloat. I'm happy not to face the hyper super over engineering of Java "solutions". I like the "Of course this just shifts the burden a tad, we still have to get the locator into the lister" but the solution is super simple let us use another "Singleton and a Factory...." :) Stef On Mon, Jun 5, 2017 at 8:43 PM, Ben Coman <btc(a)openinworld.com> wrote: > > > On Tue, Jun 6, 2017 at 1:26 AM, Vitor Medina Cruz <vitormcruz(a)gmail.com> > wrote: > >> Thanks for the answer Ben and Stephane. >> >> I already read A Mentoring Course on Smalltalk, Valloud, there is >> nothing there I could use in this case :( . I will look after for The >> Design Patterns Smalltalk Companion. Most of the sources provided I already >> know of or went in the same lines lines of what I have already found. >> >> About TDD, I am experienced with the discipline and have tested it on >> Pharo living system already, but I could not understand how this is related >> with object wiring, DI and service locator. >> > > I guess I don't properly understand your need and those topics. That was > my quick pass. Now if I take the time to actually read Fowler's long > article > > "the inversion is about how they lookup a plugin implementation ... to > ensure that any user of a plugin follows some convention that allows a > separate assembler module to inject the implementation into the lister." > > "The basic idea of the Dependency Injection is to have a separate object, > an assembler, that populates a field in the lister class with an > appropriate implementation for the finder interface. There are three main > styles of dependency injection. The names I'm using for them are > Constructor Injection, Setter Injection, and Interface Injection." > > Now there was too much syntactical noise in those Java examples for me to > think clearly, so I converted them all to Smalltalk. > > > ##CONSTRUCTOR INJECTION > > Object subclass: MovieLister > instanceVariables: 'finder' > > > MovieLister class >> newWith: aFinder > ^ self basicNew initializeWith: aFinder > > MovieLister >> initializeWith: aFinder > finder := aFinder > > > ColonMovieFinder class >> newWith: aFilename > ^ self basicNew initializeWith: aFilename > > ColonMovieFinder >> initializeWith: aFilename > filename := aFilename. > > > ConstructorInjectionContainer >> new > container := DefaultContainer new. "the article doesn't specify where > this comes from" > finderParams := ConstantParameter newWith: 'movies1.txt'. > container registerComponentInterface: MovieFinderInterface > implementation: ColonMovieFinder > params: finderParams. > container registerComponentImplementation: MovieLister > ^container > > to be used like this... > ConstructorInjectionTest >> testWithContainer > container := ConstructorInjectionContainer new. > lister := container getComponentInstance( MovieLister ). > movies = lister moviesDirectedBy: 'Sergio Leone'. > self assert: (movies includes: 'Once Upon a Time in the West') > > The article poorly defines registerComponentXXX: or getComponentInstance: > methods, so I don't dwell on them. I presume its little relevant to the > main theme. > > > ##SETTER INJECTION > > MovieLister >> setFinder: aFinder > finder := aFinder. > > ColonMovieFinder >> setFilename: aFilename > filename := aFilename. > > SetterInjectionTest >> testWithConfigurationFile > ctx := SomeXmlApplicationConfiguration on: 'config.xml'. > lister := ctx getConfigOf: 'MovieLister'. > movies = lister moviesDirectedBy: 'Sergio Leone'. > self assert: (movies includes: 'Once Upon a Time in the West') > > > ##INTERFACE INJECTION > > MovieLister >> injectFinder: aFinder > finder := aFinder > > ColonMovieFinder >> injectFilename: aFilename > filename := aFilename > > InterfaceInjectionTest >> configureContainer > container := InterfaceInjectionContainer new. > self registerComponents. > self registerInjectors. > container start. > > InterfaceInjectionTest >> registerComponents > container registerComponent: 'MovieLister' with: MovieLister. > container registerComponent: 'MovieFinder' with: ColonMovieFinder. > > InterfaceInjectionTest >> registerInjectors > container registerInjector: Injector with: (container lookup: > 'MovieFinder'). > container registerInjector: InjectorFinderFilename with: > FinderFilenameInjector new. > > ColonMovieFinder >> inject: anObject > anObject injectFinder: self. > > FinderFilenameInjector >> inject: anObject > anObject injectFilename: 'movies1.txt'. > > InterfaceInjectionTester >> testInterface > self configureContainer. > lister := container lookup: 'MovieLister'. > movies = lister moviesDirectedBy: 'Sergio Leone'. > self assert: (movies includes: 'Once Upon a Time in the West') > > The article doesn't define InterfaceInjectionContainer, but I guess it > could look like this... > > InterfaceInjectionContainer >> registerComponent: componentName with: > aComponent > container ifNil: [ container := Dictionary new]. > container at: componentName put: aComponent > > InterfaceInjectionContainer >> lookup: componentName > ^ container at: componentName > > > ##SERVICE LOCATOR > > "The basic idea behind a service locator is to have an object that knows > how to get hold of all of the services that an application might need. So a > service locator for this application would have a method that returns a > movie finder when one is needed. Of course this just shifts the burden a > tad, we still have to get the locator into the lister" > > MovieLister >> initialize > finder := ServiceLocator movieFinder. > > > Object subclass: ServiceLocator > instanceVariable: 'movieFinder' > classVariable: 'SoleInstance' > > ServiceLocator class >> load: aServiceLocator > SoleInstance := aServiceLocator > > ServiceLocator class >> soleInstance > ^ SoleInstance > > ServiceLocator class >> movieFinder > ^ self soleInstance movieFinder > > ServiceLocator >> movieFinder > ^movieFinder > > > ServiceLocatorTest >> configure > ServiceLocator load: (ServiceLocator newWith: (ColonMovieFinder > newWith: 'movies1.txt')) > > > ServiceLocator class >> newWith: aMovieFinder > ^ self basicNew initializeWithFinder: aMovieFinder > > ServiceLocator >> initializeWithFinder: aMovieFinder > movieFinder := aMovieFinder > > > ServiceLocatorTest >> testSimple > self configure. > lister := MovieLister new. > movies = lister moviesDirectedBy: 'Sergio Leone'. > self assert: (movies includes: 'Once Upon a Time in the West') > > So it seems that a service locator is just a Singleton pattern having a > class variable for each service of interest ?? > So in good faith** I ask... "Is it any more complicated than that?" > > **Since its taken me a couple of hours to convert the Java to this point > so I stopped reading to seek your feedback. > Is that enough insight to adapt to your needs, or is there something else > further down the article that invalidates my analysis? > > > > > >> >> From ben: >> >> "I'm not really familiar with IoC or DI patterns, so just taking your >>> example at face value, in Pharo I'd do... >>> >>> MovieLister>>moviesDirectedBy: director >>> allMovies := finder allMovies. >>> ^ allMovies select: [ :movie | movie getDirector = director ]. >>> "although typically #getDirector would be renamed #director" >>> >>> MovieLister>>finder: movieFinder >>> finder := movieFinder. >>> >>> to be used like this... >>> lister := MovieLister new finder: (ColonDelimitedMovieFinder on: >>> 'movies1.txt'). >>> movies := lister moviesDirectedBy: 'Tarantino'." >> >> > > So per Fowler, the above is equivalent to "Setter Injection with Spring" > > >> >> and Stephane: >> >> Why don't you simply pass the class and use that class in your >>> MovieLister? >>> >>> MovieLister new >>> finderClass: MySuperCoolFinderClass >>> >>> ... >>> MovieLister finder >>> finderClass new ..... >>> >>> What is wrong with that. >> >> >> That was what I meant when I said: "I know that in Smalltalk I can make >> MovieLister to receive, upon construction, a class representing MovieFinder >> and call it construction message.". The code I had in mind is a bit of >> mix from the one provided by you both: >> >> MovieLister>>moviesDirectedBy: director >> allMovies := finder allMovies. >> ^ allMovies select: [ :movie | movie getDirector = director ]. >> "although typically #getDirector would be renamed #director" >> >> MovieLister>>finder: aMovieFinderBuilder >> finder := aMovieFinderClass new. >> >> to be used like this... >> lister := MovieLister new finder: (ColonDelimitedMovieFinder >> builderOn: 'movies1.txt'). >> movies := lister moviesDirectedBy: 'Tarantino'." >> >> But that means I will have to wire dependencies by hand whenever I create >> a MovieLister and seek through code when and if those dependencies change. >> When there are lot's of dependencies it's is a considerable and tedious >> work. Let's see an image from Fowlers article: >> >> [image: Inline image 1] >> >> In this case, the service locator provides me with an instance and I >> configure the instance in the assembler, the scheme is alike for an IoC, >> and that would mean my implementation could be like this: >> >> >> MovieLister>>moviesDirectedBy: director >> allMovies := finder allMovies. >> ^ allMovies select: [ :movie | movie getDirector = director ]. >> "although typically #getDirector would be renamed #director" >> >> MovieLister>>initialize >> finder := ServiceLocator locate: FinderClass <--- This would bring >> the instance of finder class configured by the assembler >> > > No, like this... > finder := ServiceLocation movieFinder. > > Now if you want to store a class rather than an instance as I did higher > up, you just do this... > > Object subclass: ServiceLocator > instanceVariable: 'movieFinderClass' > classVariable: 'SoleInstance' > > ServiceLocator class >> movieFinder > ^ self soleInstance movieFinderClass new > > > >> >> >> to be used like this... >> lister := MovieLister new. >> movies := lister moviesDirectedBy: 'Tarantino'." >> >> and the assembler: >> >> Assember class>>configure: >> aMap put: (ColonDelimitedMovieFinder builderOn: 'movies1.txt') at: >> FinderClass >> > > Assembler class>>configure > ServiceLocator load: > (ServiceLocator new > movieFinder: (ColonMovieFinder newWith: 'movies1.txt') > otherService: MyCustomService new) > > >> >> My assembler and service locator could be even more elaborated, and >> provide a different MovieFinder in test scope, for different classes or >> wharever. >> > > Really, the test should not be updating the class variable global like > this... > ServiceLocatorTest >> configure > ServiceLocator load: (ServiceLocator newWith: (ColonMovieFinder > newWith: 'movies1.txt')) > > you probably want something like (its rough but shows the point...) > Object subclass: #MovieLister > instanceVariables: 'serviceLocator' > > MovieLister >> initialize > serviceLocator ifNil: [ serviceLocator := ServiceLocator soleInstance > ]. > finder := serviceLocator movieFinder. > > MovieLister class >> newWithServiceLocator: aServiceLocator > ^ (self basicNew initializeWithServiceLocator: aServiceLocator) > initialize. > > MovieLister >> initializeWithServiceLocator: aServiceLocator > serviceLocator := aServiceLocator > > ServiceLocatorTest >> testSimple2 > lister := MovieLister newWithServiceLocator: (ServiceLocator newWith: > (ColonMovieFinder newWith: 'movies1.txt')). > movies = lister moviesDirectedBy: 'Sergio Leone'. > self assert: (movies includes: 'Once Upon a Time in the West') > > > cheers -ben > > >> >> It is a little convenience for Smalltalk, I will give that, but I was >> wandering if there was something alike in Pharo, by your answers I assuming >> there is nothing like that. >> >> >> >> On Mon, Jun 5, 2017 at 6:41 AM, Stephane Ducasse <stepharo.self(a)gmail.com >> > wrote: >> >>> Why don't you simply pass the class and use that class in your >>> MovieLister? >>> >>> MovieLister new >>> finderClass: MySuperCoolFinderClass >>> >>> ... >>> MovieLister finder >>> finderClass new ..... >>> >>> What is wrong with that. >>> >>> If you do not want to have a reference at runtime to a Finder then you >>> need to use announcement and registration. >>> >>> Stef >>> >>> >>> >>> On Sun, Jun 4, 2017 at 11:17 PM, Vitor Medina Cruz <vitormcruz(a)gmail.com> >>> wrote: >>> > Hello, >>> > >>> > I would like to know how people in Pharo ecosystem do to deal with >>> object >>> > wiring, as described by Marting Fowler in >>> > https://martinfowler.com/articles/injection.html#FormsOfDepe >>> ndencyInjection: >>> > >>> > "A common issue to deal with is how to wire together different >>> elements: how >>> > do you fit together this web controller architecture with that database >>> > interface backing when they were built by different teams with little >>> > knowledge of each other." >>> > >>> > He gives an example, I will leave it in java as it is simple enough to >>> > understand: >>> > >>> > "class MovieLister... >>> > >>> > public Movie[] moviesDirectedBy(String arg) { >>> > List allMovies = finder.findAll(); >>> > for (Iterator it = allMovies.iterator(); it.hasNext();) { >>> > Movie movie = (Movie) it.next(); >>> > if (!movie.getDirector().equals(arg)) it.remove(); >>> > } >>> > return (Movie[]) allMovies.toArray(new Movie[allMovies.size()]); >>> > >>> > }" >>> > >>> > The question is how to provide the finder object in a decoupled >>> matter, a >>> > naive approach would be: >>> > >>> > " private MovieFinder finder; >>> > >>> > public MovieLister() { >>> > finder = new ColonDelimitedMovieFinder("movies1.txt"); >>> > >>> > }" >>> > >>> > Which couples the MovieLister to the specific ColonDelimitedMovieFinder >>> > class. >>> > >>> > Fowler explains how to decouple using an IoC framework or a Service >>> Locator. >>> > In Java and .Net IoC is used most of the time. I Googled how this >>> problem is >>> > approached in Smalltalk/Pharo, and I generally I found answers "that >>> is easy >>> > to do in Smalltalk, so there is no need of a framework", what I miss >>> is a >>> > description on *how* to do that: >>> > >>> > https://stackoverflow.com/questions/243905/smalltalk-and-ioc >>> > https://stackoverflow.com/questions/2684326/is-there-a-depen >>> dency-injection-framework-for-smalltalk >>> > https://stackoverflow.com/questions/243905/smalltalk-and-ioc >>> /347477#347477 >>> > >>> > I know that in Smalltalk I can make MovieLister to receive, upon >>> > construction, a class representing MovieFinder and call it construction >>> > message. As long an object that responds to this message is provided, >>> I can >>> > create as many derivations I want and the MovieLister will be >>> decoupled from >>> > the MovieFinder. That way, however, I still have to wire things by >>> hand, and >>> > I am not sure if this is what I am supposed to do in order to solve the >>> > decouple problem. >>> > >>> > Can you explain me how this is done in Pharo? It's is usually wiring by >>> > hand? Is there a simple construction that deals with the wiring >>> problem that >>> > I cannot foresee? >>> > >>> > Thanks in advance, >>> > Vitor >>> > >>> > >>> > >>> >>> >> >

June 5, 2017

Re: [Pharo-users] STON Question

by Stephane Ducasse

Hi offray Thanks but pillar ha a conf since several years and it is working well. Now I'm revisiting the implementation of cocoon because I want to have it simpler independent of magritte and better tested. Now I just want to add a new functionality to output a configuration file from the objects and in Pillar the configuration objects hold more complex ***objects***. So just taking the object and turning it in ston does not work. Stef On Mon, Jun 5, 2017 at 6:23 PM, Offray Vladimir Luna CÃ¡rdenas < offray.luna(a)mutabit.com> wrote: > Hi, > > Maybe what I'm doing in Grafoscopio could help. > > I have a %metadata node which contains all configuration options for the > production of the document (as shown in the image below). Exporting a > document consist in looking for these nodes while traversing the notebook > tree and applying that options in the proper place. You can see the source > code of the current notebook STON file at [1], the exported markdown file > at [2] and the exported PDF at [3]. As you can see I have pretty good > control of the configuration of the document using this option (and a > single place to manage all, without endless small files and folders for a > document, but event that exporting options as split folders and docs, could > be added also). > [1] http://mutabit.com/repos.fossil/grafoscopio/artifact/fb25442038a0d4a1 > [2] http://mutabit.com/repos.fossil/grafoscopio/artifact? > name=59245142cf93590b&txt=1 > [3] http://mutabit.com/repos.fossil/grafoscopio/doc/tip/ > Docs/En/Books/Manual/manual.pdf > > > > Cheers, > > Offray > > > On 05/06/17 01:58, Stephane Ducasse wrote: > > Sven I know what Ston is :) > > Now Pillar dev used Ston as input and it works. Then with some hooks they > let the user convert the strings > into specific objects and this is ok. > Now I want to add export in Ston and for configurations I need to control > for the application and not as a ston object the value saved. > For example a file reference should not be just a file reference in Ston > but > a string relative the the baseDirectory of the configuration. > > So I thought that I can build a hook and control the call to Ston (convert > the object before to the correct values) and export. > It should be working now doing this I found myself redoing the output of > Ston. > So I will do it. Then I thought that may be I could reuse this logic. > > Stef > > > > On Sun, Jun 4, 2017 at 11:49 PM, Sven Van Caekenberghe <sven(a)stfx.eu> > wrote: > >> Stef, >> >> STON is like FUEL, it can write any object to a stream and read it back. >> Although you can customise how this is done, only one way of doing so is >> supported (i.e. you cannot change the format for each application). >> >> People have used STON for various applications now, including for >> configuration stuff (because it is a textual format that is easy to read). >> >> I would suggest you just try to see what your config looks like once you >> have the objects in Pharo. >> >> STON toStringPretty: myConfig. >> >> Then we can see how to tune the representation. >> >> Sven >> >> > On 4 Jun 2017, at 22:58, Stephane Ducasse <stepharo.self(a)gmail.com> >> wrote: >> > >> > Hi sven >> > >> > I'm working on a new configuration frameworks similar to the one use >> pillar.conf. >> > >> > So basically I have >> > >> > ston := '{ >> > "newLine":#unix, >> > "separateOutputFiles":true >> > }'. >> > and I want to recreate it. >> > >> > So I did >> > >> > Object >> toConfigurationString >> > >> > ^ STON toString: self >> > >> > SimpleConfiguration >> exportStream >> > >> > ^ String streamContents: [ :str | >> > str << '{' . >> > self propertiesKeysAndValuesDo: [ :key :value| >> > str << key toConfigurationString. >> > str << ':'. >> > str << value toConfigurationString. >> > str << ','. >> > str lf. >> > ]. >> > str << '}'. >> > str contents >> > ] >> > >> > The idea is that for special configuration values people should be able >> to define >> > how to go from the object to configuration. >> > For example for some FileReference I want to have just the path up to >> the baseDirectory. >> > >> > Now I wonder if I could not better reuse ston. >> > I saw the stonOn: >> > but I did not look further because I was wondering how the writer where >> passed. >> > >> > Any feedback is welcome. >> > >> > Stef (now bed time). >> > >> >> >> > >

June 5, 2017

Re: [Pharo-users] Wiring objects, IoC and Service Locator

by Ben Coman

On Tue, Jun 6, 2017 at 1:26 AM, Vitor Medina Cruz <vitormcruz(a)gmail.com> wrote: > Thanks for the answer Ben and Stephane. > > I already read A Mentoring Course on Smalltalk, Valloud, there is nothing > there I could use in this case :( . I will look after for The Design > Patterns Smalltalk Companion. Most of the sources provided I already know > of or went in the same lines lines of what I have already found. > > About TDD, I am experienced with the discipline and have tested it on > Pharo living system already, but I could not understand how this is related > with object wiring, DI and service locator. > I guess I don't properly understand your need and those topics. That was my quick pass. Now if I take the time to actually read Fowler's long article "the inversion is about how they lookup a plugin implementation ... to ensure that any user of a plugin follows some convention that allows a separate assembler module to inject the implementation into the lister." "The basic idea of the Dependency Injection is to have a separate object, an assembler, that populates a field in the lister class with an appropriate implementation for the finder interface. There are three main styles of dependency injection. The names I'm using for them are Constructor Injection, Setter Injection, and Interface Injection." Now there was too much syntactical noise in those Java examples for me to think clearly, so I converted them all to Smalltalk. ##CONSTRUCTOR INJECTION Object subclass: MovieLister instanceVariables: 'finder' MovieLister class >> newWith: aFinder ^ self basicNew initializeWith: aFinder MovieLister >> initializeWith: aFinder finder := aFinder ColonMovieFinder class >> newWith: aFilename ^ self basicNew initializeWith: aFilename ColonMovieFinder >> initializeWith: aFilename filename := aFilename. ConstructorInjectionContainer >> new container := DefaultContainer new. "the article doesn't specify where this comes from" finderParams := ConstantParameter newWith: 'movies1.txt'. container registerComponentInterface: MovieFinderInterface implementation: ColonMovieFinder params: finderParams. container registerComponentImplementation: MovieLister ^container to be used like this... ConstructorInjectionTest >> testWithContainer container := ConstructorInjectionContainer new. lister := container getComponentInstance( MovieLister ). movies = lister moviesDirectedBy: 'Sergio Leone'. self assert: (movies includes: 'Once Upon a Time in the West') The article poorly defines registerComponentXXX: or getComponentInstance: methods, so I don't dwell on them. I presume its little relevant to the main theme. ##SETTER INJECTION MovieLister >> setFinder: aFinder finder := aFinder. ColonMovieFinder >> setFilename: aFilename filename := aFilename. SetterInjectionTest >> testWithConfigurationFile ctx := SomeXmlApplicationConfiguration on: 'config.xml'. lister := ctx getConfigOf: 'MovieLister'. movies = lister moviesDirectedBy: 'Sergio Leone'. self assert: (movies includes: 'Once Upon a Time in the West') ##INTERFACE INJECTION MovieLister >> injectFinder: aFinder finder := aFinder ColonMovieFinder >> injectFilename: aFilename filename := aFilename InterfaceInjectionTest >> configureContainer container := InterfaceInjectionContainer new. self registerComponents. self registerInjectors. container start. InterfaceInjectionTest >> registerComponents container registerComponent: 'MovieLister' with: MovieLister. container registerComponent: 'MovieFinder' with: ColonMovieFinder. InterfaceInjectionTest >> registerInjectors container registerInjector: Injector with: (container lookup: 'MovieFinder'). container registerInjector: InjectorFinderFilename with: FinderFilenameInjector new. ColonMovieFinder >> inject: anObject anObject injectFinder: self. FinderFilenameInjector >> inject: anObject anObject injectFilename: 'movies1.txt'. InterfaceInjectionTester >> testInterface self configureContainer. lister := container lookup: 'MovieLister'. movies = lister moviesDirectedBy: 'Sergio Leone'. self assert: (movies includes: 'Once Upon a Time in the West') The article doesn't define InterfaceInjectionContainer, but I guess it could look like this... InterfaceInjectionContainer >> registerComponent: componentName with: aComponent container ifNil: [ container := Dictionary new]. container at: componentName put: aComponent InterfaceInjectionContainer >> lookup: componentName ^ container at: componentName ##SERVICE LOCATOR "The basic idea behind a service locator is to have an object that knows how to get hold of all of the services that an application might need. So a service locator for this application would have a method that returns a movie finder when one is needed. Of course this just shifts the burden a tad, we still have to get the locator into the lister" MovieLister >> initialize finder := ServiceLocator movieFinder. Object subclass: ServiceLocator instanceVariable: 'movieFinder' classVariable: 'SoleInstance' ServiceLocator class >> load: aServiceLocator SoleInstance := aServiceLocator ServiceLocator class >> soleInstance ^ SoleInstance ServiceLocator class >> movieFinder ^ self soleInstance movieFinder ServiceLocator >> movieFinder ^movieFinder ServiceLocatorTest >> configure ServiceLocator load: (ServiceLocator newWith: (ColonMovieFinder newWith: 'movies1.txt')) ServiceLocator class >> newWith: aMovieFinder ^ self basicNew initializeWithFinder: aMovieFinder ServiceLocator >> initializeWithFinder: aMovieFinder movieFinder := aMovieFinder ServiceLocatorTest >> testSimple self configure. lister := MovieLister new. movies = lister moviesDirectedBy: 'Sergio Leone'. self assert: (movies includes: 'Once Upon a Time in the West') So it seems that a service locator is just a Singleton pattern having a class variable for each service of interest ?? So in good faith** I ask... "Is it any more complicated than that?" **Since its taken me a couple of hours to convert the Java to this point so I stopped reading to seek your feedback. Is that enough insight to adapt to your needs, or is there something else further down the article that invalidates my analysis? > > From ben: > > "I'm not really familiar with IoC or DI patterns, so just taking your >> example at face value, in Pharo I'd do... >> >> MovieLister>>moviesDirectedBy: director >> allMovies := finder allMovies. >> ^ allMovies select: [ :movie | movie getDirector = director ]. >> "although typically #getDirector would be renamed #director" >> >> MovieLister>>finder: movieFinder >> finder := movieFinder. >> >> to be used like this... >> lister := MovieLister new finder: (ColonDelimitedMovieFinder on: >> 'movies1.txt'). >> movies := lister moviesDirectedBy: 'Tarantino'." > > So per Fowler, the above is equivalent to "Setter Injection with Spring" > > and Stephane: > > Why don't you simply pass the class and use that class in your MovieLister? >> >> MovieLister new >> finderClass: MySuperCoolFinderClass >> >> ... >> MovieLister finder >> finderClass new ..... >> >> What is wrong with that. > > > That was what I meant when I said: "I know that in Smalltalk I can make > MovieLister to receive, upon construction, a class representing MovieFinder > and call it construction message.". The code I had in mind is a bit of > mix from the one provided by you both: > > MovieLister>>moviesDirectedBy: director > allMovies := finder allMovies. > ^ allMovies select: [ :movie | movie getDirector = director ]. > "although typically #getDirector would be renamed #director" > > MovieLister>>finder: aMovieFinderBuilder > finder := aMovieFinderClass new. > > to be used like this... > lister := MovieLister new finder: (ColonDelimitedMovieFinder > builderOn: 'movies1.txt'). > movies := lister moviesDirectedBy: 'Tarantino'." > > But that means I will have to wire dependencies by hand whenever I create > a MovieLister and seek through code when and if those dependencies change. > When there are lot's of dependencies it's is a considerable and tedious > work. Let's see an image from Fowlers article: > > [image: Inline image 1] > > In this case, the service locator provides me with an instance and I > configure the instance in the assembler, the scheme is alike for an IoC, > and that would mean my implementation could be like this: > > > MovieLister>>moviesDirectedBy: director > allMovies := finder allMovies. > ^ allMovies select: [ :movie | movie getDirector = director ]. > "although typically #getDirector would be renamed #director" > > MovieLister>>initialize > finder := ServiceLocator locate: FinderClass <--- This would bring > the instance of finder class configured by the assembler > No, like this... finder := ServiceLocation movieFinder. Now if you want to store a class rather than an instance as I did higher up, you just do this... Object subclass: ServiceLocator instanceVariable: 'movieFinderClass' classVariable: 'SoleInstance' ServiceLocator class >> movieFinder ^ self soleInstance movieFinderClass new > > > to be used like this... > lister := MovieLister new. > movies := lister moviesDirectedBy: 'Tarantino'." > > and the assembler: > > Assember class>>configure: > aMap put: (ColonDelimitedMovieFinder builderOn: 'movies1.txt') at: > FinderClass > Assembler class>>configure ServiceLocator load: (ServiceLocator new movieFinder: (ColonMovieFinder newWith: 'movies1.txt') otherService: MyCustomService new) > > My assembler and service locator could be even more elaborated, and > provide a different MovieFinder in test scope, for different classes or > wharever. > Really, the test should not be updating the class variable global like this... ServiceLocatorTest >> configure ServiceLocator load: (ServiceLocator newWith: (ColonMovieFinder newWith: 'movies1.txt')) you probably want something like (its rough but shows the point...) Object subclass: #MovieLister instanceVariables: 'serviceLocator' MovieLister >> initialize serviceLocator ifNil: [ serviceLocator := ServiceLocator soleInstance ]. finder := serviceLocator movieFinder. MovieLister class >> newWithServiceLocator: aServiceLocator ^ (self basicNew initializeWithServiceLocator: aServiceLocator) initialize. MovieLister >> initializeWithServiceLocator: aServiceLocator serviceLocator := aServiceLocator ServiceLocatorTest >> testSimple2 lister := MovieLister newWithServiceLocator: (ServiceLocator newWith: (ColonMovieFinder newWith: 'movies1.txt')). movies = lister moviesDirectedBy: 'Sergio Leone'. self assert: (movies includes: 'Once Upon a Time in the West') cheers -ben > > It is a little convenience for Smalltalk, I will give that, but I was > wandering if there was something alike in Pharo, by your answers I assuming > there is nothing like that. > > > > On Mon, Jun 5, 2017 at 6:41 AM, Stephane Ducasse <stepharo.self(a)gmail.com> > wrote: > >> Why don't you simply pass the class and use that class in your >> MovieLister? >> >> MovieLister new >> finderClass: MySuperCoolFinderClass >> >> ... >> MovieLister finder >> finderClass new ..... >> >> What is wrong with that. >> >> If you do not want to have a reference at runtime to a Finder then you >> need to use announcement and registration. >> >> Stef >> >> >> >> On Sun, Jun 4, 2017 at 11:17 PM, Vitor Medina Cruz <vitormcruz(a)gmail.com> >> wrote: >> > Hello, >> > >> > I would like to know how people in Pharo ecosystem do to deal with >> object >> > wiring, as described by Marting Fowler in >> > https://martinfowler.com/articles/injection.html#FormsOfDepe >> ndencyInjection: >> > >> > "A common issue to deal with is how to wire together different >> elements: how >> > do you fit together this web controller architecture with that database >> > interface backing when they were built by different teams with little >> > knowledge of each other." >> > >> > He gives an example, I will leave it in java as it is simple enough to >> > understand: >> > >> > "class MovieLister... >> > >> > public Movie[] moviesDirectedBy(String arg) { >> > List allMovies = finder.findAll(); >> > for (Iterator it = allMovies.iterator(); it.hasNext();) { >> > Movie movie = (Movie) it.next(); >> > if (!movie.getDirector().equals(arg)) it.remove(); >> > } >> > return (Movie[]) allMovies.toArray(new Movie[allMovies.size()]); >> > >> > }" >> > >> > The question is how to provide the finder object in a decoupled matter, >> a >> > naive approach would be: >> > >> > " private MovieFinder finder; >> > >> > public MovieLister() { >> > finder = new ColonDelimitedMovieFinder("movies1.txt"); >> > >> > }" >> > >> > Which couples the MovieLister to the specific ColonDelimitedMovieFinder >> > class. >> > >> > Fowler explains how to decouple using an IoC framework or a Service >> Locator. >> > In Java and .Net IoC is used most of the time. I Googled how this >> problem is >> > approached in Smalltalk/Pharo, and I generally I found answers "that is >> easy >> > to do in Smalltalk, so there is no need of a framework", what I miss is >> a >> > description on *how* to do that: >> > >> > https://stackoverflow.com/questions/243905/smalltalk-and-ioc >> > https://stackoverflow.com/questions/2684326/is-there-a-depen >> dency-injection-framework-for-smalltalk >> > https://stackoverflow.com/questions/243905/smalltalk-and-ioc >> /347477#347477 >> > >> > I know that in Smalltalk I can make MovieLister to receive, upon >> > construction, a class representing MovieFinder and call it construction >> > message. As long an object that responds to this message is provided, I >> can >> > create as many derivations I want and the MovieLister will be decoupled >> from >> > the MovieFinder. That way, however, I still have to wire things by >> hand, and >> > I am not sure if this is what I am supposed to do in order to solve the >> > decouple problem. >> > >> > Can you explain me how this is done in Pharo? It's is usually wiring by >> > hand? Is there a simple construction that deals with the wiring problem >> that >> > I cannot foresee? >> > >> > Thanks in advance, >> > Vitor >> > >> > >> > >> >> >

June 5, 2017

Re: [Pharo-users] STON Question

by Offray Vladimir Luna CÃ¡rdenas

Hi, Maybe what I'm doing in Grafoscopio could help. I have a %metadata node which contains all configuration options for the production of the document (as shown in the image below). Exporting a document consist in looking for these nodes while traversing the notebook tree and applying that options in the proper place. You can see the source code of the current notebook STON file at [1], the exported markdown file at [2] and the exported PDF at [3]. As you can see I have pretty good control of the configuration of the document using this option (and a single place to manage all, without endless small files and folders for a document, but event that exporting options as split folders and docs, could be added also). [1] http://mutabit.com/repos.fossil/grafoscopio/artifact/fb25442038a0d4a1 [2] http://mutabit.com/repos.fossil/grafoscopio/artifact?name=59245142cf93590b&… [3] http://mutabit.com/repos.fossil/grafoscopio/doc/tip/Docs/En/Books/Manual/ma… Cheers, Offray On 05/06/17 01:58, Stephane Ducasse wrote: > Sven I know what Ston is :) > > Now Pillar dev used Ston as input and it works. Then with some hooks > they let the user convert the strings > into specific objects and this is ok. > Now I want to add export in Ston and for configurations I need to > control for the application and not as a ston object the value saved. > For example a file reference should not be just a file reference in > Ston but > a string relative the the baseDirectory of the configuration. > > So I thought that I can build a hook and control the call to Ston > (convert the object before to the correct values) and export. > It should be working now doing this I found myself redoing the output > of Ston. > So I will do it. Then I thought that may be I could reuse this logic. > > Stef > > > > On Sun, Jun 4, 2017 at 11:49 PM, Sven Van Caekenberghe <sven(a)stfx.eu > <mailto:sven@stfx.eu>> wrote: > > Stef, > > STON is like FUEL, it can write any object to a stream and read it > back. Although you can customise how this is done, only one way of > doing so is supported (i.e. you cannot change the format for each > application). > > People have used STON for various applications now, including for > configuration stuff (because it is a textual format that is easy > to read). > > I would suggest you just try to see what your config looks like > once you have the objects in Pharo. > > STON toStringPretty: myConfig. > > Then we can see how to tune the representation. > > Sven > > > On 4 Jun 2017, at 22:58, Stephane Ducasse > <stepharo.self(a)gmail.com <mailto:stepharo.self@gmail.com>> wrote: > > > > Hi sven > > > > I'm working on a new configuration frameworks similar to the one > use pillar.conf. > > > > So basically I have > > > > ston := '{ > > "newLine":#unix, > > "separateOutputFiles":true > > }'. > > and I want to recreate it. > > > > So I did > > > > Object >> toConfigurationString > > > > ^ STON toString: self > > > > SimpleConfiguration >> exportStream > > > > ^ String streamContents: [ :str | > > str << '{' . > > self propertiesKeysAndValuesDo: [ :key :value| > > str << key toConfigurationString. > > str << ':'. > > str << value toConfigurationString. > > str << ','. > > str lf. > > ]. > > str << '}'. > > str contents > > ] > > > > The idea is that for special configuration values people should > be able to define > > how to go from the object to configuration. > > For example for some FileReference I want to have just the path > up to the baseDirectory. > > > > Now I wonder if I could not better reuse ston. > > I saw the stonOn: > > but I did not look further because I was wondering how the > writer where passed. > > > > Any feedback is welcome. > > > > Stef (now bed time). > > > > >

June 5, 2017