June 2017 - Pharo-users - lists.pharo.org

Re: [Pharo-users] [ARTICLE] Quick write me a Redis client

by Sven Van Caekenberghe

> On 15 Jun 2017, at 00:20, Tim Mackinnon <tim(a)testit.works> wrote: > > Hi Sven - another nice article. > > 2 small typos I spotted: Fixed, thanks ! > 1) requests) from the client to the server are sent as a array of bulk strings > > Should be > > requests) from the client to the server are sent as an array of bulk strings > > 2) to interact with as much services and servers as possible > > Is better as > > to interact with as many services and servers as possible > > > Tim > > Sent from my iPhone > > On 14 Jun 2017, at 13:31, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > >> Hi, >> >> I wrote another article in the 'Concerning Pharo' publication: >> >> [TITLE] Quick write me a Redis client >> [SUBTITLE] A beautiful protocol makes implementation easy >> [URL] https://medium.com/concerning-pharo/quick-write-me-a-redis-client-5fbe4ddfb… >> [SOURCECODE] https://github.com/svenvc/SimpleRedisClient >> >> Sven >> >> >> -- >> Sven Van Caekenberghe >> Proudly supporting Pharo >> http://pharo.org >> http://association.pharo.org >> http://consortium.pharo.org >> >> >> >> >>

June 15, 2017

Re: [Pharo-users] Help in thinking about how to save a "program"

by Glenn Hoetker

Hi Stephan, Thank you for the helpful info and nice welcome to the Pharo community. Iâd not been using Citezen. Since your email, Iâve found the Smalltalkhub site for it and had two quick questions. 1. Is it compatible with Pharo 6? 2. Is there a manual or getting started document you could point me to? (I love the ability in Pharo to peruse well-documented classes and methods in a package, but for a new user and big package, itâs hard to get started!). Iâve made the jump to creating a class with methods for my small script. Less work than I thoughtâitâs really just a change of thinking. Again, thank you. Glenn Glenn Hoetker ghoetker(a)me.com <mailto:ghoetker@me.com> http://hoetker.faculty.asu.edu <http://hoetker.faculty.asu.edu/> > On Jun 13, 2017, at 10:53 PM, Stephane Ducasse <stepharo.self(a)gmail.com <mailto:stepharo.self@gmail.com>> wrote: > > Hi glenn > > Do you use Citezen to parse? > I create a class and put the script as methods and save. You should > kill script as fast as possible > up the give birth to nice method. > > GHBibDesk new loadFrom: '' > GHBibDesk new analysis > > should be your scripts :) > :) > > > On Mon, Jun 12, 2017 at 1:22 AM, Glenn Hoetker <ghoetker(a)me.com <mailto:ghoetker@me.com>> wrote: >> Hi all. Iâm new to Pharo and loving it. As I transition from a text-file >> based mindset, Iâm a little stuck and would appreciate help in how to think >> about a situation in a Pharonic (Pharo-ish, Pharoc?) way. >> >> Iâm crafting a short program to help me process a large text file >> (specifically: extract, sorting, and regularizing the âkeywordâ fields of a >> large BibTex file). Especially since I donât really know what Iâm doing, >> working in a Playground has been a great development environment. Now that >> the program is complete (under 30 lines, wonderful), I want to be able to >> save it for future reference (and perhaps for future use). If Iâd written a >> shell script, Iâd just save âfixBibDeskKeyWords.shâ to a directory. Iâm not >> sure what to do in the Pharo environment, thought. >> >> At the moment, it just lives in the Playground Iâve developed it on. I >> could save the image and leave that Playground open, but Iâm just positive >> thatâs not a best practice. I also worry about what happens if I >> closed/cleared that Playground by accident. >> >> I think I understand that, if I created a new package, I could use >> Monticello to save it to a local cache and load it into a new image whenever >> I needed it. But, given that itâs short, highly specialized and fairly >> linear, the idea of creating a âGHBibDeskStuffâ package with one class >> (âGBibDeskKeywordFixerâ containing a single âFixFileâ method seems really >> heavy and awkward. >> >> Can one save the contents of a Playground in a Pharonic way? Is there a >> better approach? >> >> Thank you to all involved in this wonderful programming ecosystem. I >> appreciate any advice. >> >> Glenn >> >> Glenn Hoetker >> ghoetker(a)me.com <mailto:ghoetker@me.com> >> http://hoetker.faculty.asu.edu >> >> >> >

June 14, 2017

Re: [Pharo-users] Help in thinking about how to save a "program"

by Glenn Hoetker

H Offray, Thanks for the helpful reply and nice welcome to the Pharo community. Grafoscopio looks wonderful and the Panama Papers application of it, in particular, is really impressive. I look forward to experimenting with it. Best wishes, Glenn p.s. Previously, I had actually Googled my way Grafoscopioâs Spanish language site and wasnât aware it had a corresponding English site. Perhaps a link between the English/Spanish sites would be helpful for some? If I just overlooked such a link, sorry to mention it. Glenn Hoetker ghoetker(a)me.com <mailto:ghoetker@me.com> http://hoetker.faculty.asu.edu <http://hoetker.faculty.asu.edu/> > On Jun 14, 2017, at 2:10 PM, Offray Vladimir Luna CÃ¡rdenas <offray.luna(a)mutabit.com <mailto:offray.luna@mutabit.com>> wrote: > > Hi Glenn, > > I made also the transition for the plain "dead" text-files based mindset to live objects. My approach to bridge these two words was to create Grafoscopio [1], where I can save my scripts and put them inside a broader context/narrative. This environment let's me go from scripting/files to objects / code browser and back and I have found this is useful for non programmers (researchers, hacktivists, journalist), because they can have a notebook for their explorations. For example, recently we started a pretty specific project at [2] using this interactive notebook + code browser approach (see screenshot attached below). > [1] http://mutabit.com/grafoscopio/index.en.html <http://mutabit.com/grafoscopio/index.en.html> > [2] http://smalltalkhub.com/#!/~Offray/DPYA <http://smalltalkhub.com/#!/~Offray/DPYA> > > <hmnillffiajnlhpp.png> > > If you're interested in Grafoscopio, please follow the manual and take into account that now we're trying to migrate to Pharo 6. > > Cheers, > > Offray > > On 11/06/17 18:22, Glenn Hoetker wrote: >> Hi all. Iâm new to Pharo and loving it. As I transition from a text-file based mindset, Iâm a little stuck and would appreciate help in how to think about a situation in a Pharonic (Pharo-ish, Pharoc?) way. >> >> Iâm crafting a short program to help me process a large text file (specifically: extract, sorting, and regularizing the âkeywordâ fields of a large BibTex file). Especially since I donât really know what Iâm doing, working in a Playground has been a great development environment. Now that the program is complete (under 30 lines, wonderful), I want to be able to save it for future reference (and perhaps for future use). If Iâd written a shell script, Iâd just save âfixBibDeskKeyWords.shâ to a directory. Iâm not sure what to do in the Pharo environment, thought. >> >> At the moment, it just lives in the Playground Iâve developed it on. I could save the image and leave that Playground open, but Iâm just positive thatâs not a best practice. I also worry about what happens if I closed/cleared that Playground by accident. >> >> I think I understand that, if I created a new package, I could use Monticello to save it to a local cache and load it into a new image whenever I needed it. But, given that itâs short, highly specialized and fairly linear, the idea of creating a âGHBibDeskStuffâ package with one class (âGBibDeskKeywordFixerâ containing a single âFixFileâ method seems really heavy and awkward. >> >> Can one save the contents of a Playground in a Pharonic way? Is there a better approach? >> >> Thank you to all involved in this wonderful programming ecosystem. I appreciate any advice. >> >> Glenn >> >> Glenn Hoetker >> ghoetker(a)me.com <mailto:ghoetker@me.com> >> http://hoetker.faculty.asu.edu <http://hoetker.faculty.asu.edu/> >> >> >> >

June 14, 2017

Re: [Pharo-users] [ARTICLE] Quick write me a Redis client

by Tim Mackinnon

Hi Sven - another nice article. 2 small typos I spotted: 1) requests) from the client to the server are sent as a array of bulk strings Should be requests) from the client to the server are sent as an array of bulk strings 2) to interact with as much services and servers as possible Is better as to interact with as many services and servers as possible Tim Sent from my iPhone > On 14 Jun 2017, at 13:31, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > > Hi, > > I wrote another article in the 'Concerning Pharo' publication: > > [TITLE] Quick write me a Redis client > [SUBTITLE] A beautiful protocol makes implementation easy > [URL] https://medium.com/concerning-pharo/quick-write-me-a-redis-client-5fbe4ddfb… > [SOURCECODE] https://github.com/svenvc/SimpleRedisClient > > Sven > > > -- > Sven Van Caekenberghe > Proudly supporting Pharo > http://pharo.org > http://association.pharo.org > http://consortium.pharo.org > > > > >

June 14, 2017

Re: [Pharo-users] Help in thinking about how to save a "program"

by Offray Vladimir Luna CÃ¡rdenas

Hi Glenn, I made also the transition for the plain "dead" text-files based mindset to live objects. My approach to bridge these two words was to create Grafoscopio [1], where I can save my scripts and put them inside a broader context/narrative. This environment let's me go from scripting/files to objects / code browser and back and I have found this is useful for non programmers (researchers, hacktivists, journalist), because they can have a notebook for their explorations. For example, recently we started a pretty specific project at [2] using this interactive notebook + code browser approach (see screenshot attached below). [1] http://mutabit.com/grafoscopio/index.en.html [2] http://smalltalkhub.com/#!/~Offray/DPYA If you're interested in Grafoscopio, please follow the manual and take into account that now we're trying to migrate to Pharo 6. Cheers, Offray On 11/06/17 18:22, Glenn Hoetker wrote: > Hi all. Iâm new to Pharo and loving it. As I transition from a > text-file based mindset, Iâm a little stuck and would appreciate help > in how to think about a situation in a Pharonic (Pharo-ish, Pharoc?) way. > > Iâm crafting a short program to help me process a large text file > (specifically: extract, sorting, and regularizing the âkeywordâ fields > of a large BibTex file). Especially since I donât really know what Iâm > doing, working in a Playground has been a great development > environment. Now that the program is complete (under 30 lines, > wonderful), I want to be able to save it for future reference (and > perhaps for future use). If Iâd written a shell script, Iâd just save > âfixBibDeskKeyWords.shâ to a directory. Iâm not sure what to do in the > Pharo environment, thought. > > At the moment, it just lives in the Playground Iâve developed it on. > I could save the image and leave that Playground open, but Iâm just > positive thatâs not a best practice. I also worry about what happens > if I closed/cleared that Playground by accident. > > I think I understand that, if I created a new package, I could use > Monticello to save it to a local cache and load it into a new image > whenever I needed it. But, given that itâs short, highly specialized > and fairly linear, the idea of creating a âGHBibDeskStuffâ package > with one class (âGBibDeskKeywordFixerâ containing a single âFixFileâ > method seems really heavy and awkward. > > Can one save the contents of a Playground in a Pharonic way? Is there > a better approach? > > Thank you to all involved in this wonderful programming ecosystem. I > appreciate any advice. > > Glenn > > Glenn Hoetker > ghoetker(a)me.com <mailto:ghoetker@me.com> > http://hoetker.faculty.asu.edu > > >

June 14, 2017

Re: [Pharo-users] About how to benchmark the lookup speed...

by werner kassens

On 06/14/2017 09:12 PM, Steven Costiou wrote: > repetitions timesRepeat:[ results add: [1000000 timesRepeat:[o m]] > timeToRun]. Hi Steven, the influence of the garbage collector is in cases like these often somewhat difficult to forecast. i would eventually change the code to: repetitions timesRepeat:[ Smalltalk garbageCollect. results add: [1000000 timesRepeat:[o m]] timeToRun]. and if i wanted to see the influence of the garbage collector i would enlarge repetitions and diminish 1000000 in such a way that the product remains constant. of course one would not want to destroy that influence completely as in the real world it always takes its toll. werner

June 14, 2017

Re: [Pharo-users] About how to benchmark the lookup speed...

by Steven Costiou

Thanks Peter :) I will make these computations tomorrow at the lab and see what the confidence interval looks like. Steven. Le 2017-06-14 20:03, PBKResearch a Ã©crit : > Steven > > The question you need to consider is how much the results vary from one repetition to another. If they are very variable, then the average will still be variable. In the case of your 100 repetitions, for instance, you can work out a confidence interval for the mean quite easily. Find the mean and standard deviation of the 100 repetitions; the standard error of the mean is the sample standard deviation divided by the square root of the number of values averaged (i.e. 10 in this case); the approximate 95% confidence interval is the mean +/- twice the standard error of the mean. (This makes a lot of simplifying assumptions, but should be sufficient for your purposes.) > > If, as I suspect, the width of the confidence interval is quite large in relation to the mean, this means that you cannot consistently measure the speed of operations like this. You could try greatly increasing the number of repetitions, but the square root law is working against you. 10,000 repetitions would give you an interval about 10% of the width of 100 repetitions, 1,000,000 repetitions would reduce it to 1%. > > Hope this is helpful > > Peter Kenny > > FROM: Pharo-users [mailto:pharo-users-bounces@lists.pharo.org] ON BEHALF OF Steven Costiou > SENT: 14 June 2017 18:14 > TO: Pharo users users <pharo-users(a)lists.pharo.org> > SUBJECT: [Pharo-users] About how to benchmark the lookup speed... > > Hi, > > i'm having trouble doing benchmarks in Pharo, at least i don't understand the results (maybe i'm missing something). I want to compare anonymous subclasses lookup speed with standard pharo classes lookup speed. > > I have a method m and a method m2 that execute the following code: ^ 100 printString. I have implemented these 2 methods in one class then in one anonymous subclass. I thought that measuring the execution speed of the same code in these two different cases would give me different times if the lookup speed was not the same. > > So I did the following: > > |o results repetitions | > > o := theClass new. > > results := OrderedCollection new. > > repetitions := 100. > > repetitions timesRepeat:[ results add: [1000000 timesRepeat:[o m]] timeToRun]. > > I do the same for m2, and then i compute an average of all the values measured in results. > > What i don't understand is that, for example, for an average on 100 measurements, m is 1% slower and m2 is 2% faster in the Pharo class case than with anonymous subclasses. But for 1 000 measurements, m is 11% faster but m2 is 3% slower. Results continue to vary as i change the number of measurements, but they do not increase with it (seems not to be linear). > > I don't have enough knowledge about how to benchmark code, or what will make a difference in Pharo. For now the only explanations i have is that maybe the results are too slow to be significant and then they can vary, or i have done something wrong in how i measure it. > > How would you measure the lookup speed of a method ? > > Steven.

June 14, 2017

Re: [Pharo-users] About how to benchmark the lookup speed...

by PBKResearch

Steven The question you need to consider is how much the results vary from one repetition to another. If they are very variable, then the average will still be variable. In the case of your 100 repetitions, for instance, you can work out a confidence interval for the mean quite easily. Find the mean and standard deviation of the 100 repetitions; the standard error of the mean is the sample standard deviation divided by the square root of the number of values averaged (i.e. 10 in this case); the approximate 95% confidence interval is the mean +/- twice the standard error of the mean. (This makes a lot of simplifying assumptions, but should be sufficient for your purposes.) If, as I suspect, the width of the confidence interval is quite large in relation to the mean, this means that you cannot consistently measure the speed of operations like this. You could try greatly increasing the number of repetitions, but the square root law is working against you. 10,000 repetitions would give you an interval about 10% of the width of 100 repetitions, 1,000,000 repetitions would reduce it to 1%. Hope this is helpful Peter Kenny From: Pharo-users [mailto:pharo-users-bounces@lists.pharo.org] On Behalf Of Steven Costiou Sent: 14 June 2017 18:14 To: Pharo users users <pharo-users(a)lists.pharo.org> Subject: [Pharo-users] About how to benchmark the lookup speed... Hi, i'm having trouble doing benchmarks in Pharo, at least i don't understand the results (maybe i'm missing something). I want to compare anonymous subclasses lookup speed with standard pharo classes lookup speed. I have a method m and a method m2 that execute the following code: ^ 100 printString. I have implemented these 2 methods in one class then in one anonymous subclass. I thought that measuring the execution speed of the same code in these two different cases would give me different times if the lookup speed was not the same. So I did the following: |o results repetitions | o := theClass new. results := OrderedCollection new. repetitions := 100. repetitions timesRepeat:[ results add: [1000000 timesRepeat:[o m]] timeToRun]. I do the same for m2, and then i compute an average of all the values measured in results. What i don't understand is that, for example, for an average on 100 measurements, m is 1% slower and m2 is 2% faster in the Pharo class case than with anonymous subclasses. But for 1 000 measurements, m is 11% faster but m2 is 3% slower. Results continue to vary as i change the number of measurements, but they do not increase with it (seems not to be linear). I don't have enough knowledge about how to benchmark code, or what will make a difference in Pharo. For now the only explanations i have is that maybe the results are too slow to be significant and then they can vary, or i have done something wrong in how i measure it. How would you measure the lookup speed of a method ? Steven.

June 14, 2017

About how to benchmark the lookup speed...

by Steven Costiou

Hi, i'm having trouble doing benchmarks in Pharo, at least i don't understand the results (maybe i'm missing something). I want to compare anonymous subclasses lookup speed with standard pharo classes lookup speed. I have a method m and a method m2 that execute the following code: ^ 100 printString. I have implemented these 2 methods in one class then in one anonymous subclass. I thought that measuring the execution speed of the same code in these two different cases would give me different times if the lookup speed was not the same. So I did the following: |o results repetitions | o := theClass new. results := OrderedCollection new. repetitions := 100. repetitions timesRepeat:[ results add: [1000000 timesRepeat:[o m]] timeToRun]. I do the same for m2, and then i compute an average of all the values measured in results. What i don't understand is that, for example, for an average on 100 measurements, m is 1% slower and m2 is 2% faster in the Pharo class case than with anonymous subclasses. But for 1 000 measurements, m is 11% faster but m2 is 3% slower. Results continue to vary as i change the number of measurements, but they do not increase with it (seems not to be linear). I don't have enough knowledge about how to benchmark code, or what will make a difference in Pharo. For now the only explanations i have is that maybe the results are too slow to be significant and then they can vary, or i have done something wrong in how i measure it. How would you measure the lookup speed of a method ? Steven.

June 14, 2017

Re: [Pharo-users] Zink geo location data reading

by Sven Van Caekenberghe

Hi, > On 14 Jun 2017, at 17:23, bachitoph <cj-bachinger(a)gmx.de> wrote: > > Hi, > I'm playing around with Zink reading the geo location of any IP-address. > Evaluating the code below in a playground works fine. But what is the best > way to read the entity data of the ZnResponse instance I get back. Have I to > parse it, with an self written parser, or is there anything available. > > |client znResponse location| > client := ZnClient new. > client host: 'www.geoplugin.net'. > client addPathSegment: 'php.gp'. > client queryAt: 'ip' put: '188.194.228.195'. > znResponse := client get; response. > > The code should anyhow look like this. > AnyParser parse: (ReadStream on: znResponse contents). > > In PHP the example code is at http://www.geoplugin.com/webservices/php > var_export(unserialize(file_get_contents('http://www.geoplugin.net/php.gp?ip=188.194.228.195] > I'm searching for the unserialize of the php, which delivers an array with > key value pairs. The result looks to be PHP's own serialisation format as described here: http://php.net/manual/en/function.serialize.php See the first comment which describes the format a bit. I don't know if anyone ever implemented a parser for that. You will most probably have to write it yourself. However, the service you are using can also return its results in JSON, which we can parse out of the box. |client znResponse location| client := ZnClient new. client host: 'www.geoplugin.net'. client addPathSegment: 'json.gp'. client queryAt: 'ip' put: '188.194.228.195'. client contentReader: [ :entity | STONJSON fromString: entity contents ]. znResponse := client get; contents. HTH, Sven PS: it is Zinc not Zink ;-) > The response entity contents looks somehow like the bottom string without > the newlines. > 'a:18:{ > s:17:"geoplugin_request";s:15:"188.194.228.195"; > s:16:"geoplugin_status";i:200; > s:16:"geoplugin_credit";s:145:"Some of the returned data includes GeoLite > data created by MaxMind, available from http://www.maxmind.com > <\'http://www.maxmind.com\'> ."; > s:14:"geoplugin_city";s:6:"Passau"; > s:16:"geoplugin_region";s:7:"Bavaria"; > s:18:"geoplugin_areaCode";s:1:"0"; > s:17:"geoplugin_dmaCode";s:1:"0"; > s:21:"geoplugin_countryCode";s:2:"DE"; > s:21:"geoplugin_countryName";s:7:"Germany"; > s:23:"geoplugin_continentCode";s:2:"EU"; > s:18:"geoplugin_latitude";s:7:"48.5833"; > s:19:"geoplugin_longitude";s:7:"13.4833"; > s:20:"geoplugin_regionCode";s:2:"02"; > s:20:"geoplugin_regionName";s:7:"Bavaria"; > s:22:"geoplugin_currencyCode";s:3:"EUR"; > s:24:"geoplugin_currencySymbol";s:7:"€"; > s:29:"geoplugin_currencySymbol_UTF8";s:3:"â¬"; > s:27:"geoplugin_currencyConverter";s:6:"0.9348";}' > > Thanks for any help > cjb > > > > > > -- > View this message in context: http://forum.world.st/Zink-geo-location-data-reading-tp4951446.html > Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. >

June 14, 2017