June 2016 - Pharo-users - lists.pharo.org

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by PBKResearch

Hello I have used Soup, but I now prefer XMLHTMLParser, because I find it easier to relate the structure of the XML output to that of the original web page. It is also possible to use XPath to locate the target area more quickly. I particularly like Montyâs âSmalltalkishâ adaptation of XPath (see the last para of the class comment to XPath). Hope this helps Peter Kenny From: Pharo-users [mailto:pharo-users-bounces@lists.pharo.org] On Behalf Of stepharo Sent: 27 June 2016 10:03 To: pharo-users(a)lists.pharo.org Subject: Re: [Pharo-users] If you have to do web data scraping, what tool would you use? I scrapped all the magic cards (bad bad practice) using Soup. It could be easier but it worked for me. This is why I maintain it and added tests. Stef Le 26/6/16 Ã 23:14, Bernardo Ezequiel Contreras a Ã©crit : Hi, Imagine that you have to do some data scraping work, what tool would you use? I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else that i'm not aware of it? thanks. -- Bernardo E.C. Sent from a cheap desktop computer in South America.

June 27, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by stepharo

I scrapped all the magic cards (bad bad practice) using Soup. It could be easier but it worked for me. This is why I maintain it and added tests. Stef Le 26/6/16 Ã 23:14, Bernardo Ezequiel Contreras a Ã©crit : > Hi, > Imagine that you have to do some data scraping work, what tool would > you use? > I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else > that i'm not aware of it? > > thanks. > > > -- > Bernardo E.C. > > Sent from a cheap desktop computer in South America.

June 27, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by Pierce Ng

On Sun, Jun 26, 2016 at 06:14:50PM -0300, Bernardo Ezequiel Contreras wrote: > Imagine that you have to do some data scraping work, what tool would you > use? > I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else that > i'm not aware of it? I used Todd Blanchard's HTML parser back in Squeak 3.x days and found it very nice. Not sure about compatibility with current Pharo though. http://smalltalkhub.com/#!/~ToddBlanchard/HTMCSSValidatingParser Pierce

June 27, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by Tudor Girba

Hi, Could you provide more details about the use case? Cheers, Doru > On Jun 26, 2016, at 11:14 PM, Bernardo Ezequiel Contreras <vonbecmann(a)gmail.com> wrote: > > Hi, > Imagine that you have to do some data scraping work, what tool would you use? > I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else that i'm not aware of it? > > thanks. > > > -- > Bernardo E.C. > > Sent from a cheap desktop computer in South America. -- www.tudorgirba.com www.feenk.com "If you can't say why something is relevant, it probably isn't."

June 27, 2016

[dtabase] Looking for a report band editor

by sitepublique＠free.fr

Hi, I'm new with pharo and smalltalk and I would like to use it to start a new database application. But I need to find out a report band editor and I can't find anything about this into the pharo projets catalog... A report band exxemple is like : XtraReports : https://documentation.devexpress.com/#XtraReports/CustomDocument2590 Lazreport (LAzarus/pascal) : http://wiki.lazarus.freepascal.org/LazReport_Tutorial etc. Do you know a report band editor with pharo (or other smalltalk implementation ?) Thank you for your help.

June 27, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by Andy Burnett

I had a similar question, which led me to the Webdriver project (now part of selenium). I haven't done any experiments yet, but the idea of driving the browser via its API is appealing. The Parasol project says it is a Webdriver implementation for Pharo, and it looks quite exciting. The build is currently failing, but that seems to be a gemstone problem. https://github.com/SeasideSt/Parasol/blob/master/README.md If you have time to play with it I would love to hear your experience. Cheers Andy >

June 27, 2016

Re: [Pharo-users] Styling a Pharo UI application

by Offray Vladimir Luna CÃ¡rdenas

+1 :) Offray On 26/06/16 02:56, stepharo wrote: > > + 1 > > Stef > >> Tommaso, >> >> can you give some concrete examples of what it is that you wanted to >> do to refine your application and that was really hard (or >> impossible) to do with Spec? >> >> As long as we do not know what is wrong, we cannot fix it. >> >> As long as we do not know what important things are wrong, we cannot >> prioritize. >> >> -- >> Does this mail seem too brief? Sorry for that, I donât mean to be >> rude! Please see http://emailcharter.org . >> >> Johan Fabry - http://pleiad.cl/~jfabry <http://pleiad.cl/%7Ejfabry> >> PLEIAD and RyCh labs - Computer Science Department (DCC) - >> University of Chile >> >>> On Jun 25, 2016, at 15:54, Tommaso Dal Sasso >>> <tommaso.dalsasso(a)gmail.com <mailto:tommaso.dalsasso@gmail.com>> wrote: >>> >>> The beauty that I am looking for as a developer for has to do with >>> the code and the API. I consider important how fast I am able to >>> prototype a working example --in this Spec is excellent-- and how >>> much I can extend the code to refine my application --in this Spec >>> is really hard to use--. >> >

June 26, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by Offray Vladimir Luna CÃ¡rdenas

Hi Bernardo, On 26/06/16 16:14, Bernardo Ezequiel Contreras wrote: > Hi, > Imagine that you have to do some data scraping work, what tool would > you use? > I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else > that i'm not aware of it? > > thanks. > No that I'm aware of. This combination in a live coding environment like Pharo has been really empowering for me. Cheers, Offray

June 26, 2016

If you have to do web data scraping, what tool would you use?

by Bernardo Ezequiel Contreras

Hi, Imagine that you have to do some data scraping work, what tool would you use? I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else that i'm not aware of it? thanks. -- Bernardo E.C. Sent from a cheap desktop computer in South America.

June 26, 2016

Re: [Pharo-users] Image freezes on Linux if it was previously saved on Windows

by Nicolai Hess

Hm, I don't know what exactly happens. It seems this behavior started with Pharo 50574. Since that image version, the UUIDGenerator will be reset on startup. Maybe the initialization of the uuidgenerator (or the random seed) will access the filesystem and at this step the file system initialization traps into an infinit loop. What I don't understand is, why this only happens when the image was saved on a windows platform and reopened on a unix platform. Maybe, saving the image (or the shutDownList) does not fully cleanup the platform settings. Please open a bug entry. 2016-06-25 17:17 GMT+02:00 Maximiliano Tabacman via Pharo-users < pharo-users(a)lists.pharo.org>: > > > ---------- Weitergeleitete Nachricht ---------- > From: Maximiliano Tabacman <mtabacman(a)yahoo.com> > To: Any Question About Pharo Is Welcome <pharo-users(a)lists.pharo.org> > Cc: > Date: Sat, 25 Jun 2016 15:16:27 +0000 (UTC) > Subject: Image freezes on Linux if it was previously saved on Windows > Hi. I am not sure if this issue is known, or what files to provide to help > fix it. > In the latest image (60112, but my guess is that this will happen with all > Pharo 6 images) if I download a clean latest image, start Pharo on Windows, > save the image, then copy it to a Linux environment, and try to start it, > the image freezes even before displaying the workspace (I get an > unresponsive black and white box in Linux, only killable through xkill > command). > I am sure this did not happen back with Pharo 5. > If I output "./pharo Image.image > log.txt" I end up with a huge file > since there seems to be an infinite loop while trying to determine the > FileStore to use. > > The first lines of this output file, before going into the loop, are: > > out of memory > > /home/theUser/Downloads/Pharo6/pharo > pharo VM version: 5.0 #1 Tue Jun 21 12:37:33 CEST 2016 gcc 4.6.3 > [Production Spur ITHB VM] > Built from: CoInterpreter VMMaker.oscog-HolgerHansPeterFreyther.1880 uuid: > 16138eb3-2390-40f5-a6c8-15f0494936f8 Jun 21 2016 > With: StackToRegisterMappingCogit > VMMaker.oscog-HolgerHansPeterFreyther.1880 uuid: > 16138eb3-2390-40f5-a6c8-15f0494936f8 Jun 21 2016 > Revision: https://github.com/pharo-project/pharo-vm.git Commit: > 9638b0190a9fc01479bfb752becd96edfd253c8c Date: 2016-06-21 12:29:26 +0200 > By: GitHub <noreply(a)github.com> Jenkins build #594 > Build host: Linux pharo-linux 3.2.0-31-generic-pae #50-Ubuntu SMP Fri Sep > 7 16:39:45 UTC 2012 i686 i686 i386 GNU/Linux > plugin path: /home/theUser/Downloads/Pharo6/ [default: > /home/theUser/Downloads/Pharo6/] > > > C stack backtrace & registers: > *./pharo[0x80c133c] > ./pharo(error+0x17)[0x80c1547] > ./pharo[0x809a26c] > ./pharo[0x809a301] > ./pharo[0x809a53d] > ./pharo[0x809bf13] > ./pharo[0x80a6b61] > ./pharo[0x80ae4ca] > ./pharo[0x80ae6ba] > ./pharo[0x80af07f] > ./pharo[0x80afcf4] > ./pharo(ceSendsupertonumArgs+0x1d8)[0x80b0098] > [0x990008d] > [0x990de03] > [0x99090af] > [0x9900b70] > [0x990dda3] > [0x990de03] > [0x99090af] > [0x9900b40] > [0xffe95808] > > > Smalltalk stack dump: > 0xffe9e9f8 I MacStore class(Class)>subclassesDo: 0xa3393f0: a(n) MacStore > class > 0xffe9ea14 M MacStore class(Behavior)>allSubclassesDo: 0xa3393f0: a(n) > MacStore class > 0xffe9ea34 M [] in UnixStore class(Behavior)>allSubclassesDo: 0xa339380: > a(n) UnixStore class > 0xffe9ea58 M Array(SequenceableCollection)>do: 0x9ded798: a(n) Array > 0xffe9ea7c I UnixStore class(Class)>subclassesDo: 0xa339380: a(n) > UnixStore class > 0xffe9ea98 M UnixStore class(Behavior)>allSubclassesDo: 0xa339380: a(n) > UnixStore class > 0xffe9eab8 M [] in DiskStore class(Behavior)>allSubclassesDo: 0xa339310: > a(n) DiskStore class > 0xffe9eadc M Array(SequenceableCollection)>do: 0x9ded710: a(n) Array > 0xffe9d7c8 I DiskStore class(Class)>subclassesDo: 0xa339310: a(n) > DiskStore class > 0xffe9d7e4 M DiskStore class(Behavior)>allSubclassesDo: 0xa339310: a(n) > DiskStore class > 0xffe9d800 M DiskStore class>activeClass 0xa339310: a(n) DiskStore class > 0xffe9d81c M DiskStore class>currentFileSystem 0xa339310: a(n) DiskStore > class > 0xffe9d834 M DiskStore class>current 0xa339310: a(n) DiskStore class > 0xffe9d84c M DiskStore class>delimiter 0xa339310: a(n) DiskStore class > 0xffe9d864 M DiskStore(FileSystemStore)>delimiter 0x9deb478: a(n) DiskStore > 0xffe9d884 M DiskStore(FileSystemStore)>pathFromString: 0x9deb478: a(n) > DiskStore > 0xffe9d8a4 M DiskStore>defaultWorkingDirectory 0x9deb478: a(n) DiskStore > 0xffe9d8bc M FileSystem>initializeWithStore: 0x9deb488: a(n) FileSystem > 0xffe9d8dc M FileSystem class>store: 0xa2e2978: a(n) FileSystem class > 0xffe9d8f8 M DiskStore class>currentFileSystem 0xa339310: a(n) DiskStore > class > > ... and so on...from #currentFileSystem to #store: and again... > > Thanks for any feedback and/or insight on how I should proceed to avoid > this from happening, or what bug should I monitor to know when this might > be fixed. > > >

June 26, 2016