- Pharo-users - lists.pharo.org

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by Bernardo Ezequiel Contreras

Doru, See attached file, it's a job posting from upwork. On Mon, Jun 27, 2016 at 3:58 AM, Tudor Girba <tudor(a)tudorgirba.com> wrote: > Hi, > > Could you provide more details about the use case? > > Cheers, > Doru > > > > On Jun 26, 2016, at 11:14 PM, Bernardo Ezequiel Contreras < > vonbecmann(a)gmail.com> wrote: > > > > Hi, > > Imagine that you have to do some data scraping work, what tool would you > use? > > I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else > that i'm not aware of it? > > > > thanks. > > > > > > -- > > Bernardo E.C. > > > > Sent from a cheap desktop computer in South America. > > -- > www.tudorgirba.com > www.feenk.com > > "If you can't say why something is relevant, > it probably isn't." > > > -- Bernardo E.C. Sent from a cheap desktop computer in South America.

June 27, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by stepharo

I can imagine that too :) because Soup was often trial and error. Stef Le 27/6/16 Ã 11:26, PBKResearch a Ã©crit : > > Hello > > I have used Soup, but I now prefer XMLHTMLParser, because I find it > easier to relate the structure of the XML output to that of the > original web page. It is also possible to use XPath to locate the > target area more quickly. I particularly like Montyâs âSmalltalkishâ > adaptation of XPath (see the last para of the class comment to XPath). > > Hope this helps > > Peter Kenny > >

June 27, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by PBKResearch

Hello I have used Soup, but I now prefer XMLHTMLParser, because I find it easier to relate the structure of the XML output to that of the original web page. It is also possible to use XPath to locate the target area more quickly. I particularly like Montyâs âSmalltalkishâ adaptation of XPath (see the last para of the class comment to XPath). Hope this helps Peter Kenny From: Pharo-users [mailto:pharo-users-bounces@lists.pharo.org] On Behalf Of stepharo Sent: 27 June 2016 10:03 To: pharo-users(a)lists.pharo.org Subject: Re: [Pharo-users] If you have to do web data scraping, what tool would you use? I scrapped all the magic cards (bad bad practice) using Soup. It could be easier but it worked for me. This is why I maintain it and added tests. Stef Le 26/6/16 Ã 23:14, Bernardo Ezequiel Contreras a Ã©crit : Hi, Imagine that you have to do some data scraping work, what tool would you use? I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else that i'm not aware of it? thanks. -- Bernardo E.C. Sent from a cheap desktop computer in South America.

June 27, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by stepharo

I scrapped all the magic cards (bad bad practice) using Soup. It could be easier but it worked for me. This is why I maintain it and added tests. Stef Le 26/6/16 Ã 23:14, Bernardo Ezequiel Contreras a Ã©crit : > Hi, > Imagine that you have to do some data scraping work, what tool would > you use? > I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else > that i'm not aware of it? > > thanks. > > > -- > Bernardo E.C. > > Sent from a cheap desktop computer in South America.

June 27, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by Pierce Ng

On Sun, Jun 26, 2016 at 06:14:50PM -0300, Bernardo Ezequiel Contreras wrote: > Imagine that you have to do some data scraping work, what tool would you > use? > I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else that > i'm not aware of it? I used Todd Blanchard's HTML parser back in Squeak 3.x days and found it very nice. Not sure about compatibility with current Pharo though. http://smalltalkhub.com/#!/~ToddBlanchard/HTMCSSValidatingParser Pierce

June 27, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by Tudor Girba

Hi, Could you provide more details about the use case? Cheers, Doru > On Jun 26, 2016, at 11:14 PM, Bernardo Ezequiel Contreras <vonbecmann(a)gmail.com> wrote: > > Hi, > Imagine that you have to do some data scraping work, what tool would you use? > I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else that i'm not aware of it? > > thanks. > > > -- > Bernardo E.C. > > Sent from a cheap desktop computer in South America. -- www.tudorgirba.com www.feenk.com "If you can't say why something is relevant, it probably isn't."

June 27, 2016

[dtabase] Looking for a report band editor

by sitepublique＠free.fr

Hi, I'm new with pharo and smalltalk and I would like to use it to start a new database application. But I need to find out a report band editor and I can't find anything about this into the pharo projets catalog... A report band exxemple is like : XtraReports : https://documentation.devexpress.com/#XtraReports/CustomDocument2590 Lazreport (LAzarus/pascal) : http://wiki.lazarus.freepascal.org/LazReport_Tutorial etc. Do you know a report band editor with pharo (or other smalltalk implementation ?) Thank you for your help.

June 27, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by Andy Burnett

I had a similar question, which led me to the Webdriver project (now part of selenium). I haven't done any experiments yet, but the idea of driving the browser via its API is appealing. The Parasol project says it is a Webdriver implementation for Pharo, and it looks quite exciting. The build is currently failing, but that seems to be a gemstone problem. https://github.com/SeasideSt/Parasol/blob/master/README.md If you have time to play with it I would love to hear your experience. Cheers Andy >

June 27, 2016

Re: [Pharo-users] Styling a Pharo UI application

by Offray Vladimir Luna CÃ¡rdenas

+1 :) Offray On 26/06/16 02:56, stepharo wrote: > > + 1 > > Stef > >> Tommaso, >> >> can you give some concrete examples of what it is that you wanted to >> do to refine your application and that was really hard (or >> impossible) to do with Spec? >> >> As long as we do not know what is wrong, we cannot fix it. >> >> As long as we do not know what important things are wrong, we cannot >> prioritize. >> >> -- >> Does this mail seem too brief? Sorry for that, I donât mean to be >> rude! Please see http://emailcharter.org . >> >> Johan Fabry - http://pleiad.cl/~jfabry <http://pleiad.cl/%7Ejfabry> >> PLEIAD and RyCh labs - Computer Science Department (DCC) - >> University of Chile >> >>> On Jun 25, 2016, at 15:54, Tommaso Dal Sasso >>> <tommaso.dalsasso(a)gmail.com <mailto:tommaso.dalsasso@gmail.com>> wrote: >>> >>> The beauty that I am looking for as a developer for has to do with >>> the code and the API. I consider important how fast I am able to >>> prototype a working example --in this Spec is excellent-- and how >>> much I can extend the code to refine my application --in this Spec >>> is really hard to use--. >> >

June 26, 2016

Re: [Pharo-users] If you have to do web data scraping, what tool would you use?

by Offray Vladimir Luna CÃ¡rdenas

Hi Bernardo, On 26/06/16 16:14, Bernardo Ezequiel Contreras wrote: > Hi, > Imagine that you have to do some data scraping work, what tool would > you use? > I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else > that i'm not aware of it? > > thanks. > No that I'm aware of. This combination in a live coding environment like Pharo has been really empowering for me. Cheers, Offray

June 26, 2016