[Pharo-project] Parsing and navigating Html
Hi I would like extract partial information from HTML pages. So I started to play and fix HTMLParser. Now does anybody know alternatives? Second, does anybody develop a lib to query HTML structure as with the XMLSupport package? Stef
I recently got the following very detailed response on the Squeak list - http://forum.world.st/HTML-parser-again-again-td3018595.html In addition to what's discussed there, I've been successfully using PetitParser with/in lieu of HTML parsers for partial parsing. Cheers, Sean -- View this message in context: http://forum.world.st/Parsing-and-navigating-Html-tp3072743p3072777.html Sent from the Pharo Smalltalk mailing list archive at Nabble.com.
SeasideTesting uses the XMLParser for parsing html files and has support for querying them. It's not complete but, for example, covers quite a lot of cases needed in testing, obviously On 04 Dec 2010, at 22:15, Sean P. DeNigris wrote:
I recently got the following very detailed response on the Squeak list - http://forum.world.st/HTML-parser-again-again-td3018595.html
In addition to what's discussed there, I've been successfully using PetitParser with/in lieu of HTML parsers for partial parsing.
Cheers, Sean -- View this message in context: http://forum.world.st/Parsing-and-navigating-Html-tp3072743p3072777.html Sent from the Pharo Smalltalk mailing list archive at Nabble.com.
On Dec 5, 2010, at 12:13 PM, Johan Brichau wrote:
SeasideTesting uses the XMLParser for parsing html files and has support for querying them. It's not complete but, for example, covers quite a lot of cases needed in testing, obviously
good to know. Now I tried to parse some pages with XMLParser before trying HTMLParser and it did not succeed. Stef
On 04 Dec 2010, at 22:15, Sean P. DeNigris wrote:
I recently got the following very detailed response on the Squeak list - http://forum.world.st/HTML-parser-again-again-td3018595.html
In addition to what's discussed there, I've been successfully using PetitParser with/in lieu of HTML parsers for partial parsing.
Cheers, Sean -- View this message in context: http://forum.world.st/Parsing-and-navigating-Html-tp3072743p3072777.html Sent from the Pharo Smalltalk mailing list archive at Nabble.com.
Thanks. - I looked at HtmlParser (I would like to have a visitor so that all the morphic code for the rendering is removed from the node. - I was planning to look at CSS/parser validator. - I will look at SOUP and webrobots thanks for the pointers. Stef On Dec 4, 2010, at 10:15 PM, Sean P. DeNigris wrote:
I recently got the following very detailed response on the Squeak list - http://forum.world.st/HTML-parser-again-again-td3018595.html
In addition to what's discussed there, I've been successfully using PetitParser with/in lieu of HTML parsers for partial parsing.
Cheers, Sean -- View this message in context: http://forum.world.st/Parsing-and-navigating-Html-tp3072743p3072777.html Sent from the Pharo Smalltalk mailing list archive at Nabble.com.
Stef, Are the html pages produced under your control? I ask because a lot of html on the net is potentially mal-formed, which is reportedly a big source of trouble for creators of web browsers. Bill ________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr [pharo-project-bounces@lists.gforge.inria.fr] On Behalf Of Stéphane Ducasse [stephane.ducasse@inria.fr] Sent: Saturday, December 04, 2010 3:48 PM To: Pharo-project@lists.gforge.inria.fr Development Subject: [Pharo-project] Parsing and navigating Html Hi I would like extract partial information from HTML pages. So I started to play and fix HTMLParser. Now does anybody know alternatives? Second, does anybody develop a lib to query HTML structure as with the XMLSupport package? Stef
no just some applications I do not control. :) On Dec 5, 2010, at 3:21 AM, Schwab,Wilhelm K wrote:
Stef,
Are the html pages produced under your control? I ask because a lot of html on the net is potentially mal-formed, which is reportedly a big source of trouble for creators of web browsers.
Bill
________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr [pharo-project-bounces@lists.gforge.inria.fr] On Behalf Of Stéphane Ducasse [stephane.ducasse@inria.fr] Sent: Saturday, December 04, 2010 3:48 PM To: Pharo-project@lists.gforge.inria.fr Development Subject: [Pharo-project] Parsing and navigating Html
Hi
I would like extract partial information from HTML pages. So I started to play and fix HTMLParser.
Now does anybody know alternatives?
Second, does anybody develop a lib to query HTML structure as with the XMLSupport package?
Stef
Stef, Do you at least have a list of specific applications producing the data? Do you know and trust the people running them? That might be a nice position compared to data mining the net (like Google) where you have no idea what might arrive, how well it might comply with standards, all the time having to worry about malicious intent. For example, I do not recommend putting untrusted data through a Microsoft parsing library ~:0 Bill ________________________________________ From: pharo-project-bounces@lists.gforge.inria.fr [pharo-project-bounces@lists.gforge.inria.fr] On Behalf Of Stéphane Ducasse [stephane.ducasse@inria.fr] Sent: Sunday, December 05, 2010 10:21 AM To: Pharo-project@lists.gforge.inria.fr Subject: Re: [Pharo-project] Parsing and navigating Html no just some applications I do not control. :) On Dec 5, 2010, at 3:21 AM, Schwab,Wilhelm K wrote:
Stef,
Are the html pages produced under your control? I ask because a lot of html on the net is potentially mal-formed, which is reportedly a big source of trouble for creators of web browsers.
Bill
participants (4)
-
Johan Brichau -
Schwab,Wilhelm K -
Sean P. DeNigris -
Stéphane Ducasse