- Pharo-users - lists.pharo.org

Pharo-Chrome (was: Soup bug(fix))
by Alistair Grant Nov. 12, 2017

Nov. 12, 2017

Hi Stef, On 12 November 2017 at 14:47, Stephane Ducasse <stepharo.self(a)gmail.com> wrote: > exampleNavigation > | chrome page logger | > logger := InMemoryLogger new. > logger start. > chrome := GoogleChrome new > debugOn; > debugSession; > open; > yourself. > page := chrome tabPages first. > page enablePage. > page enableDOM. > page navigateTo: 'http://pharo.org'. > page getDocument. > page getMissingChildren. > page updateTitle. > logger stop. > ^{ chrome. page. logger. } > > but in fact I realised that I would like to a simple doc :) > > > On Sun, Nov 12, 2017 at 2:44 PM, Stephane Ducasse > <stepharo.self(a)gmail.com> wrote: >> Hi alistair >> >> this is cool. >> Do you have one little example so that we can see how we can use it? >> >> Stef Fair enough :-) I'll try and extend the readme to include some basic documentation. Cheers, Alistair >> On Sat, Nov 11, 2017 at 4:38 PM, Alistair Grant <akgrant0710(a)gmail.com> wrote: >>> On 9 November 2017 at 00:00, Kjell Godo <squeaklist(a)gmail.com> wrote: >>>> i like to collect some newspaper comics from an online newspaper >>>> but it takes really long to do it by hand by hand >>>> i tried Soup but i didnât get anywhere >>>> the pictures were hidden behind a script or something >>>> is there anything to do about that? >>> >>> Most of the web pages I want to scrape use javascript to construct the >>> DOM, which makes Soup. XMLHTMLParser, etc. useless. >>> >>> I've extended Torsten's Pharo-Chrome library and use that to navigate >>> the DOM in a way similar to Soup: >>> >>> https://github.com/akgrant43/Pharo-Chrome >>> >>> This gets around the issue with javascript since it waits for the >>> browser to load the page, run the javascript and construct the DOM. >>> >>> HTH, >>> Alistair >>> >>> >>> >>>> i donât want to collect them all >>>> i have the XPath .pdf but i havenât read it yet >>>> >>>> these browsers seem to gobble up memory >>>> and while open they just keep getting bigger till the OS session crash >>>> might there be a browser that is more minimal? >>>> >>>> Vivaldi seems better at not bloating up RAM >>> >

2 1

LGit_GIT_ERROR: Invalid version 0 on git_remote_callbacks on latest 64bit 6.1 image?
by Tim Mackinnon Nov. 12, 2017

Nov. 12, 2017

Hi - does Iceberg work on a 64bit image yet? Iâve not tried in a while, and was surprised when I went to get a new image via the command line that I am getting the error: LGit_GIT_ERROR: Invalid version 0 on git_remote_callbacks I can see a post by Alistair in Jun asking about this, and it seems 64bit hadnât been updated to work back then - but is this still true in Nov? We seem very much in turmoil at the moment - and its unclear what should work and not work. Is there a stable platform? If 64 bit is only working for 7.x - should we remove it from 6.x so that people donât inadvertently try to use it? Tim

4 5

Unable to load SmaCC on pharo6 (or pharo5)
by Federico.Balaguer Nov. 11, 2017

Nov. 11, 2017

I would like to check if I need to use SmaCC for a project. I tried to install it on Pharo 6.1 32bits with iceberg but I was not able to do it. Then I tried to get SmaCC on an Pharo5 and Pharo6 images with "Catalog Browser" but I was not able to do it neither. The tool did pop up a message saying that Smacc was not tested for Pharo6 which was nice. Then I tried to clone the git repository to my local machine, I pointed iceberg to that local repository and then I loaded each package by hand. I was able to load BaselineOfSmaccBrowser but SmaCC-Rewrite-Engine failed to load with a debugger with a list of classes and methods that are missing (they are listed at the end of this message). Could some give an idea how to fix this? Thanks. Federico This package depends on the following classes: SmaCCStringInterval SmaCCParseNodeVisitor SmaCCScanner SmaCCParseNode SmaCCParser SmaCCString You must resolve these dependencies before you will be able to load these definitions: SmaCCAnnotatedString SmaCCAnnotatedString>>#addAnnotationTo: SmaCCAnnotatedString>>#intervalClass SmaCCAnnotatedString>>#newIntervalFor: SmaCCAnnotatedString>>#node SmaCCAnnotatedString>>#node: SmaCCAnnotatedString>>#removeInterval: SmaCCAnnotatedString>>#rule SmaCCAnnotatedString>>#rule: SmaCCAnnotatedStringInterval SmaCCAnnotatedStringInterval>>#addAllAnnotations: SmaCCAnnotatedStringInterval>>#addAnnotation: SmaCCAnnotatedStringInterval>>#annotations SmaCCAnnotatedStringInterval>>#annotations: SmaCCAnnotatedStringInterval>>#canBeMergedWith: SmaCCAnnotatedStringInterval>>#postCopy SmaCCCodeReplaceExpression SmaCCCodeReplaceExpression>>#acceptVisitor: SmaCCCodeReplaceExpression>>#code SmaCCCodeReplaceExpression>>#code: SmaCCCodeReplaceExpression>>#evaluateInContext: SmaCCCodeReplaceExpression>>#method SmaCCCodeReplaceExpression>>#tokenVariables SmaCCCompositeReplaceExpression SmaCCCompositeReplaceExpression>>#acceptVisitor: SmaCCCompositeReplaceExpression>>#compositeNodeVariables SmaCCCompositeReplaceExpression>>#evaluateInContext: SmaCCCompositeReplaceExpression>>#expressions SmaCCCompositeReplaceExpression>>#expressions: SmaCCCompositeReplaceExpression>>#initialize SmaCCNodeReplaceExpression SmaCCNodeReplaceExpression>>#acceptVisitor: SmaCCNodeReplaceExpression>>#addPostfixTo:inContext: SmaCCNodeReplaceExpression>>#addPrefixTo:inContext: SmaCCNodeReplaceExpression>>#afterPostfix SmaCCNodeReplaceExpression>>#afterPostfix: SmaCCNodeReplaceExpression>>#afterWhitespace SmaCCNodeReplaceExpression>>#afterWhitespace: SmaCCNodeReplaceExpression>>#beforePrefix SmaCCNodeReplaceExpression>>#beforePrefix: SmaCCNodeReplaceExpression>>#beforeWhitespace SmaCCNodeReplaceExpression>>#beforeWhitespace: SmaCCNodeReplaceExpression>>#evaluateInContext: SmaCCNodeReplaceExpression>>#name SmaCCNodeReplaceExpression>>#name: SmaCCNodeReplaceExpression>>#postfix SmaCCNodeReplaceExpression>>#postfix: SmaCCNodeReplaceExpression>>#prefix SmaCCNodeReplaceExpression>>#prefix: SmaCCNodeReplaceExpression>>#tokenVariables SmaCCReplaceExpression SmaCCReplaceExpression>>#acceptVisitor: SmaCCReplaceExpression>>#evaluateInContext: SmaCCReplaceExpressionParser SmaCCReplaceExpressionParser>>#cacheId SmaCCReplaceExpressionParser>>#definitionComment SmaCCReplaceExpressionParser>>#scannerClass SmaCCReplaceExpressionParser>>#startingStateForExpression SmaCCReplaceExpressionParser>>#reduceActionForCodeReplace1: SmaCCReplaceExpressionParser>>#reduceActionForExpression1: SmaCCReplaceExpressionParser>>#reduceActionForNodeReplace1: SmaCCReplaceExpressionParser>>#reduceActionForPostfixModifiers1: SmaCCReplaceExpressionParser>>#reduceActionForPrefixModifiers1: SmaCCReplaceExpressionParser>>#reduceActionForPrefixModifiers2: SmaCCReplaceExpressionParser>>#reduceActionForRewriteExpression3: SmaCCReplaceExpressionParser>>#reduceActionForRewriteExpressions1: SmaCCReplaceExpressionParser>>#reduceActionForRewriteExpressions2: SmaCCReplaceExpressionParser>>#reduceActionForStringReplace1: SmaCCReplaceExpressionParser>>#reduceActionForSwitchStateToCode1: SmaCCReplaceExpressionParser>>#reduceActionForSwitchStateToDefault1: SmaCCReplaceExpressionParser>>#reduceActionForSwitchStateToExpression1: SmaCCReplaceExpressionParser>>#reduceTable SmaCCReplaceExpressionParser>>#symbolNames SmaCCReplaceExpressionParser>>#symbolTypes SmaCCReplaceExpressionParser>>#transitionTable SmaCCReplaceExpressionScanner SmaCCReplaceExpressionScanner>>#codeExpressionId SmaCCReplaceExpressionScanner>>#emptySymbolTokenId SmaCCReplaceExpressionScanner>>#errorTokenId SmaCCReplaceExpressionScanner>>#isValidCode SmaCCReplaceExpressionScanner>>#next SmaCCReplaceExpressionScanner>>#scanCode SmaCCReplaceExpressionScanner>>#scanForToken SmaCCReplaceExpressionScanner>>#scanForTokenX1 SmaCCReplaceExpressionVisitor SmaCCReplaceExpressionVisitor>>#visitCodeReplace: SmaCCReplaceExpressionVisitor>>#visitCompositeReplace: SmaCCReplaceExpressionVisitor>>#visitNodeReplace: SmaCCReplaceExpressionVisitor>>#visitReplace: SmaCCReplaceExpressionVisitor>>#visitStringReplace: SmaCCRewriteRuleFileParser SmaCCRewriteRuleFileParser>>#cacheId SmaCCRewriteRuleFileParser>>#definitionComment SmaCCRewriteRuleFileParser>>#fileExtension SmaCCRewriteRuleFileParser>>#fileExtensionType SmaCCRewriteRuleFileParser>>#parseFile: SmaCCRewriteRuleFileParser>>#scannerClass SmaCCRewriteRuleFileParser>>#startingStateForFile SmaCCRewriteRuleFileParser>>#filename: SmaCCRewriteRuleFileParser>>#lookupClass: SmaCCRewriteRuleFileParser>>#reduceActionForComment2: SmaCCRewriteRuleFileParser>>#reduceActionForFile1: SmaCCRewriteRuleFileParser>>#reduceActionForImport1: SmaCCRewriteRuleFileParser>>#reduceActionForMatch1: SmaCCRewriteRuleFileParser>>#reduceActionForMatch2: SmaCCRewriteRuleFileParser>>#reduceActionForMatch3: SmaCCRewriteRuleFileParser>>#reduceActionForMatch4: SmaCCRewriteRuleFileParser>>#reduceActionForParserClass1: SmaCCRewriteRuleFileParser>>#reduceActionForRule1: SmaCCRewriteRuleFileParser>>#reduceActionForRule2: SmaCCRewriteRuleFileParser>>#reduceActionForRule3: SmaCCRewriteRuleFileParser>>#reduceActionForRules1: SmaCCRewriteRuleFileParser>>#reduceActionForRules2: SmaCCRewriteRuleFileParser>>#reduceActionForRules3: SmaCCRewriteRuleFileParser>>#reduceActionForRules4: SmaCCRewriteRuleFileParser>>#reduceActionForStartSmalltalkExpression1: SmaCCRewriteRuleFileParser>>#reduceActionForStartStringExpression1: SmaCCRewriteRuleFileParser>>#reduceActionForTransformation1: SmaCCRewriteRuleFileParser>>#reduceActionForTransformation2: SmaCCRewriteRuleFileParser>>#reduceActionForVariable1: SmaCCRewriteRuleFileParser>>#reduceActionForVariable2: SmaCCRewriteRuleFileParser>>#reduceActionForVariableList1: SmaCCRewriteRuleFileParser>>#reduceActionForVariableList2: SmaCCRewriteRuleFileParser>>#reduceTable SmaCCRewriteRuleFileParser>>#scanSmalltalkExpression SmaCCRewriteRuleFileParser>>#scanStringExpression SmaCCRewriteRuleFileParser>>#symbolNames SmaCCRewriteRuleFileParser>>#transitionTable SmaCCRewriteRuleFileParser>>#tryAllTokens SmaCCRewriteRuleFileScanner SmaCCRewriteRuleFileScanner>>#initializeKeywordMap SmaCCRewriteRuleFileScanner>>#rewriter SmaCCRewriteRuleFileScanner>>#rewriter: SmaCCRewriteRuleFileScanner>>#emptySymbolTokenId SmaCCRewriteRuleFileScanner>>#errorTokenId SmaCCRewriteRuleFileScanner>>#fixExpression: SmaCCRewriteRuleFileScanner>>#isValidSmalltalk: SmaCCRewriteRuleFileScanner>>#scan1 SmaCCRewriteRuleFileScanner>>#scan2 SmaCCRewriteRuleFileScanner>>#scan3 SmaCCRewriteRuleFileScanner>>#scan4 SmaCCRewriteRuleFileScanner>>#scanForToken SmaCCRewriteRuleFileScanner>>#scanForTokenX1 SmaCCRewriteRuleFileScanner>>#scanForTokenX2 SmaCCRewriteRuleFileScanner>>#scanForTokenX3 SmaCCRewriteRuleFileScanner>>#scanForTokenX4 SmaCCRewriteRuleFileScanner>>#scanForTokenX5 SmaCCRewriteRuleFileScanner>>#scanForTokenX6 SmaCCRewriteRuleFileScanner>>#scanForTokenX7 SmaCCRewriteRuleFileScanner>>#scanSmalltalkExpression SmaCCRewriteRuleFileScanner>>#scanStringExpression SmaCCRewriteRuleFileScanner>>#tokenActions SmaCCStringReplaceExpression SmaCCStringReplaceExpression>>#acceptVisitor: SmaCCStringReplaceExpression>>#evaluateInContext: SmaCCStringReplaceExpression>>#string SmaCCStringReplaceExpression>>#string: SmaCCStringReplaceExpression>>#tokenVariables -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

4 11

smalltalkhub amber debugger
by Sebastian Heidbrink Nov. 11, 2017

Nov. 11, 2017

Hi! I just browsed to http://smalltalkhub.com/#!/~jhoncc2 And got an amber debugger. ShTimelineEvent class from: json Â Â Â ^(self withAllSubclasses Â Â Â Â Â Â detect: [:each | each type = (json at: 'type')] Â Â Â Â Â Â ifNone: [self]) fromJson: json json is nil here! Cheers! Sebastian

1 0

Please consider Apache Integration of Services
by henry Nov. 10, 2017

Nov. 10, 2017

Note, my quote below, Storm is implementable by any language, hello Smalltalk! At the risk of throwing a rock in the pool, I must as well acknowledging the unique offerings we have in Smalltalk spaces. The challenge as I see it is the lack of a coordinated effort to adopt common interfaces used in industry. I would hold up the history of the Cryptography team how different folks came together to join efforts in creating a shared library. Which they did. It holds up over the test of time and is ported through multiple Smalltalk environments. Using that as a reference, were the various cloud and BigData applications be seen as worthy to build good integration with, the access to all the great data-manipulation tools and presentations that Smalltalk environments offer will finally be accessible to put on the table in corporate and advanced data processing environments. Alright, you may accept what I have been saying then for those of us still in contemplation will be curious about what work that entails. Allow me to present a few of the projects working together through Apache Foundation. They are truly leaders in creating the computing of BigData. The core architecture that is commonly used in BigData and Cloud is called the Lambda Architecture, consisting of a fault-tolerant event streaming source, such as Apache Kafka [1], a batch-processing pipe and NoSQL database coordinator, such as Apache Cassandra [2], and a real-time processing pipe, for example Apache Storm [3]. There is also analytics on the other side of storage, such as through Cassandra to Hadoop and queries. What I would like to highlight is Apache Storm. Apache Storm is quite simple in idea though more complex on hardware. One thing to keep in mind is that the fault-tolerance requirement has forced Kafka and Storm to both be replication centric in a de-centralized way. They tend to use Apache Zookeeper [4] to monitor progress through durable queues of data. Storm in particular is a way to consume streams of events, including the ability to join and filter them. Here are two blurbs, one about Storm Architecture and the other about how other languages can implement Storm architecture pieces, especially Bolts. My question is why can't and why shouldn't Smalltalks (Pharo, Squeak, Gemstone, Smalltalk Express, Swift, ST/X, Dolphin) be able to participate? Working software engineers are building this stuff and lots of time and money are being spent converting critical data in industry. It seems now is the time to jump aboard as much computing will be done in these areas and we can compete! Here are blurbs about Storm then links to Kafka [1], Cassandra [2] and Storm [3]. ------ "There are just three abstractions in Storm: spouts, bolts, and topologies. A spout is a source of streams in a computation. Typically a spout reads from a queueing broker such as Kestrel, RabbitMQ, or Kafka, but a spout can also generate its own stream or read from somewhere like the Twitter streaming API. Spout implementations already exist for most queueing systems. A bolt processes any number of input streams and produces any number of new output streams. Most of the logic of a computation goes into bolts, such as functions, filters, streaming joins, streaming aggregations, talking to databases, and so on. A topology is a network of spouts and bolts, with each edge in the network representing a bolt subscribing to the output stream of some other spout or bolt. A topology is an arbitrarily complex multi-stage stream computation. Topologies run indefinitely when deployed." ------ "Storm was designed from the ground up to be usable with any programming language. At the core of Storm is a [Thrift](http://thrift.apache.org/) [definition](https://github.com/apache/storm/blob/master/storm-core/src/stor… for defining and submitting topologies. Since Thrift can be used in any language, topologies can be defined and submitted from any language. Similarly, spouts and bolts can be defined in any language. Non-JVM spouts and bolts communicate to Storm over a [JSON-based protocol](http://storm.apache.org/documentation/Multilang-protocol.html) over stdin/stdout. Adapters that implement this protocol exist for [Ruby](https://github.com/apache/storm/blob/master/storm-multilang/ruby/src/…, [Python](https://github.com/apache/storm/blob/master/storm-multilang/python/…, [Javascript](https://github.com/apache/storm/blob/master/storm-multilang/jav…, [Perl](https://github.com/dan-blanchard/io-storm)." ------ [1] https://kafka.apache.org/ [2] http://cassandra.apache.org/ [3] http://storm.apache.org/ [4] https://zookeeper.apache.org/ - HH

2 2

Adding an Iceberg repository at startup
by Prof. Andrew P. Black Nov. 10, 2017

Nov. 10, 2017

I would like to have the git repositories that Iâm working from automatically added to the list of known repositories in Iceberg at startup time. In other words, I don;t want to have to do a bunch of âAdd local repositoryâ commands before I can start work. What magic can I put in my settings.st file to make this happen? Andrew

4 4

Another example of invoking a REST/JSON web service - resolving User-Agent strings
by Sven Van Caekenberghe Nov. 10, 2017

Nov. 10, 2017

In one of our web applications, when a user logs in, we give some meta/context information, like this: You are user /users/4 in entity context /entities/0 for T3 using timezone Europe/Brussels [offset -1] Last login Fri Nov 10 2017 15:15:46 from 80.89.7.35 using Safari 11 on Mac OS X 10 Your login count is 10,375 The last login info functions as a soft security measure. In it, the part after using, 'Safari 11 on Mac OS X 10', is computed from the (previous) User-Agent string of the web browser when the user last logged in. But these strings are quite complex. There exist web services that parse these complex user agent strings and extract all possible information out of them, including the high level description used above. The previous solution stopped working and I configured a new one today [https://www.whatismybrowser.com] the core implementation of which I would like to share as yet another example. (ZnClient new systemPolicy; url: 'https://api.whatismybrowser.com/api/v2/user_agent_parse'; accept: ZnMimeType applicationJson; headerAt: 'x-api-key' put: '8cf7cee797f3c68d59055eac96778000'; contentReader: [ :entity | entity ifNotNil: [ NeoJSONObject fromString: entity contents ] ]; contentWriter: [ :object | ZnEntity json: object asString ]; contents: ({ 'user_agent' -> 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_1) AppleWebKit/604.3.5 (KHTML, like Gecko) Version/11.0.1 Safari/604.3.5' } as: NeoJSONObject); post) parse at: 'simple_software_string'. You have to create an account and insert your own API key. NeoJSON must be loaded. Using #systemPolicy and #accept: makes this call throw an exception unless valid JSON is returned in a 2XX response. NeoJSONObject is a convenient way to use the NeoJSON infrastructure. The #parse message accesses the property by the same name (via a DNU), as does the #at: message (for keys that cannot be written as message sends). Sven

2 1

perspective request for those earning a living from Smalltalk
by Ben Coman Nov. 10, 2017

Nov. 10, 2017

At https://news.ycombinator.com/item?id=15523807 the question is asked... "Does anyone on here program in Smalltalk professionally? Not to get off topic, but I'm curious and would like to know how it stacks up compared to what they did previously? " If you've earning a living from programming Smalltalk, please drop a comment there. cheers -ben

13 21

SmaCC UI Problem solved but only when breakpoint was added
by Federico.Balaguer Nov. 10, 2017

Nov. 10, 2017

Hello I am progressing with my use of SmaCC and I think a found the source of the problem that makes it impossible to generete the classes for the parser and scanner. Scenario 1) I gave the name for both classes: the parser and the scanner. 2) I copy the very simple first part of the tutorial 3) I clicked on the Compile LR(1) button and a window popped up with the label: "Both classes are not specified" Problem: At the time the method SmaCCDevelopmentUI>>compile: was invoked the expression self parserClassString returns an empty string (although I entered the name of a class on the UI) I found that the "parserClassMorph" did not hold the name of the class Then I breakpointed the method SmaCCDevelopmentUI>>addParseClass: and I entered a new name for the class of my parser and I follow with the debugger the execution that follows the invocation of the method. Everything works as expected. I changed the name again but the method SmaCCDevelopmentUI>>addParseClass: (the one with a breakpoint) was not called again. I think it is a problem related to Morph . I am a complete ignorant on Morph (among other things) so it is hard for me to fix the problem. I hope this message helps fix the issue Federico -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

2 2

Pharo 6.1 UTF8InvalidText error
by ÐÐ¸ÐºÐµÐ½ÑÐ¸Ð¹ ÐÐ¾ÑÐ°Ð¿Ð¾Ð² Nov. 10, 2017

Nov. 10, 2017

Good day! Now i download fresh latest pharo archive and unzipped it to C:\Pharo 6.1. The error still exists. Debugging shows that error comes with reading from environment varaible: ... ByteString(String) convertFromWithConverter: FilePathEncoder class decode: WindowsResolver(platformResolver) resolveString: WindowsResolver(platformResolver) directoryFromEnvVariableNamed:or: ... it tries to read 'USERPROFILE', get envValue 'C:\Users\ÐÐ¸ÐºÐµÐ½ÑÐ¸Ð¹' and can't parse cyrillic characters in this path. Please, tell me how to fix it by myself. Best regards, Vikenti.

3 4