March 2019 - Pharo-users - lists.pharo.org

Parsing text to discover general data of interest (phone, email, address, ...)
by CÃ©drick BÃ©ler March 8, 2019

March 8, 2019

Hi all, Iâve often got the need to analyse some random unstructured text to discover (structured) information (in email for instance), to extract : - emails - telephone numbers - addresses - events - person names (according to a list of known persons), - etcâ¦ Apple do it in email for instance (strangely, this is not generalized). So my questions are : - do we have something equivalent in Smalltalk/Pharo ? (I didnât find) - if not, what strategy would you use ? => I do really stupid text analysis (substrings, finding @, â¦, parsing according to the text structure when there isâ¦ kind of Soup parsingâ¦) => I feel this is a job for PetitParser ? And would be a nice feet to the new GToolkit. All ideas or suggestions are welcome ;-) TIA, CÃ©drick

5 11

Re: [Pharo-users] Parsing text to discover general data of interest (phone, email, address, ...)
by CÃ©drick BÃ©ler March 8, 2019

March 8, 2019

> Couldn't find anything in Smalltalk but that should you give ideas and inspire you or get you started... > > https://github.com/search?q=contact+scraping&type=Repositories > > I guess we have all that's needed in Pharo : parsers (HTML, XML, PetitParser), Soup & regex ! Yes for markup, I played already quite much with Soup initially at first but then XPath which os far more convenient and direct. PetitParser(2) is also a pure gem. I finally understand it better. Grammar and Parser are interesting but maybe more appropriate for structured/semi/structured texts. Pure text, is nice with tools like those Richard just showed. I continue to play with PetitParser2 today (finishing tutorialâ¦). Cheers, CÃ©drick > > On 2019-03-07 04:52, CÃ©drick BÃ©ler wrote: >> Hi all, >> >> Iâve often got the need to analyse some random unstructured text to discover (structured) information (in email for instance), to extract : >> - emails >> - telephone numbers >> - addresses >> - events >> - person names (according to a list of known persons), >> - etcâ¦ >> >> Apple do it in email for instance (strangely, this is not generalized). >> >> >> So my questions are : >> - do we have something equivalent in Smalltalk/Pharo ? (I didnât find) >> - if not, what strategy would you use ? >> => I do really stupid text analysis (substrings, finding @, â¦, parsing according to the text structure when there isâ¦ kind of Soup parsingâ¦) >> => I feel this is a job for PetitParser ? And would be a nice feet to the new GToolkit. >> >> All ideas or suggestions are welcome ;-) >> >> >> TIA, >> >> CÃ©drick >> >> >> > -- > ----------------- > BenoÃ®t St-Jean > Yahoo! Messenger: bstjean > Twitter: @BenLeChialeux > Pinterest: benoitstjean > Instagram: Chef_Benito > IRC: lamneth > Blogue: endormitoire.wordpress.com > "A standpoint is an intellectual horizon of radius zero". (A. Einstein) > > > >

1 0

Load Tonel package from local folder
by BrunoBB March 7, 2019

March 7, 2019

Hi, I have a very simple Baseline: baselineOf: spec <baseline> spec for: #common do: [ spec baseline: 'NeoJSON' with: [ spec repository: 'github://svenvc/NeoJSON:master/repository' ]. spec baseline: 'P3' with: [ spec repository: 'github://svenvc/P3' ]. spec package: 'Pre-Checkin-Database' with: [ spec requires: #('NeoJSON' 'P3') ]. ] The Baseline file is in: C:\Program Files (x86)\Pharo\pharo-local\pre-checkin\booking-addons\Pre-Checkin\BaselineOfPreCheckinDatabase Also in Development Image the following answer an empty collection: MetacelloToolBox validateBaseline: BaselineOfPreCheckinDatabase. But in a Fresh Image the following evaluation answer an error: Metacello new repository: 'tonel://C:\Program Files (x86)\Pharo\pharo-local\pre-checkin\booking-addons\Pre-Checkin\'; baseline: 'PreCheckinDatabase'; onLock: [ :ex | ex honor ]; load. Any idea what is wrong ? Never worked with Tonel before but fore sure something similar works fine with filetree. Stack: ByteString(Object)>>doesNotUnderstand: #resolve: FileLocator>>resolve FileLocator(AbstractFileReference)>>fileSystem FileLocator(AbstractFileReference)>>/ IceLibgitRepository class>>localRepositoriesLocation IceLibgitRepository class>>repositoriesLocation IceRepositoryCreator>>defaultLocation IceRepositoryCreator>>locationToUse IceRepositoryCreator>>validateNotDuplicated IceRepositoryCreator>>validate [ self validate. self isCloning ifTrue: [ self cloneRepository ] ifFalse: [ self addLocalRepository ] ] in IceRepositoryCreator>>createRepository in Block: [ self validate.... BlockClosure>>on:do: IceRepositoryCreator>>createRepository [ repository := builder createRepository ] in MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryFor: in Block: [ repository := builder createRepository ] BlockClosure>>on:do: MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryFor: [ ^ self createIcebergRepositoryFor: urlToUse ] in MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryWithFallbackFor:url: in Block: [ ^ self createIcebergRepositoryFor: urlToUse ] BlockClosure>>on:do: MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryWithFallbackFor:url: [ | remote | remote := IceGitRemote url: remoteUrl. self createIcebergRepositoryWithFallbackFor: remote url: remoteUrl ] in MCGitHubRepository(MCGitBasedNetworkRepository)>>getOrCreateIcebergRepository in Block: [ | remote |... OrderedCollection(Collection)>>detect:ifFound:ifNone: OrderedCollection(Collection)>>detect:ifNone: MCGitHubRepository(MCGitBasedNetworkRepository)>>getOrCreateIcebergRepository IceGithubRepositoryType>>mcRepository Iceberg class>>mcRepositoryFor: IceMetacelloPharoPlatform>>createRepository: MetacelloMCBaselineProject(MetacelloMCProject)>>createRepository: MetacelloRepositorySpec>>createRepository [ aSpec createRepository ] in [ :aSpec | | description repo | description := aSpec description. (repo := repositories detect: [ :rep | rep description = description ] ifNone: [ aSpec createRepository ]) ~~ nil ifTrue: [ repos add: repo ] ] in MetacelloEnsureFetchingMCSpecLoader(MetacelloCommonMCSpecLoader)>>repositoriesFrom:ignoreOverrides: in Block: [ aSpec createRepository ] Array(Collection)>>detect:ifFound:ifNone: -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

1 2

Noob Question - slicing
by Craig Johnson March 7, 2019

March 7, 2019

Hi All, I was trying to figure an elegant way to slice strings (Python style), and came up empty. What is the simplest way to copy characters between positions 4 and 8 from a string in Pharo? Craig

6 6

IMAP in Pharo
by CÃ©drick BÃ©ler March 7, 2019

March 7, 2019

Hi all, Do you know if IMAP is possible in Pharo ? I havent found any implementation (quick search). Iâd like to have it to interact/filter my email. POP3 is not really possible. I think it would be a nice addition and maybe a good GSOC project ? Cheers, CÃ©drick http://forum.world.st/Zodiac-and-IMAP-td4741328.html <http://forum.world.st/Zodiac-and-IMAP-td4741328.html> It exists in GNU-Smalltalk but donât look at ti, its GPL :-) https://github.com/gnu-smalltalk/smalltalk/blob/master/packages/net/IMAP.st <https://github.com/gnu-smalltalk/smalltalk/blob/master/packages/net/IMAP.st>

4 6

Loading Baseline from Smart HTTP git
by SebastiÃ¡n Filippini March 7, 2019

March 7, 2019

Hi, My name is Sebastian and I'm new to Pharo and Smalltalk in general. I'm trying to load a baseline from a git server using Smart HTTP protocol. I'm using a self hosted git server with gitolite. I can clone the repository by http using: git clone http://user:password@host/repo-name. I've readed (https://github.com/pharo-open-documentation/pharo-wiki/blob/master/General/…) and I can't found info on how to use a git server other than gitlab and github. Is it possible to do this? (I don't need it now but I wonder if it is possible to use ssh git transport too.) Regards, Sebastian

1 0

Why can't a Bag answer as a dictionary?
by Tim Mackinnon March 7, 2019

March 7, 2019

I was surprised to find that a Bag canât convert to a dictionary - e.g. Bag new addAll: 'aabbbbcdddâ; asDictionary Gives an error - Dnu #key It looks to me like Bag is inheriting a bad version of #associationsDo: and instead could simply forward it to #doWithOccurences: instead? I know Bag is not used that much - but it comes up a lot in programming exercises. Tim

7 12

Fail on condense when image name is drgeo.image
by Hilaire March 7, 2019

March 7, 2019

Hi, When I use the stable P7, drgeo build fails. There is an obscure error in File>>nextVersion, with negative index which are not catch, although it looks like it should be. This same build was working on alpha P7 of June. The stack of the debugger is attached as well the PharoDebug.log. Does it sound familiar to any of you? Hilaire -- Dr. Geo http://drgeo.eu

3 7

Google Protobuf and usage of Slots
by Holger Freyther March 7, 2019

March 7, 2019

Hi, from my point of view the pillars of future services are Google protobuf[1] and gRPC. Protobuf can be used for configuration files[2], tracing/logging[3] and storage[4]. gRPC is built on top-of HTTP2 and is using the protobuf IDL and marshaling. Many projects (etcd, envoy, Google Cloud, ...) provide a gRPC based API (and some automatically map this from REST to gRPC) already and I would like to build clients and servers in Pharo. My plan of action is to start with a protobuf compiler/model and then look into binding the gRPC C implementation to Pharo. I have started with gokr's Protobuf code on Smalltalkhub and defined base types and a Slot and could use some help to structure this more nicely. The code is at: https://github.com/zecke/pharo-protobuf and I could use some comments/review of how to use Slots in a significant way (add "type" validation on write, constraint checks, builder pattern?). Given a definition like: syntax = "proto2"; package foo; enum Color { RED = 0; GREEN = 1; BLUE = 2; } message MyMessage { optional Color color = 1; } And an encoded binary message of #[8 2] the following can: PBTestMessage materializeFrom: #[8 2] readStream decode and set the color field. Proper handling of mandatory and repeated fields are missing and decoding the other values, nested messages... :) Looking forward to have some eyes on the code. holger [1] A simple IDL to define structs/enums with marshaller/materializer for a binary protocol, JSON (and yaml). [2] Without having to write a XML/JSON schema and getting validation from the IDL. [3] Many of us log structured to text, then have something like logstash to re-parse, regexp it and dump it into ElasticSearch. With protobuf we can have plain objects end to end for logging. [4] We have FUEL so this is less interesting for us than others but quite interesting if you are mixing Pharo with other implementation languages.

3 4

How exactly is "share repositories between images" supposed to work without tripping each other up?
by Tim Mackinnon March 6, 2019

March 6, 2019

Hi - as many windows users have struggled with the long file path problem (some of which can be caused by orphaned files not even referenced in your baseline - but that were checked in) - many users have started using the "share repositories between imagesâ and point it to a nice short file path (at least we have a workaround). This got us running on Exercism - and unblocked our testers. However - I was suprised when I asked one of our users to update his image to pull in some new code that fixed an issue for him (Itâs the first time I've encountered a conflict and had to use onConflict - and Iâm not sure why there is a conflict - but thats a side point). Metacello new baseline: 'Exercism'; repository: 'github://exercism/pharo-smalltalk:master/dev/src'; onConflict: [ :ex | ex allow ]; load. So doing the above on OSX loads the update into my older image, and everything was fine. However on Windows - one of my testers tried the same thing and got a strange error: âNotFound: failed to resolve path âC:\pharo\images\Exercism test\pharo-localâ¦.â (See photo below). The weird bit is that we arenât sure where the âExercism testâ bit comes from because his image isnât "Exercism testâ - however I suspect that this is one of the other images he created when we were testing 64 bit and he was loading into that. So my question is - how is this shared repository supposed to work? It seems to me that different images are storing non-sharable information in the repository such that sharing canât possibly work? As my baseline and setup are really simple - Iâm suprised by this - there is literally 4 packages and one external dependency on OSProcess (which is an mcz I think). So why does this fail? Iâve always avoided the shared repository as when I initially tried it, I recall all kinds of weird behaviour - but as the windows folks canât seem to avoid it - can someone explain what it does and what we need to look out for? Tim

6 6