March 2019 - Pharo-users - lists.pharo.org

Re: [Pharo-users] Parsing text to discover general data of interest (phone, email, address, ...)

by CÃ©drick BÃ©ler

Hi Hernan, Really nice. I try it today. It might be what I need. I come back if installation pb. Cheers, CÃ©drick > Le 8 mars 2019 Ã 03:34, HernÃ¡n Morales Durand <hernan.morales(a)gmail.com> a Ã©crit : > > Hi CÃ©drick, > > I wrote some years ago an interface to a named-entity recognizer: > https://80738163270632.blogspot.com/2015/02/stner-interface-to-stanford-nam… > > I think that was Pharo 5, so you may want to check if there are load > problems in current Pharo. > > The blogger post didn't parsed correctly the output but for the input: > > StSocketNERClient new > tagText: 'Argentina President Kirchner has been asked to testify in > court on the death of Alberto Nisman the crusading prosecutor who had > accused her of conspiring to cover up involvement of Iran' > > > output would be: > > '<location>Argentina</LOCATION> President <person>Kirchner</PERSON> > has been asked to testify in court on the death of <person>Alberto > Nisman</PERSON> the crusading prosecutor who had accused her of > conspiring to cover up involvement of <location>Iran</LOCATION>' > > Cheers, > > HernÃ¡n > > El jue., 7 mar. 2019 a las 6:53, CÃ©drick BÃ©ler (<cdrick65(a)gmail.com>) escribiÃ³: >> >> Hi all, >> >> Iâve often got the need to analyse some random unstructured text to discover (structured) information (in email for instance), to extract : >> - emails >> - telephone numbers >> - addresses >> - events >> - person names (according to a list of known persons), >> - etcâ¦ >> >> Apple do it in email for instance (strangely, this is not generalized). >> >> >> So my questions are : >> - do we have something equivalent in Smalltalk/Pharo ? (I didnât find) >> - if not, what strategy would you use ? >> => I do really stupid text analysis (substrings, finding @, â¦, parsing according to the text structure when there isâ¦ kind of Soup parsingâ¦) >> => I feel this is a job for PetitParser ? And would be a nice feet to the new GToolkit. >> >> All ideas or suggestions are welcome ;-) >> >> >> TIA, >> >> CÃ©drick >> >> >> >

March 8, 2019

Re: [Pharo-users] Parsing text to discover general data of interest (phone, email, address, ...)

by CÃ©drick BÃ©ler

> Couldn't find anything in Smalltalk but that should you give ideas and inspire you or get you started... > > https://github.com/search?q=contact+scraping&type=Repositories > > I guess we have all that's needed in Pharo : parsers (HTML, XML, PetitParser), Soup & regex ! Yes for markup, I played already quite much with Soup initially at first but then XPath which os far more convenient and direct. PetitParser(2) is also a pure gem. I finally understand it better. Grammar and Parser are interesting but maybe more appropriate for structured/semi/structured texts. Pure text, is nice with tools like those Richard just showed. I continue to play with PetitParser2 today (finishing tutorialâ¦). Cheers, CÃ©drick > > On 2019-03-07 04:52, CÃ©drick BÃ©ler wrote: >> Hi all, >> >> Iâve often got the need to analyse some random unstructured text to discover (structured) information (in email for instance), to extract : >> - emails >> - telephone numbers >> - addresses >> - events >> - person names (according to a list of known persons), >> - etcâ¦ >> >> Apple do it in email for instance (strangely, this is not generalized). >> >> >> So my questions are : >> - do we have something equivalent in Smalltalk/Pharo ? (I didnât find) >> - if not, what strategy would you use ? >> => I do really stupid text analysis (substrings, finding @, â¦, parsing according to the text structure when there isâ¦ kind of Soup parsingâ¦) >> => I feel this is a job for PetitParser ? And would be a nice feet to the new GToolkit. >> >> All ideas or suggestions are welcome ;-) >> >> >> TIA, >> >> CÃ©drick >> >> >> > -- > ----------------- > BenoÃ®t St-Jean > Yahoo! Messenger: bstjean > Twitter: @BenLeChialeux > Pinterest: benoitstjean > Instagram: Chef_Benito > IRC: lamneth > Blogue: endormitoire.wordpress.com > "A standpoint is an intellectual horizon of radius zero". (A. Einstein) > > > >

March 8, 2019

Re: [Pharo-users] Parsing text to discover general data of interest (phone, email, address, ...)

by Richard O'Keefe

You say that named entity recognition is not generalised beyond Mail, but the support library is there for anyone to use. See for example https://developer.apple.com/documentation/foundation/nslinguistictagger/ide… In Python, you can use NLTK to do roughly the same. There's no real point in reimplementing this stuff in Pharo. Just set up a separate process, send text to it, and receive results back. On Thu, 7 Mar 2019 at 22:53, CÃ©drick BÃ©ler <cdrick65(a)gmail.com> wrote: > Hi all, > > Iâve often got the need to analyse some random unstructured text to > discover (structured) information (in email for instance), to extract : > - emails > - telephone numbers > - addresses > - events > - person names (according to a list of known persons), > - etcâ¦ > > Apple do it in email for instance (strangely, this is not generalized). > > > So my questions are : > - do we have something equivalent in Smalltalk/Pharo ? (I didnât find) > - if not, what strategy would you use ? > => I do really stupid text analysis (substrings, finding @, â¦, parsing > according to the text structure when there isâ¦ kind of Soup parsingâ¦) > => I feel this is a job for PetitParser ? And would be a nice feet to the > new GToolkit. > > All ideas or suggestions are welcome ;-) > > > TIA, > > CÃ©drick > > > >

March 8, 2019

Re: [Pharo-users] Parsing text to discover general data of interest (phone, email, address, ...)

by HernÃ¡n Morales Durand

Hi CÃ©drick, I wrote some years ago an interface to a named-entity recognizer: https://80738163270632.blogspot.com/2015/02/stner-interface-to-stanford-nam… I think that was Pharo 5, so you may want to check if there are load problems in current Pharo. The blogger post didn't parsed correctly the output but for the input: StSocketNERClient new tagText: 'Argentina President Kirchner has been asked to testify in court on the death of Alberto Nisman the crusading prosecutor who had accused her of conspiring to cover up involvement of Iran' output would be: '<location>Argentina</LOCATION> President <person>Kirchner</PERSON> has been asked to testify in court on the death of <person>Alberto Nisman</PERSON> the crusading prosecutor who had accused her of conspiring to cover up involvement of <location>Iran</LOCATION>' Cheers, HernÃ¡n El jue., 7 mar. 2019 a las 6:53, CÃ©drick BÃ©ler (<cdrick65(a)gmail.com>) escribiÃ³: > > Hi all, > > Iâve often got the need to analyse some random unstructured text to discover (structured) information (in email for instance), to extract : > - emails > - telephone numbers > - addresses > - events > - person names (according to a list of known persons), > - etcâ¦ > > Apple do it in email for instance (strangely, this is not generalized). > > > So my questions are : > - do we have something equivalent in Smalltalk/Pharo ? (I didnât find) > - if not, what strategy would you use ? > => I do really stupid text analysis (substrings, finding @, â¦, parsing according to the text structure when there isâ¦ kind of Soup parsingâ¦) > => I feel this is a job for PetitParser ? And would be a nice feet to the new GToolkit. > > All ideas or suggestions are welcome ;-) > > > TIA, > > CÃ©drick > > >

March 8, 2019

Re: [Pharo-users] Pharo 7.0 image size

by Trussardi Dario Romano

Ciao, I thought that using Transcript as a report to analyze the operation of the code was a good thing - solution. Unfortunately, however, the size of the image continues to increase ( and I think it's due to the use of the transcript ) and i can not find the solution to avoid the problem. I could create a file to report everything about the operations code, but then it becomes difficult to manage, or am i wrong? Other solutions - indications - references ? Thanks, Dario > Ciao, > > thanks. > > i have a Pharo 7.0 alpha build 1262. > > I development a Seaside application. > >> May be you have a lot of still open Seaside session, which if I remember >> correctly are automatically shutdown after 10 min when not active. >> >> Looking at Seaside session instances may give clue. > > OK, i clear the seaside session with the relative seaside status Clear action. > > > > But the image size keeps increasing, without an apparent reason. > > The consideration that I can do and that in the method code i often use Transcript show: '.....NETWORK | CASH | .....' to check the correct functioning. > > With the SpaceTally printSpaceAnalysis i note: > > as of February 16th: > > Class code space # in stances inst space percent inst average size > Array 4115 656764 43904528 23.30 66.85 > ByteString 2942 233871 27527272 14.60 117.70 > > > as of March 4th > Class code space # instances inst space percent inst average size > Array 4115 837017 50564552 23.40 60.41 > ByteString 2942 266620 31933216 14.80 119.77 > > Now i do: > > ByteString allInstances select:[ :i | i includesSubstring: 'NETWORK' ] > > where 'NETWORK' is a string used in the Transcript show: ...... NETWORK' ......' report entry. > > > The system found 3214 ByteString instances.... ( relative to the NETWORK ) > > The system found 22650 ByteString instances.... ( relative to the CASH ) > > The system found .............. > > > Because ????? > > > Does the system remember something about the string create for the Transcript show: entry ? > > I need to reset something? > > How can I analyze the situation? > > I follow some aByteString entry with the pointersTo method > > but for now I have not found the solution. > > > > Thanks, > > Dario > >

March 7, 2019

Re: [Pharo-users] Load Tonel package from local folder

by BrunoBB

Hi, Fixed: Iceberg enableMetacelloIntegration: false. I felt with this one again :) regards, bruno -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

March 7, 2019

Re: [Pharo-users] Noob Question - slicing

by Craig Johnson

From: Pharo-users [mailto:pharo-users-bounces@lists.pharo.org] On Behalf Of K K Subbu Sent: Wednesday, 06 March 2019 16:45 To: pharo-users(a)lists.pharo.org Subject: Re: [Pharo-users] Noob Question - slicing > '1234567890' copyFrom: 5 to: 8 "5678" > > Page 207 in Updated Pharo by Example book explains more on substrings. > > HTH .. Subbu Thank you for this, it is perfectly clear. I disregarded the Pharo-by-Example linked from the Pharo.org page, because when I tried to use examples in that book to read text files, I found that the examples did not work under Pharo V7. The book is for Pharo 5. My mistake. If there's a later version of that book available, I'd love to know. Craig

March 7, 2019

Re: [Pharo-users] Load Tonel package from local folder

by BrunoBB

Hi, It seems that my previous image was corrupted. In new Fresh Image the error is the following: IceLibgitErrorVisitor>>visitGenericError: IceLibgitErrorVisitor>>visitERROR: LGit_GIT_ERROR>>acceptError: [ :error | location exists ifTrue: [ location ensureDeleteAll ]. error acceptError: (IceLibgitErrorVisitor onContext: self) ] in IceGitClone>>execute in Block: [ :error | ... BlockClosure>>cull: Context>>evaluateSignal: Context>>handleSignal: LGit_GIT_ERROR(Exception)>>signal LGit_GIT_ERROR class(LGitCallReturnHandler class)>>signalWith: LGitReturnCodeEnum>>handleLGitReturnCode LGitRepository(LGitExternalObject)>>withReturnHandlerDo: LGitRepository>>clone:options:to: LGitRepository>>clone:options: [ location ensureCreateDirectory. repo := LGitRepository on: location. cloneOptions := LGitCloneOptions withCredentialsProvider: (IceCredentialsProvider defaultForRemoteUrl: url). "Keeping references, because if not the GC take them." checkoutOptions := cloneOptions checkoutOptions. callbacks := cloneOptions fetchOptions callbacks. callbacks transferProgress: IceGitTransferProgress new. checkoutOptions checkoutStrategy: LGitCheckoutStrategyEnum git_checkout_force. checkoutOptions progressCallback: IceGitCheckoutProgress new. repo clone: url options: cloneOptions. (LGitRemote of: repo named: 'origin') lookup; setUrl: url ] in IceGitClone>>execute in Block: [ location ensureCreateDirectory.... BlockClosure>>on:do: IceGitClone>>execute IceRepositoryCreator>>cloneRepository [ self validate. self isCloning ifTrue: [ self cloneRepository ] ifFalse: [ self addLocalRepository ] ] in IceRepositoryCreator>>createRepository in Block: [ self validate.... BlockClosure>>on:do: IceRepositoryCreator>>createRepository [ repository := builder createRepository ] in MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryFor: in Block: [ repository := builder createRepository ] BlockClosure>>on:do: MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryFor: [ ^ self createIcebergRepositoryFor: urlToUse ] in MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryWithFallbackFor:url: in Block: [ ^ self createIcebergRepositoryFor: urlToUse ] BlockClosure>>on:do: MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryWithFallbackFor:url: [ | remote | remote := IceGitRemote url: remoteUrl. self createIcebergRepositoryWithFallbackFor: remote url: remoteUrl ] in MCGitHubRepository(MCGitBasedNetworkRepository)>>getOrCreateIcebergRepository in Block: [ | remote |... OrderedCollection(Collection)>>detect:ifFound:ifNone: OrderedCollection(Collection)>>detect:ifNone: MCGitHubRepository(MCGitBasedNetworkRepository)>>getOrCreateIcebergRepository -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

March 7, 2019

Load Tonel package from local folder

by BrunoBB

Hi, I have a very simple Baseline: baselineOf: spec <baseline> spec for: #common do: [ spec baseline: 'NeoJSON' with: [ spec repository: 'github://svenvc/NeoJSON:master/repository' ]. spec baseline: 'P3' with: [ spec repository: 'github://svenvc/P3' ]. spec package: 'Pre-Checkin-Database' with: [ spec requires: #('NeoJSON' 'P3') ]. ] The Baseline file is in: C:\Program Files (x86)\Pharo\pharo-local\pre-checkin\booking-addons\Pre-Checkin\BaselineOfPreCheckinDatabase Also in Development Image the following answer an empty collection: MetacelloToolBox validateBaseline: BaselineOfPreCheckinDatabase. But in a Fresh Image the following evaluation answer an error: Metacello new repository: 'tonel://C:\Program Files (x86)\Pharo\pharo-local\pre-checkin\booking-addons\Pre-Checkin\'; baseline: 'PreCheckinDatabase'; onLock: [ :ex | ex honor ]; load. Any idea what is wrong ? Never worked with Tonel before but fore sure something similar works fine with filetree. Stack: ByteString(Object)>>doesNotUnderstand: #resolve: FileLocator>>resolve FileLocator(AbstractFileReference)>>fileSystem FileLocator(AbstractFileReference)>>/ IceLibgitRepository class>>localRepositoriesLocation IceLibgitRepository class>>repositoriesLocation IceRepositoryCreator>>defaultLocation IceRepositoryCreator>>locationToUse IceRepositoryCreator>>validateNotDuplicated IceRepositoryCreator>>validate [ self validate. self isCloning ifTrue: [ self cloneRepository ] ifFalse: [ self addLocalRepository ] ] in IceRepositoryCreator>>createRepository in Block: [ self validate.... BlockClosure>>on:do: IceRepositoryCreator>>createRepository [ repository := builder createRepository ] in MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryFor: in Block: [ repository := builder createRepository ] BlockClosure>>on:do: MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryFor: [ ^ self createIcebergRepositoryFor: urlToUse ] in MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryWithFallbackFor:url: in Block: [ ^ self createIcebergRepositoryFor: urlToUse ] BlockClosure>>on:do: MCGitHubRepository(MCGitBasedNetworkRepository)>>createIcebergRepositoryWithFallbackFor:url: [ | remote | remote := IceGitRemote url: remoteUrl. self createIcebergRepositoryWithFallbackFor: remote url: remoteUrl ] in MCGitHubRepository(MCGitBasedNetworkRepository)>>getOrCreateIcebergRepository in Block: [ | remote |... OrderedCollection(Collection)>>detect:ifFound:ifNone: OrderedCollection(Collection)>>detect:ifNone: MCGitHubRepository(MCGitBasedNetworkRepository)>>getOrCreateIcebergRepository IceGithubRepositoryType>>mcRepository Iceberg class>>mcRepositoryFor: IceMetacelloPharoPlatform>>createRepository: MetacelloMCBaselineProject(MetacelloMCProject)>>createRepository: MetacelloRepositorySpec>>createRepository [ aSpec createRepository ] in [ :aSpec | | description repo | description := aSpec description. (repo := repositories detect: [ :rep | rep description = description ] ifNone: [ aSpec createRepository ]) ~~ nil ifTrue: [ repos add: repo ] ] in MetacelloEnsureFetchingMCSpecLoader(MetacelloCommonMCSpecLoader)>>repositoriesFrom:ignoreOverrides: in Block: [ aSpec createRepository ] Array(Collection)>>detect:ifFound:ifNone: -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

March 7, 2019

Re: [Pharo-users] Pharo 7.0 image size

by Trussardi Dario Romano

Ciao, thanks. i have a Pharo 7.0 alpha build 1262. I development a Seaside application. > May be you have a lot of still open Seaside session, which if I remember > correctly are automatically shutdown after 10 min when not active. > > Looking at Seaside session instances may give clue. OK, i clear the seaside session with the relative seaside status Clear action. But the image size keeps increasing, without an apparent reason. The consideration that I can do and that in the method code i often use Transcript show: '.....NETWORK | CASH | .....' to check the correct functioning. With the SpaceTally printSpaceAnalysis i note: as of February 16th: Class code space # in stances inst space percent inst average size Array 4115 656764 43904528 23.30 66.85 ByteString 2942 233871 27527272 14.60 117.70 as of March 4th Class code space # instances inst space percent inst average size Array 4115 837017 50564552 23.40 60.41 ByteString 2942 266620 31933216 14.80 119.77 Now i do: ByteString allInstances select:[ :i | i includesSubstring: 'NETWORK' ] where 'NETWORK' is a string used in the Transcript show: ...... NETWORK' ......' report entry. The system found 3214 ByteString instances.... ( relative to the NETWORK ) The system found 22650 ByteString instances.... ( relative to the CASH ) The system found .............. Because ????? Does the system remember something about the string create for the Transcript show: entry ? I need to reset something? How can I analyze the situation? I follow some aByteString entry with the pointersTo method but for now I have not found the solution. Thanks, Dario

March 7, 2019