- Pharo-users - lists.pharo.org

Re: [Pharo-users] Pharo 7.0 image size

by Trussardi Dario Romano

Ciao, this morning i started with an image of about 240 MB. I have 3 System Browser open ( for a long time ). I close all the System Browser and save the image. The image size after the save is about 131 MB. The new SpaceTally printSpaceAnalysis report: Class code space # instances inst space percent inst average size Array 4115 561766 37353480 25.60 66.49 ByteString 2942 249761 31313136 21.50 125.37 The Transcript entry reference basically does not change: ByteString allInstances select:[ :i | i includesSubstring: 'NETWORK' ] where 'NETWORK' is a string used in the methods to add Transcript entry Transcript show: ...... NETWORK' ......' . The system found 2958 ByteString instances.... ( relative to the NETWORK ) The system found 22655 ByteString instances.... ( relative to the CASH ) Why are there many references in the system to the ByteString instances, created in the methods to report the data in Transcript ? Someone to considerations ? Thanks, Dario > Ciao, > > I thought that using Transcript as a report to analyze the operation of the code was a good thing - solution. > > Unfortunately, however, the size of the image continues to increase ( and I think it's due to the use of the transcript ) > > and i can not find the solution to avoid the problem. > > I could create a file to report everything about the operations code, but then it becomes difficult to manage, or am i wrong? > > Other solutions - indications - references ? > > Thanks, > > Dario > >> Ciao, >> >> thanks. >> >> i have a Pharo 7.0 alpha build 1262. >> >> I development a Seaside application. >> >>> May be you have a lot of still open Seaside session, which if I remember >>> correctly are automatically shutdown after 10 min when not active. >>> >>> Looking at Seaside session instances may give clue. >> >> OK, i clear the seaside session with the relative seaside status Clear action. >> >> >> >> But the image size keeps increasing, without an apparent reason. >> >> The consideration that I can do and that in the method code i often use Transcript show: '.....NETWORK | CASH | .....' to check the correct functioning. >> >> With the SpaceTally printSpaceAnalysis i note: >> >> as of February 16th: >> >> Class code space # in stances inst space percent inst average size >> Array 4115 656764 43904528 23.30 66.85 >> ByteString 2942 233871 27527272 14.60 117.70 >> >> >> as of March 4th >> Class code space # instances inst space percent inst average size >> Array 4115 837017 50564552 23.40 60.41 >> ByteString 2942 266620 31933216 14.80 119.77 >> >> Now i do: >> >> ByteString allInstances select:[ :i | i includesSubstring: 'NETWORK' ] >> >> where 'NETWORK' is a string used in the Transcript show: ...... NETWORK' ......' report entry. >> >> >> The system found 3214 ByteString instances.... ( relative to the NETWORK ) >> >> The system found 22650 ByteString instances.... ( relative to the CASH ) >> >> The system found .............. >> >> >> Because ????? >> >> >> Does the system remember something about the string create for the Transcript show: entry ? >> >> I need to reset something? >> >> How can I analyze the situation? >> >> I follow some aByteString entry with the pointersTo method >> >> but for now I have not found the solution. >> >> >> >> Thanks, >> >> Dario >> >> > >

March 8, 2019

Re: [Pharo-users] Pharo 7.0 image size

by Trussardi Dario Romano

Ciao, this morning i started with an image of about 240 MB. I have 3 System Browser open ( for a long time ). I close all the System Browser and save the image. The image size after the save is about 131 MB. The new SpaceTally printSpaceAnalysis report: Class code space # instances inst space percent inst average size Array 4115 561766 37353480 25.60 66.49 ByteString 2942 249761 31313136 21.50 125.37 The Transcript entry reference basically does not change: ByteString allInstances select:[ :i | i includesSubstring: 'NETWORK' ] where 'NETWORK' is a string used in the methods to add Transcript entry Transcript show: ...... NETWORK' ......' . The system found 2958 ByteString instances.... ( relative to the NETWORK ) The system found 22655 ByteString instances.... ( relative to the CASH ) Why are there many references in the system to the ByteString instances, created in the methods to report the data in Transcript ? Someone to considerations ? Thanks, Dario > Ciao, > > I thought that using Transcript as a report to analyze the operation of the code was a good thing - solution. > > Unfortunately, however, the size of the image continues to increase ( and I think it's due to the use of the transcript ) > > and i can not find the solution to avoid the problem. > > I could create a file to report everything about the operations code, but then it becomes difficult to manage, or am i wrong? > > Other solutions - indications - references ? > > Thanks, > > Dario > >> Ciao, >> >> thanks. >> >> i have a Pharo 7.0 alpha build 1262. >> >> I development a Seaside application. >> >>> May be you have a lot of still open Seaside session, which if I remember >>> correctly are automatically shutdown after 10 min when not active. >>> >>> Looking at Seaside session instances may give clue. >> >> OK, i clear the seaside session with the relative seaside status Clear action. >> >> >> >> But the image size keeps increasing, without an apparent reason. >> >> The consideration that I can do and that in the method code i often use Transcript show: '.....NETWORK | CASH | .....' to check the correct functioning. >> >> With the SpaceTally printSpaceAnalysis i note: >> >> as of February 16th: >> >> Class code space # in stances inst space percent inst average size >> Array 4115 656764 43904528 23.30 66.85 >> ByteString 2942 233871 27527272 14.60 117.70 >> >> >> as of March 4th >> Class code space # instances inst space percent inst average size >> Array 4115 837017 50564552 23.40 60.41 >> ByteString 2942 266620 31933216 14.80 119.77 >> >> Now i do: >> >> ByteString allInstances select:[ :i | i includesSubstring: 'NETWORK' ] >> >> where 'NETWORK' is a string used in the Transcript show: ...... NETWORK' ......' report entry. >> >> >> The system found 3214 ByteString instances.... ( relative to the NETWORK ) >> >> The system found 22650 ByteString instances.... ( relative to the CASH ) >> >> The system found .............. >> >> >> Because ????? >> >> >> Does the system remember something about the string create for the Transcript show: entry ? >> >> I need to reset something? >> >> How can I analyze the situation? >> >> I follow some aByteString entry with the pointersTo method >> >> but for now I have not found the solution. >> >> >> >> Thanks, >> >> Dario >> >> > >

March 8, 2019

ldap, Pier3 & git migration

by Albrecht Baur

Hi, In case someone can use it: I used Peters git migration tool for ... http://smalltalkhub.com/#!/~PharoExtras/LDAP/ ... and put it to: https://github.com/a2b-alb/PharoExtras-LDAP I don't know if this is the right place or if you would rather have it under ... https://github.com/pharo-contributions/ ... or somewhere else. ------------- here the question: I started trying to do the same migration process for ... http://www.smalltalkhub.com/#!/~Pier/Pier3 ... but I failed on errors loading older mcz files: "instance of ByteString did not understand #peek" on: MCMczReader >> contentsForMember: (ZnInvalidUTF8: Illegal leading byte for utf-8 encoding) Is this wrong encoding or corrupted files ? How to treat these files ? -> Is just ignoring this majority of failing mcz files via migration ignoredFileNames: #() ok ? ------------- As a workaround I then left the history versions behind and took only the newest mcz files. But I am not sure which package version "is in harmony" with the other ones...Â ;-) -> While trying out which versions of the ConfigurationOfPier3 load in a p7 image only the #stable one loaded without problems. The newer ones didn't. I did this by first loading as much pier3 dependencies (seaside, magritte, ...) from the new github repos. So I can then say ... onConflict: [ :e | e useLoaded ]; ... when loading pier3 from smaltalkhub. Can someone who knows pier3 better than me, give me a hint on which package versions combinations are the ones to go with ? -> Is to just start with the newest mcz files the way to go? Or should I use the #stable ConfigurationOfPier3 ? best, Albrecht

March 8, 2019

Lightweight name spacing or shadowing - anything that can help me load conflicting code?

by Tim Mackinnon

Hi - as I work through the different strands fo exercism (which has been a great project to kick different corners of Pharo) - Iâve hit an area where Iâm wondering if there might be some useful tricks/techniques/ideas to help â¦ Essentially - I want to make mentoring easier (so hopefully people on this list might consider being a Pharo Exercism mentor). While there are basic review tools on exercism.io - reading code in Tonel only gets you so farâ¦ So there is an endpoint for mentors to load in code (much like we already read in the exercises for users, and then use the TonelReader to parse and compile the code so its ready to run - a nice property of recent Pharo changes is that its quite happy to compile missing classes/methods and let you later fill those in, inside the debugger - it makes TDD awesome). However - it would be nice if mentors could have the current solutions loading in an image, and then could load in the users submission (via a tool hitting the endpoint - and doing the same TonelReader stuff). The issue of course is that you have a name clash - their solution and the reference solution. So I could possibly walk the ast of the parsed solution and adjust the names (putting a user prefix) - and possibly the refactoring tools will also let me detect references to those names and then let adjust those too (I also will have the thorny issue of extension methods - although its a rare edge case I could ignore). But Iâm wondering if there is something neater that might work? Can I load these as âshadow classes/methodsâ somehow (when you browse Monticello package versions I recall you could see code in a browser - and I guess iceberg does that too?). This might work - although it doesnât let me run the code and see any errors - but it might be good enough. Or is there some way of having a cheap alternate Smalltalk context where I can load that code so it doesnât collide. I guess this is edging on full namespaces - but I think my problem might be more confined and possibly doable more easily (than a general namespace solution that has to work for everything). Anyone have any thoughts - pointers? I know namespaces is very controversial, but maybe this might be simpler? Tim

March 8, 2019

Re: [Pharo-users] Parsing text to discover general data of interest (phone, email, address, ...)

by CÃ©drick BÃ©ler

> > > You say that named entity recognition is not generalised beyond Mail, > but the support library is there for anyone to use. See for > example https://developer.apple.com/documentation/foundation/nslinguistictagger/ide… <https://developer.apple.com/documentation/foundation/nslinguistictagger/ide…> Yes true. > > In Python, you can use NLTK to do roughly the same. > > There's no real point in reimplementing this stuff in Pharo. > Just set up a separate process, send text to it, and receive > results back. I agree, that is an excellent option. "NLTK is a leading platform for building Python programs to work with human language data. It provides easy-to-use interfaces to over 50 corpora and lexical resources <http://nltk.org/nltk_data/> such as WordNet, along with a suite of text processing libraries for classification, tokenization, stemming, tagging, parsing, and semantic reasoning, wrappers for industrial-strength NLP libraries, and an active discussion forum <http://groups.google.com/group/nltk-users>." Thanks for pointing NLTK. Great tool for sure. I agree that there no point in reimplementing but in this case of NLP, this might worth it as I think we have already all good foundations (Basic string manipulation, PP, Zn, XML, etcâ¦). The hard stuff is probably the integration of 100 corpora and lexical ressources (http://www.nltk.org/nltk_data/) The thing is I need a lighter version, based on my own (growing) corpora (my experience). So Hernan solution, PP, or straight string processing would do the job. But thanks, this is something I will explore too (especially the luges ressources). Cheers, CÃ©drick > > > On Thu, 7 Mar 2019 at 22:53, CÃ©drick BÃ©ler <cdrick65(a)gmail.com <mailto:cdrick65@gmail.com>> wrote: > Hi all, > > Iâve often got the need to analyse some random unstructured text to discover (structured) information (in email for instance), to extract : > - emails > - telephone numbers > - addresses > - events > - person names (according to a list of known persons), > - etcâ¦ > > Apple do it in email for instance (strangely, this is not generalized). > > > So my questions are : > - do we have something equivalent in Smalltalk/Pharo ? (I didnât find) > - if not, what strategy would you use ? > => I do really stupid text analysis (substrings, finding @, â¦, parsing according to the text structure when there isâ¦ kind of Soup parsingâ¦) > => I feel this is a job for PetitParser ? And would be a nice feet to the new GToolkit. > > All ideas or suggestions are welcome ;-) > > > TIA, > > CÃ©drick > > >

March 8, 2019

Re: [Pharo-users] Parsing text to discover general data of interest (phone, email, address, ...)

by CÃ©drick BÃ©ler

Hi Hernan, Really nice. I try it today. It might be what I need. I come back if installation pb. Cheers, CÃ©drick > Le 8 mars 2019 Ã 03:34, HernÃ¡n Morales Durand <hernan.morales(a)gmail.com> a Ã©crit : > > Hi CÃ©drick, > > I wrote some years ago an interface to a named-entity recognizer: > https://80738163270632.blogspot.com/2015/02/stner-interface-to-stanford-nam… > > I think that was Pharo 5, so you may want to check if there are load > problems in current Pharo. > > The blogger post didn't parsed correctly the output but for the input: > > StSocketNERClient new > tagText: 'Argentina President Kirchner has been asked to testify in > court on the death of Alberto Nisman the crusading prosecutor who had > accused her of conspiring to cover up involvement of Iran' > > > output would be: > > '<location>Argentina</LOCATION> President <person>Kirchner</PERSON> > has been asked to testify in court on the death of <person>Alberto > Nisman</PERSON> the crusading prosecutor who had accused her of > conspiring to cover up involvement of <location>Iran</LOCATION>' > > Cheers, > > HernÃ¡n > > El jue., 7 mar. 2019 a las 6:53, CÃ©drick BÃ©ler (<cdrick65(a)gmail.com>) escribiÃ³: >> >> Hi all, >> >> Iâve often got the need to analyse some random unstructured text to discover (structured) information (in email for instance), to extract : >> - emails >> - telephone numbers >> - addresses >> - events >> - person names (according to a list of known persons), >> - etcâ¦ >> >> Apple do it in email for instance (strangely, this is not generalized). >> >> >> So my questions are : >> - do we have something equivalent in Smalltalk/Pharo ? (I didnât find) >> - if not, what strategy would you use ? >> => I do really stupid text analysis (substrings, finding @, â¦, parsing according to the text structure when there isâ¦ kind of Soup parsingâ¦) >> => I feel this is a job for PetitParser ? And would be a nice feet to the new GToolkit. >> >> All ideas or suggestions are welcome ;-) >> >> >> TIA, >> >> CÃ©drick >> >> >> >

March 8, 2019

Re: [Pharo-users] Parsing text to discover general data of interest (phone, email, address, ...)

by CÃ©drick BÃ©ler

> Couldn't find anything in Smalltalk but that should you give ideas and inspire you or get you started... > > https://github.com/search?q=contact+scraping&type=Repositories > > I guess we have all that's needed in Pharo : parsers (HTML, XML, PetitParser), Soup & regex ! Yes for markup, I played already quite much with Soup initially at first but then XPath which os far more convenient and direct. PetitParser(2) is also a pure gem. I finally understand it better. Grammar and Parser are interesting but maybe more appropriate for structured/semi/structured texts. Pure text, is nice with tools like those Richard just showed. I continue to play with PetitParser2 today (finishing tutorialâ¦). Cheers, CÃ©drick > > On 2019-03-07 04:52, CÃ©drick BÃ©ler wrote: >> Hi all, >> >> Iâve often got the need to analyse some random unstructured text to discover (structured) information (in email for instance), to extract : >> - emails >> - telephone numbers >> - addresses >> - events >> - person names (according to a list of known persons), >> - etcâ¦ >> >> Apple do it in email for instance (strangely, this is not generalized). >> >> >> So my questions are : >> - do we have something equivalent in Smalltalk/Pharo ? (I didnât find) >> - if not, what strategy would you use ? >> => I do really stupid text analysis (substrings, finding @, â¦, parsing according to the text structure when there isâ¦ kind of Soup parsingâ¦) >> => I feel this is a job for PetitParser ? And would be a nice feet to the new GToolkit. >> >> All ideas or suggestions are welcome ;-) >> >> >> TIA, >> >> CÃ©drick >> >> >> > -- > ----------------- > BenoÃ®t St-Jean > Yahoo! Messenger: bstjean > Twitter: @BenLeChialeux > Pinterest: benoitstjean > Instagram: Chef_Benito > IRC: lamneth > Blogue: endormitoire.wordpress.com > "A standpoint is an intellectual horizon of radius zero". (A. Einstein) > > > >

March 8, 2019

Re: [Pharo-users] Parsing text to discover general data of interest (phone, email, address, ...)

by Richard O'Keefe

You say that named entity recognition is not generalised beyond Mail, but the support library is there for anyone to use. See for example https://developer.apple.com/documentation/foundation/nslinguistictagger/ide… In Python, you can use NLTK to do roughly the same. There's no real point in reimplementing this stuff in Pharo. Just set up a separate process, send text to it, and receive results back. On Thu, 7 Mar 2019 at 22:53, CÃ©drick BÃ©ler <cdrick65(a)gmail.com> wrote: > Hi all, > > Iâve often got the need to analyse some random unstructured text to > discover (structured) information (in email for instance), to extract : > - emails > - telephone numbers > - addresses > - events > - person names (according to a list of known persons), > - etcâ¦ > > Apple do it in email for instance (strangely, this is not generalized). > > > So my questions are : > - do we have something equivalent in Smalltalk/Pharo ? (I didnât find) > - if not, what strategy would you use ? > => I do really stupid text analysis (substrings, finding @, â¦, parsing > according to the text structure when there isâ¦ kind of Soup parsingâ¦) > => I feel this is a job for PetitParser ? And would be a nice feet to the > new GToolkit. > > All ideas or suggestions are welcome ;-) > > > TIA, > > CÃ©drick > > > >

March 8, 2019

Re: [Pharo-users] Parsing text to discover general data of interest (phone, email, address, ...)

by HernÃ¡n Morales Durand

Hi CÃ©drick, I wrote some years ago an interface to a named-entity recognizer: https://80738163270632.blogspot.com/2015/02/stner-interface-to-stanford-nam… I think that was Pharo 5, so you may want to check if there are load problems in current Pharo. The blogger post didn't parsed correctly the output but for the input: StSocketNERClient new tagText: 'Argentina President Kirchner has been asked to testify in court on the death of Alberto Nisman the crusading prosecutor who had accused her of conspiring to cover up involvement of Iran' output would be: '<location>Argentina</LOCATION> President <person>Kirchner</PERSON> has been asked to testify in court on the death of <person>Alberto Nisman</PERSON> the crusading prosecutor who had accused her of conspiring to cover up involvement of <location>Iran</LOCATION>' Cheers, HernÃ¡n El jue., 7 mar. 2019 a las 6:53, CÃ©drick BÃ©ler (<cdrick65(a)gmail.com>) escribiÃ³: > > Hi all, > > Iâve often got the need to analyse some random unstructured text to discover (structured) information (in email for instance), to extract : > - emails > - telephone numbers > - addresses > - events > - person names (according to a list of known persons), > - etcâ¦ > > Apple do it in email for instance (strangely, this is not generalized). > > > So my questions are : > - do we have something equivalent in Smalltalk/Pharo ? (I didnât find) > - if not, what strategy would you use ? > => I do really stupid text analysis (substrings, finding @, â¦, parsing according to the text structure when there isâ¦ kind of Soup parsingâ¦) > => I feel this is a job for PetitParser ? And would be a nice feet to the new GToolkit. > > All ideas or suggestions are welcome ;-) > > > TIA, > > CÃ©drick > > >

March 8, 2019

Re: [Pharo-users] Pharo 7.0 image size

by Trussardi Dario Romano

Ciao, I thought that using Transcript as a report to analyze the operation of the code was a good thing - solution. Unfortunately, however, the size of the image continues to increase ( and I think it's due to the use of the transcript ) and i can not find the solution to avoid the problem. I could create a file to report everything about the operations code, but then it becomes difficult to manage, or am i wrong? Other solutions - indications - references ? Thanks, Dario > Ciao, > > thanks. > > i have a Pharo 7.0 alpha build 1262. > > I development a Seaside application. > >> May be you have a lot of still open Seaside session, which if I remember >> correctly are automatically shutdown after 10 min when not active. >> >> Looking at Seaside session instances may give clue. > > OK, i clear the seaside session with the relative seaside status Clear action. > > > > But the image size keeps increasing, without an apparent reason. > > The consideration that I can do and that in the method code i often use Transcript show: '.....NETWORK | CASH | .....' to check the correct functioning. > > With the SpaceTally printSpaceAnalysis i note: > > as of February 16th: > > Class code space # in stances inst space percent inst average size > Array 4115 656764 43904528 23.30 66.85 > ByteString 2942 233871 27527272 14.60 117.70 > > > as of March 4th > Class code space # instances inst space percent inst average size > Array 4115 837017 50564552 23.40 60.41 > ByteString 2942 266620 31933216 14.80 119.77 > > Now i do: > > ByteString allInstances select:[ :i | i includesSubstring: 'NETWORK' ] > > where 'NETWORK' is a string used in the Transcript show: ...... NETWORK' ......' report entry. > > > The system found 3214 ByteString instances.... ( relative to the NETWORK ) > > The system found 22650 ByteString instances.... ( relative to the CASH ) > > The system found .............. > > > Because ????? > > > Does the system remember something about the string create for the Transcript show: entry ? > > I need to reset something? > > How can I analyze the situation? > > I follow some aByteString entry with the pointersTo method > > but for now I have not found the solution. > > > > Thanks, > > Dario > >

March 7, 2019