- Pharo-users - lists.pharo.org

Re: [Pharo-users] NeoCSV and big files

by Norbert Hartl

> Am 04.04.2015 um 19:23 schrieb Serge Stinckwich <serge.stinckwich(a)gmail.com>: > > Dear all, > We are currently setup a small ROASSAL team to participate to > #Datathon Data for Development: > http://simplon.co/datathon-data-for-development-rdv-les-7-et-8-avril-a-mont… > > We are looking to ways to be able to load big CSV table in a Pharo image. > Apparently the size of some CSV files provided will be huge (around 5 > Go for one month of data). The format of the data are describe here: > http://arxiv.org/abs/1407.4885 > > Is this possible with NeoCSV, to read only a fraction of the lines > regarding some conditions ? > The NeoCSVReader supports the necessary stream protocol. If you setup the csv reader you can call #next on it and filter by condition. There is also #atEnd so a simple loop should. But I never used to csv reader so Sven might have much better options. Norbert > If some people want to help online, we can organize a chat to organize us. > Regards, > -- > Serge Stinckwich > UCBN & UMI UMMISCO 209 (IRD/UPMC) > Every DSL ends up being Smalltalk > http://www.doesnotunderstand.org/ >

April 4, 2015

NeoCSV and big files

by Serge Stinckwich

Dear all, We are currently setup a small ROASSAL team to participate to #Datathon Data for Development: http://simplon.co/datathon-data-for-development-rdv-les-7-et-8-avril-a-mont… We are looking to ways to be able to load big CSV table in a Pharo image. Apparently the size of some CSV files provided will be huge (around 5 Go for one month of data). The format of the data are describe here: http://arxiv.org/abs/1407.4885 Is this possible with NeoCSV, to read only a fraction of the lines regarding some conditions ? If some people want to help online, we can organize a chat to organize us. Regards, -- Serge Stinckwich UCBN & UMI UMMISCO 209 (IRD/UPMC) Every DSL ends up being Smalltalk http://www.doesnotunderstand.org/

April 4, 2015

How do I get the list of projects on SmalltalkHub?

by stepharo

Where can we find this information as a newbie? Stef

April 4, 2015

Re: [Pharo-users] How to silently generate and remove code

by stepharo

Thierry this means that generating ring objects would help you? I guess so. stef Le 30/3/15 16:25, Thierry Goubier a Ã©crit : > A use case: > > the ability to test and debug the code generation part of SmaCC. > > SmaCC, when compiling a parser, generates dozens of classes and > hundreds of methods, some of those very long, as a sequence of > refactorings (and optimise them). > > Then SmaCC apply them all in one step. > > I'd dream of having a virtual environment where I could test-compile > and check all those methods, via a system browser, before they are > compiled. > > Thierry > > 2015-03-30 9:10 GMT+02:00 Marcus Denker <marcus.denker(a)inria.fr > <mailto:marcus.denker@inria.fr>>: > > > > On 29 Mar 2015, at 10:32, stepharo <stepharo(a)free.fr > <mailto:stepharo@free.fr>> wrote: > > > > Before that I would like that the compiler outputs classes > definition in an environment (that can be the default one) but > that can be the one > > I want and specified from the outside of the compiler. > > For installing, it is the ClassInstaller that does that (and yes, > it has an environment). > > What the compiler does not have is to look up references e.g. to > symbols regarding to an environment, but that is because we > donât have that concept right now in the system in general. > globals/class vars are requested from the class (which defines its > environment). > > So in general, we first need a use case, else it is not clear what > to doâ¦ > > > Marcus > >

April 4, 2015

Re: [Pharo-users] How to silently generate and remove code

by stepharo

Le 30/3/15 09:10, Marcus Denker a Ã©crit : >> On 29 Mar 2015, at 10:32, stepharo <stepharo(a)free.fr> wrote: >> >> Before that I would like that the compiler outputs classes definition in an environment (that can be the default one) but that can be the one >> I want and specified from the outside of the compiler. > For installing, it is the ClassInstaller that does that (and yes, it has an environment). > > What the compiler does not have is to look up references e.g. to symbols regarding to an environment, but that is because we > donât have that concept right now in the system in general. globals/class vars are requested from the class (which defines its environment). > > So in general, we first need a use case, else it is not clear what to doâ¦ Sc1: Imagine that Max wants to load code that if the code is incomplete or contains Undefined the code is not loaded at all. To do so we need to be able to compile the code in a separate namespace. Then on success copy/install to another one. sd := SystemDictionary new. OpalCompiler inputEnvironment: Smalltalk globals outputEnvironment: sd. This shows that probably sd should be linked to Smalltalk globals to be able to find new added class (that will not be found in sd). Sc2: We should be able to compile Opal beside Opal in a sister environment, modify it by compiling method there. Sc3: Guillermo's Tornado Infrastructure. Instead of installing, copying manually and hacking, probably that guillermo needs a compiling infrastructure were we can say - look for literals in this special array or environemtn - look for globals in this one - put the returns in the other literalas environment and globals. Stef

April 4, 2015

Re: [Pharo-users] IconFactory - utility for creating icons in Pharo

by kilon alios

No really I dont get the idea, composition decomposition is the bread and butter of collection types in any language. Unless pharo has a weakness in this area that I am not aware of, in python I had never such problem. actually its a foremost reason to use them in the first place. Browsing is a limitation of the browser which does not provide a special view for variables but not that hard to amend with inspector. And I find hard to believe you prefer a ton of short methods instead one short one for returning those values. The only reason I can think in this case of icons is that compiling a string as return value of a method to be used statically is easier/ more convenient than defining a huge collection in the initialize method. on the other hand would not make more sense to have all this data that means nothing for the user as separate files and let them load at the startup of the image ? Its not as if anyone would bother editing those huge gibberish strings . Thats the only way I see for avoiding long methods. Or am I missing something here ? On Sat, Apr 4, 2015 at 6:01 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > Because composition/decomposition is good (among others for re-use), > because with separate entries you can browse them more easily, because we > don't like long methods, ... You get the idea ;-) > > > On 04 Apr 2015, at 16:45, kilon alios <kilon.alios(a)gmail.com> wrote: > > > > once more I really dont like idea of methods returning single values. > This also one of the reasons why Spec annoys me. Why not have Collection / > Dictionary that stores all these strings ? Having 100 methods for 100 icons > seems really ugly . Instead one collection with 100 entries and a single > method would be more than enough. > > > > I know its not just you that do this and is how icons work in Pharo > .Its basically how many things work like this inside Pharo. But I still > dont get it.... why ? > > > > On Sat, Apr 4, 2015 at 5:15 PM, Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: > > Aha, of course. > > The program makes assumptions about the file name and since it is naming > the method like the file it fails, because you can't have "-" in method > name. > > I could change it so it removes all non-alphanumeric characters from the > name. > > > > Peter > > > > On Sat, Apr 4, 2015 at 3:52 PM, kilon alios <kilon.alios(a)gmail.com> > wrote: > > I found the problem > > > > "Norse_largeThe '-' prefix works only for literal numbers (use #negated > instead) -> -cpcIconContents > > "Private - Method generated with the content of the file File @ > /Users/kilon/Downloads/Norse_large-cpc.png"" > > > > looks like it does not like that i use "-" inside the file name. In the > folder the name of the file is not Norse_large-cpc.png but > Norse-large-cpc.png > > > > "-" has some special meaning here ? > > > > On Sat, Apr 4, 2015 at 4:12 PM, Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: > > create file ? i thought the class only creates methods > > yeah, I mean method > > > > anyway, the method is created , but it does not proceed to next png. > Shouldn create a method for each png it finds in the directory ? > > yes it should, it operates on a collection, so if > > dir allFiles select: [ :each | each extension = 'png' ] > > shows more then one file it should also create a method for each one, > not just the first > > > > Peter > > > > > > > > >

April 4, 2015

Re: [Pharo-users] IconFactory - utility for creating icons in Pharo

by Sven Van Caekenberghe

Because composition/decomposition is good (among others for re-use), because with separate entries you can browse them more easily, because we don't like long methods, ... You get the idea ;-) > On 04 Apr 2015, at 16:45, kilon alios <kilon.alios(a)gmail.com> wrote: > > once more I really dont like idea of methods returning single values. This also one of the reasons why Spec annoys me. Why not have Collection / Dictionary that stores all these strings ? Having 100 methods for 100 icons seems really ugly . Instead one collection with 100 entries and a single method would be more than enough. > > I know its not just you that do this and is how icons work in Pharo .Its basically how many things work like this inside Pharo. But I still dont get it.... why ? > > On Sat, Apr 4, 2015 at 5:15 PM, Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: > Aha, of course. > The program makes assumptions about the file name and since it is naming the method like the file it fails, because you can't have "-" in method name. > I could change it so it removes all non-alphanumeric characters from the name. > > Peter > > On Sat, Apr 4, 2015 at 3:52 PM, kilon alios <kilon.alios(a)gmail.com> wrote: > I found the problem > > "Norse_largeThe '-' prefix works only for literal numbers (use #negated instead) -> -cpcIconContents > "Private - Method generated with the content of the file File @ /Users/kilon/Downloads/Norse_large-cpc.png"" > > looks like it does not like that i use "-" inside the file name. In the folder the name of the file is not Norse_large-cpc.png but Norse-large-cpc.png > > "-" has some special meaning here ? > > On Sat, Apr 4, 2015 at 4:12 PM, Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: > create file ? i thought the class only creates methods > yeah, I mean method > > anyway, the method is created , but it does not proceed to next png. Shouldn create a method for each png it finds in the directory ? > yes it should, it operates on a collection, so if > dir allFiles select: [ :each | each extension = 'png' ] > shows more then one file it should also create a method for each one, not just the first > > Peter > > >

April 4, 2015

Re: [Pharo-users] IconFactory - utility for creating icons in Pharo

by kilon alios

once more I really dont like idea of methods returning single values. This also one of the reasons why Spec annoys me. Why not have Collection / Dictionary that stores all these strings ? Having 100 methods for 100 icons seems really ugly . Instead one collection with 100 entries and a single method would be more than enough. I know its not just you that do this and is how icons work in Pharo .Its basically how many things work like this inside Pharo. But I still dont get it.... why ? On Sat, Apr 4, 2015 at 5:15 PM, Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: > Aha, of course. > The program makes assumptions about the file name and since it is naming > the method like the file it fails, because you can't have "-" in method > name. > I could change it so it removes all non-alphanumeric characters from the > name. > > Peter > > On Sat, Apr 4, 2015 at 3:52 PM, kilon alios <kilon.alios(a)gmail.com> wrote: > >> I found the problem >> >> "Norse_largeThe '-' prefix works only for literal numbers (use #negated >> instead) -> -cpcIconContents >> "Private - Method generated with the content of the file File @ >> /Users/kilon/Downloads/Norse_large-cpc.png"" >> >> looks like it does not like that i use "-" inside the file name. In the >> folder the name of the file is not Norse_large-cpc.png but >> Norse-large-cpc.png >> >> "-" has some special meaning here ? >> >> On Sat, Apr 4, 2015 at 4:12 PM, Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: >> >>> create file ? i thought the class only creates methods >>>> >>> yeah, I mean method >>> >>>> >>>> anyway, the method is created , but it does not proceed to next png. >>>> Shouldn create a method for each png it finds in the directory ? >>>> >>> yes it should, it operates on a collection, so if >>> dir allFiles select: [ :each | each extension = 'png' ] >>> shows more then one file it should also create a method for each one, >>> not just the first >>> >>> Peter >>> >> >> >

April 4, 2015

Re: [Pharo-users] Devnology presentation slides

by Offray Vladimir Luna CÃ¡rdenas

Thanks Stephan and Diego, Added to my zotero subcollection on Smalltalk/Pharo: https://www.zotero.org/groups/diseo_y_creacion_phd_msc_universidad_de_calda… Cheers, Offray El 03/04/15 a las 16:35, Stephan Eggermont escribiÃ³: > On 03/04/15 19:30, stepharo wrote: >> Hi stefan >> >> what were the reactions of the audience? > > We managed to make them think. > > We had a very small, and very knowledgable group, > so we had lots of difficult and interesting questions > and discussions. > > The thing that impressed them the most was the incredibly > short feedback loop when doing debugger driven design, > and the way you talk to your objects. > > We pretty much followed the slides with the exercises, > having a short sample of each of the complexity reducing > things we do in Pharo. > > Stephan > > >

April 4, 2015

Re: [Pharo-users] IconFactory - utility for creating icons in Pharo

by Peter UhnÃ¡k

Aha, of course. The program makes assumptions about the file name and since it is naming the method like the file it fails, because you can't have "-" in method name. I could change it so it removes all non-alphanumeric characters from the name. Peter On Sat, Apr 4, 2015 at 3:52 PM, kilon alios <kilon.alios(a)gmail.com> wrote: > I found the problem > > "Norse_largeThe '-' prefix works only for literal numbers (use #negated > instead) -> -cpcIconContents > "Private - Method generated with the content of the file File @ > /Users/kilon/Downloads/Norse_large-cpc.png"" > > looks like it does not like that i use "-" inside the file name. In the > folder the name of the file is not Norse_large-cpc.png but > Norse-large-cpc.png > > "-" has some special meaning here ? > > On Sat, Apr 4, 2015 at 4:12 PM, Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: > >> create file ? i thought the class only creates methods >>> >> yeah, I mean method >> >>> >>> anyway, the method is created , but it does not proceed to next png. >>> Shouldn create a method for each png it finds in the directory ? >>> >> yes it should, it operates on a collection, so if >> dir allFiles select: [ :each | each extension = 'png' ] >> shows more then one file it should also create a method for each one, not >> just the first >> >> Peter >> > >

April 4, 2015