February 2015 - Pharo-users

Re: [Pharo-users] GSOC 2015 Call for Ideas

by Sven Van Caekenberghe

Well, you are certainly free to contribute. Heuristic interpretation of data could be useful, but looks like an addition on top, the core library should be fast and efficient. > On 18 Feb 2015, at 10:35, Andrea Ferretti <ferrettiandrea(a)gmail.com> wrote: > > For an example of what I am talking about, see > > http://pandas.pydata.org/pandas-docs/version/0.15.2/io.html#csv-text-files > > I agree that this is definitely too much options, but it gets the job > done for quick and dirty exploration. > > The fact is that working with a dump of table on your db, whose > content you know, requires different tools than exploring the latest > opendata that your local municipality has put online, using yet > another messy format. > > Enterprise programmers deal more often with the former, data > scientists with the latter, and I think there is room for both kind of > tools > > 2015-02-18 10:26 GMT+01:00 Andrea Ferretti <ferrettiandrea(a)gmail.com>: >> Thank you Sven. I think this should be emphasized and prominent on the >> home page*. Still, libraries such as pandas are even more lenient, >> doing things such as: >> >> - autodetecting which fields are numeric in CSV files >> - allowing to fill missing data based on statistics (for instance, you >> can say: where the field `age` is missing, use the average age) >> >> Probably there is room for something built on top of Neo >> >> >> * by the way, I suggest that the documentation on Neo could benefit >> from a reorganization. Right now, the first topic on the NeoJSON >> paper introduces JSON itself. I would argue that everyone that tries >> to use the library knows what JSON is already. Still, there is no >> example of how to read JSON from a file in the whole document. >> >> 2015-02-18 10:12 GMT+01:00 Sven Van Caekenberghe <sven(a)stfx.eu>: >>> >>>> On 18 Feb 2015, at 09:52, Andrea Ferretti <ferrettiandrea(a)gmail.com> wrote: >>>> >>>> Also, these tasks >>>> often involve consuming data from various sources, such as CSV and >>>> Json files. NeoCSV and NeoJSON are still a little too rigid for the >>>> task - libraries like pandas allow to just feed a csv file and try to >>>> make head or tails of the content without having to define too much of >>>> a schema beforehand >>> >>> Both NeoCSV and NeoJSON can operate in two ways, (1) without the definition of any schema's or (2) with the definition of schema's and mappings. The quick and dirty explore style is most certainly possible. >>> >>> 'my-data.csv' asFileReference readStreamDo: [ :in | (NeoCSVReader on: in) upToEnd ]. >>> >>> => an array of arrays >>> >>> 'my-data.json' asFileReference readStreamDo: [ :in | (NeoJSONReader on: in) next ]. >>> >>> => objects structured using dictionaries and arrays >>> >>> Sven >>> >>> >

Feb. 18, 2015

Re: [Pharo-users] GSOC 2015 Call for Ideas

by Sven Van Caekenberghe

> On 18 Feb 2015, at 10:26, Andrea Ferretti <ferrettiandrea(a)gmail.com> wrote: > > Thank you Sven. I think this should be emphasized and prominent on the > home page*. Still, libraries such as pandas are even more lenient, > doing things such as: > > - autodetecting which fields are numeric in CSV files > - allowing to fill missing data based on statistics (for instance, you > can say: where the field `age` is missing, use the average age) > > Probably there is room for something built on top of Neo > > > * by the way, I suggest that the documentation on Neo could benefit > from a reorganization. Right now, the first topic on the NeoJSON > paper introduces JSON itself. I would argue that everyone that tries > to use the library knows what JSON is already. Still, there is no > example of how to read JSON from a file in the whole document. These libraries (NeoCSV, NeoJSON, STON) were all written with only a dependency on a limited character stream API. It was a design decision not to depend on a File API, because at the time we were transitioning from the old FileStreams to FileSystem. And I disagree about the JSON introduction ;-) You might know it, but that is not the case for everyone. Like not everyone knows CSV, HTTP, ... But I do agree that sometimes I too would like a convenience method here or there ;-) > 2015-02-18 10:12 GMT+01:00 Sven Van Caekenberghe <sven(a)stfx.eu>: >> >>> On 18 Feb 2015, at 09:52, Andrea Ferretti <ferrettiandrea(a)gmail.com> wrote: >>> >>> Also, these tasks >>> often involve consuming data from various sources, such as CSV and >>> Json files. NeoCSV and NeoJSON are still a little too rigid for the >>> task - libraries like pandas allow to just feed a csv file and try to >>> make head or tails of the content without having to define too much of >>> a schema beforehand >> >> Both NeoCSV and NeoJSON can operate in two ways, (1) without the definition of any schema's or (2) with the definition of schema's and mappings. The quick and dirty explore style is most certainly possible. >> >> 'my-data.csv' asFileReference readStreamDo: [ :in | (NeoCSVReader on: in) upToEnd ]. >> >> => an array of arrays >> >> 'my-data.json' asFileReference readStreamDo: [ :in | (NeoJSONReader on: in) next ]. >> >> => objects structured using dictionaries and arrays >> >> Sven >> >> >

Feb. 18, 2015

Re: [Pharo-users] GSOC 2015 Call for Ideas

by Andrea Ferretti

For an example of what I am talking about, see http://pandas.pydata.org/pandas-docs/version/0.15.2/io.html#csv-text-files I agree that this is definitely too much options, but it gets the job done for quick and dirty exploration. The fact is that working with a dump of table on your db, whose content you know, requires different tools than exploring the latest opendata that your local municipality has put online, using yet another messy format. Enterprise programmers deal more often with the former, data scientists with the latter, and I think there is room for both kind of tools 2015-02-18 10:26 GMT+01:00 Andrea Ferretti <ferrettiandrea(a)gmail.com>: > Thank you Sven. I think this should be emphasized and prominent on the > home page*. Still, libraries such as pandas are even more lenient, > doing things such as: > > - autodetecting which fields are numeric in CSV files > - allowing to fill missing data based on statistics (for instance, you > can say: where the field `age` is missing, use the average age) > > Probably there is room for something built on top of Neo > > > * by the way, I suggest that the documentation on Neo could benefit > from a reorganization. Right now, the first topic on the NeoJSON > paper introduces JSON itself. I would argue that everyone that tries > to use the library knows what JSON is already. Still, there is no > example of how to read JSON from a file in the whole document. > > 2015-02-18 10:12 GMT+01:00 Sven Van Caekenberghe <sven(a)stfx.eu>: >> >>> On 18 Feb 2015, at 09:52, Andrea Ferretti <ferrettiandrea(a)gmail.com> wrote: >>> >>> Also, these tasks >>> often involve consuming data from various sources, such as CSV and >>> Json files. NeoCSV and NeoJSON are still a little too rigid for the >>> task - libraries like pandas allow to just feed a csv file and try to >>> make head or tails of the content without having to define too much of >>> a schema beforehand >> >> Both NeoCSV and NeoJSON can operate in two ways, (1) without the definition of any schema's or (2) with the definition of schema's and mappings. The quick and dirty explore style is most certainly possible. >> >> 'my-data.csv' asFileReference readStreamDo: [ :in | (NeoCSVReader on: in) upToEnd ]. >> >> => an array of arrays >> >> 'my-data.json' asFileReference readStreamDo: [ :in | (NeoJSONReader on: in) next ]. >> >> => objects structured using dictionaries and arrays >> >> Sven >> >>

Feb. 18, 2015

Re: [Pharo-users] GSOC 2015 Call for Ideas

by Andrea Ferretti

Thank you Sven. I think this should be emphasized and prominent on the home page*. Still, libraries such as pandas are even more lenient, doing things such as: - autodetecting which fields are numeric in CSV files - allowing to fill missing data based on statistics (for instance, you can say: where the field `age` is missing, use the average age) Probably there is room for something built on top of Neo * by the way, I suggest that the documentation on Neo could benefit from a reorganization. Right now, the first topic on the NeoJSON paper introduces JSON itself. I would argue that everyone that tries to use the library knows what JSON is already. Still, there is no example of how to read JSON from a file in the whole document. 2015-02-18 10:12 GMT+01:00 Sven Van Caekenberghe <sven(a)stfx.eu>: > >> On 18 Feb 2015, at 09:52, Andrea Ferretti <ferrettiandrea(a)gmail.com> wrote: >> >> Also, these tasks >> often involve consuming data from various sources, such as CSV and >> Json files. NeoCSV and NeoJSON are still a little too rigid for the >> task - libraries like pandas allow to just feed a csv file and try to >> make head or tails of the content without having to define too much of >> a schema beforehand > > Both NeoCSV and NeoJSON can operate in two ways, (1) without the definition of any schema's or (2) with the definition of schema's and mappings. The quick and dirty explore style is most certainly possible. > > 'my-data.csv' asFileReference readStreamDo: [ :in | (NeoCSVReader on: in) upToEnd ]. > > => an array of arrays > > 'my-data.json' asFileReference readStreamDo: [ :in | (NeoJSONReader on: in) next ]. > > => objects structured using dictionaries and arrays > > Sven > >

Feb. 18, 2015

Re: [Pharo-users] GSOC 2015 Call for Ideas

by Sven Van Caekenberghe

> On 18 Feb 2015, at 09:52, Andrea Ferretti <ferrettiandrea(a)gmail.com> wrote: > > Also, these tasks > often involve consuming data from various sources, such as CSV and > Json files. NeoCSV and NeoJSON are still a little too rigid for the > task - libraries like pandas allow to just feed a csv file and try to > make head or tails of the content without having to define too much of > a schema beforehand Both NeoCSV and NeoJSON can operate in two ways, (1) without the definition of any schema's or (2) with the definition of schema's and mappings. The quick and dirty explore style is most certainly possible. 'my-data.csv' asFileReference readStreamDo: [ :in | (NeoCSVReader on: in) upToEnd ]. => an array of arrays 'my-data.json' asFileReference readStreamDo: [ :in | (NeoJSONReader on: in) next ]. => objects structured using dictionaries and arrays Sven

Feb. 18, 2015

Re: [Pharo-users] GSOC 2015 Call for Ideas

by jtuchel＠objektfabrik.de

Andrea, not sure if I would call Sinatra lightweight. If you want to build a RESTFul API, there is absolutely no need for Seaside at all. You can just use the underlying HTTP server layer, in Pharo that would be Zinc. There also is a REST interface for Zinc, so all you need is there already. It's just that there is not enough noise around it ;-) I cannot comment on your machine learning and csv comments. I don't feel a need for these or can live with what's available quite well (e.g. NeoCSV). But that may be due to the fact that I mostly write boring business software, where data files are well-defined for interoperability anyways - or the format is my responsibility, which makes things even easier ;-) . Joachim Am 18.02.15 um 09:52 schrieb Andrea Ferretti: > I am not an expert in Pharo in any conceivable way, but I have tried > to learn it over the past few weeks. > > I think that an area where the interactive tools of Pharo would really > shine is that of data visualization, inspection and mining. Pharo > already has very good tools - such as Roassal2 - for data > visualization, but I think it lacks support for machine learning and > scientific computing in general. The most useful thing I would like to > come to Pharo (apart from performance improvements in the VM itself) > would be something like scikit-learn for python. Also, these tasks > often involve consuming data from various sources, such as CSV and > Json files. NeoCSV and NeoJSON are still a little too rigid for the > task - libraries like pandas allow to just feed a csv file and try to > make head or tails of the content without having to define too much of > a schema beforehand > > The second thing I can think of is a modern, minimal web framework. I > know of Seaside and Seaside REST, but it feels too big and complex. > Most web projects as of today involve some kind of stateless API that > is consumed by single page applications or mobile apps, and Seaside > does not really feel like a good solution for these cases. I would > like to see something much smaller, like Spray (scala) or Sinatra > (ruby). > > 2015-02-17 19:28 GMT+01:00 Serge Stinckwich <serge.stinckwich(a)gmail.com>: >> We have something like 45 projects ideas at the moment. >> We really need more project ideas from more people (not only RMOD guys). >> >> Even if you have a vague idea, you can contribute. >> >> Thank you. >> >> Regards, >> >> On Sun, Feb 15, 2015 at 3:23 PM, Serge Stinckwich >> <serge.stinckwich(a)gmail.com> wrote: >>> Dear pharoers, >>> >>> this year Pharo consortium (and community) is going to take part in a >>> Google Summer of Code event[1] as a standalone organization. This is >>> an opportunity to promote Pharo, get some job done and have students >>> paid. >>> >>> Currently we are at the most important stage as we are preparing the >>> organization application, and hoping that we will be accepted and >>> granted decent amount of project slots. Everyone can help with >>> application by submitting ideas for student projects. >>> >>> Current list can be found at: >>> https://github.com/pharo-project/pharo-project-proposals/blob/master/Topics… >>> >>> It is in STON format, and result is being generated at: http://gsoc.pharo.org/ >>> >>> Please add your ideas following the format of existing projects and >>> open a pull request with them (you will need a github account). >>> Preferably submit ideas with possible mentors, but if none are >>> available at the moment ideas without mentors are also welcome. >>> >>> The template to submit projects is : >>> >>> PharoTopic new >>> title: 'The name of your project; >>> contact: 'email address'; >>> supervisors: 'Supervisors names'; >>> keywords: 'keywords separated by spaces; >>> context: 'a description of the context of the project'; >>> goal: 'description of the goal'; >>> level: 'Beginner or Intermediate or Advanced'; >>> yourself. >>> >>> We will need a lot of projects/idea before February 20th 2015, the >>> deadline for applying to GSOC 2015. >>> >>> Do not hesitate to ask questions. Administrators of this yearâs >>> application are Serge Stinckwich <serge.stinckwich(a)gmail.com> and >>> Yuriy Tymchuk <yuriy.tymchuk(a)me.com> >>> >>> If you don't know how to edit the list, please send your project >>> following the template to the administrators. >>> >>> [1]: https://www.google-melange.com/gsoc/homepage/google/gsoc2015 >>> >>> Cheers, >>> -- >>> Serge Stinckwich >>> UCBN & UMI UMMISCO 209 (IRD/UPMC) >>> Every DSL ends up being Smalltalk >>> http://www.doesnotunderstand.org/ >> >> >> -- >> Serge Stinckwich >> UCBN & UMI UMMISCO 209 (IRD/UPMC) >> Every DSL ends up being Smalltalk >> http://www.doesnotunderstand.org/ >> > -- ----------------------------------------------------------------------- Objektfabrik Joachim Tuchel mailto:jtuchel@objektfabrik.de Fliederweg 1 http://www.objektfabrik.de D-71640 Ludwigsburg http://joachimtuchel.wordpress.com Telefon: +49 7141 56 10 86 0 Fax: +49 7141 56 10 86 1

Feb. 18, 2015

Re: [Pharo-users] GSOC 2015 Call for Ideas

by Andrea Ferretti

I am not an expert in Pharo in any conceivable way, but I have tried to learn it over the past few weeks. I think that an area where the interactive tools of Pharo would really shine is that of data visualization, inspection and mining. Pharo already has very good tools - such as Roassal2 - for data visualization, but I think it lacks support for machine learning and scientific computing in general. The most useful thing I would like to come to Pharo (apart from performance improvements in the VM itself) would be something like scikit-learn for python. Also, these tasks often involve consuming data from various sources, such as CSV and Json files. NeoCSV and NeoJSON are still a little too rigid for the task - libraries like pandas allow to just feed a csv file and try to make head or tails of the content without having to define too much of a schema beforehand The second thing I can think of is a modern, minimal web framework. I know of Seaside and Seaside REST, but it feels too big and complex. Most web projects as of today involve some kind of stateless API that is consumed by single page applications or mobile apps, and Seaside does not really feel like a good solution for these cases. I would like to see something much smaller, like Spray (scala) or Sinatra (ruby). 2015-02-17 19:28 GMT+01:00 Serge Stinckwich <serge.stinckwich(a)gmail.com>: > We have something like 45 projects ideas at the moment. > We really need more project ideas from more people (not only RMOD guys). > > Even if you have a vague idea, you can contribute. > > Thank you. > > Regards, > > On Sun, Feb 15, 2015 at 3:23 PM, Serge Stinckwich > <serge.stinckwich(a)gmail.com> wrote: >> Dear pharoers, >> >> this year Pharo consortium (and community) is going to take part in a >> Google Summer of Code event[1] as a standalone organization. This is >> an opportunity to promote Pharo, get some job done and have students >> paid. >> >> Currently we are at the most important stage as we are preparing the >> organization application, and hoping that we will be accepted and >> granted decent amount of project slots. Everyone can help with >> application by submitting ideas for student projects. >> >> Current list can be found at: >> https://github.com/pharo-project/pharo-project-proposals/blob/master/Topics… >> >> It is in STON format, and result is being generated at: http://gsoc.pharo.org/ >> >> Please add your ideas following the format of existing projects and >> open a pull request with them (you will need a github account). >> Preferably submit ideas with possible mentors, but if none are >> available at the moment ideas without mentors are also welcome. >> >> The template to submit projects is : >> >> PharoTopic new >> title: 'The name of your project; >> contact: 'email address'; >> supervisors: 'Supervisors names'; >> keywords: 'keywords separated by spaces; >> context: 'a description of the context of the project'; >> goal: 'description of the goal'; >> level: 'Beginner or Intermediate or Advanced'; >> yourself. >> >> We will need a lot of projects/idea before February 20th 2015, the >> deadline for applying to GSOC 2015. >> >> Do not hesitate to ask questions. Administrators of this yearâs >> application are Serge Stinckwich <serge.stinckwich(a)gmail.com> and >> Yuriy Tymchuk <yuriy.tymchuk(a)me.com> >> >> If you don't know how to edit the list, please send your project >> following the template to the administrators. >> >> [1]: https://www.google-melange.com/gsoc/homepage/google/gsoc2015 >> >> Cheers, >> -- >> Serge Stinckwich >> UCBN & UMI UMMISCO 209 (IRD/UPMC) >> Every DSL ends up being Smalltalk >> http://www.doesnotunderstand.org/ > > > > -- > Serge Stinckwich > UCBN & UMI UMMISCO 209 (IRD/UPMC) > Every DSL ends up being Smalltalk > http://www.doesnotunderstand.org/ >

Feb. 18, 2015

Re: [Pharo-users] Issues with code formatting

by Nicolai Hess

2015-02-17 21:53 GMT+01:00 sergio_101 <sergio.rrd(a)gmail.com>: > i am using pharo 3.. i don't see many options under pretty printing.. > especially when dealing with cascading... hmmm... > Settings browser -> Refactoring Engine -> Configurable Formatter > > On Tue Feb 17 2015 at 10:35:58 AM Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: > >> Hi, >> >> what version are you using? I see it in the settings under Code Browsing >> > Pretty Printing. >> >> Peter >> >> On Tue, Feb 17, 2015 at 3:17 PM, sergio_101 <sergio.rrd(a)gmail.com> wrote: >> >>> my pretty print is acting much differently than it used to. it seems to >>> be breaking every statement into a separate line. at some point, i remember >>> being able to adjust this via some system settings, but i am not finding >>> that anymore. is this called something different now, or am i just not >>> understanding how it works? >>> >>> thanks! >>> >> >>

Feb. 17, 2015

Re: [Pharo-users] Issues with code formatting

by sergio_101

i am using pharo 3.. i don't see many options under pretty printing.. especially when dealing with cascading... hmmm... On Tue Feb 17 2015 at 10:35:58 AM Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: > Hi, > > what version are you using? I see it in the settings under Code Browsing > > Pretty Printing. > > Peter > > On Tue, Feb 17, 2015 at 3:17 PM, sergio_101 <sergio.rrd(a)gmail.com> wrote: > >> my pretty print is acting much differently than it used to. it seems to >> be breaking every statement into a separate line. at some point, i remember >> being able to adjust this via some system settings, but i am not finding >> that anymore. is this called something different now, or am i just not >> understanding how it works? >> >> thanks! >> > >

Feb. 17, 2015

Re: [Pharo-users] GSOC 2015 Call for Ideas

by Serge Stinckwich

We have something like 45 projects ideas at the moment. We really need more project ideas from more people (not only RMOD guys). Even if you have a vague idea, you can contribute. Thank you. Regards, On Sun, Feb 15, 2015 at 3:23 PM, Serge Stinckwich <serge.stinckwich(a)gmail.com> wrote: > Dear pharoers, > > this year Pharo consortium (and community) is going to take part in a > Google Summer of Code event[1] as a standalone organization. This is > an opportunity to promote Pharo, get some job done and have students > paid. > > Currently we are at the most important stage as we are preparing the > organization application, and hoping that we will be accepted and > granted decent amount of project slots. Everyone can help with > application by submitting ideas for student projects. > > Current list can be found at: > https://github.com/pharo-project/pharo-project-proposals/blob/master/Topics… > > It is in STON format, and result is being generated at: http://gsoc.pharo.org/ > > Please add your ideas following the format of existing projects and > open a pull request with them (you will need a github account). > Preferably submit ideas with possible mentors, but if none are > available at the moment ideas without mentors are also welcome. > > The template to submit projects is : > > PharoTopic new > title: 'The name of your project; > contact: 'email address'; > supervisors: 'Supervisors names'; > keywords: 'keywords separated by spaces; > context: 'a description of the context of the project'; > goal: 'description of the goal'; > level: 'Beginner or Intermediate or Advanced'; > yourself. > > We will need a lot of projects/idea before February 20th 2015, the > deadline for applying to GSOC 2015. > > Do not hesitate to ask questions. Administrators of this yearâs > application are Serge Stinckwich <serge.stinckwich(a)gmail.com> and > Yuriy Tymchuk <yuriy.tymchuk(a)me.com> > > If you don't know how to edit the list, please send your project > following the template to the administrators. > > [1]: https://www.google-melange.com/gsoc/homepage/google/gsoc2015 > > Cheers, > -- > Serge Stinckwich > UCBN & UMI UMMISCO 209 (IRD/UPMC) > Every DSL ends up being Smalltalk > http://www.doesnotunderstand.org/ -- Serge Stinckwich UCBN & UMI UMMISCO 209 (IRD/UPMC) Every DSL ends up being Smalltalk http://www.doesnotunderstand.org/

Feb. 17, 2015