Am 04.04.2015 um 19:23 schrieb Serge Stinckwich <serge.stinckwich@gmail.com>:
Dear all, We are currently setup a small ROASSAL team to participate to #Datathon Data for Development: http://simplon.co/datathon-data-for-development-rdv-les-7-et-8-avril-a-montr...
We are looking to ways to be able to load big CSV table in a Pharo image. Apparently the size of some CSV files provided will be huge (around 5 Go for one month of data). The format of the data are describe here: http://arxiv.org/abs/1407.4885
Is this possible with NeoCSV, to read only a fraction of the lines regarding some conditions ?
The NeoCSVReader supports the necessary stream protocol. If you setup the csv reader you can call #next on it and filter by condition. There is also #atEnd so a simple loop should. But I never used to csv reader so Sven might have much better options. Norbert
If some people want to help online, we can organize a chat to organize us. Regards, -- Serge Stinckwich UCBN & UMI UMMISCO 209 (IRD/UPMC) Every DSL ends up being Smalltalk http://www.doesnotunderstand.org/