csv2html the Pharo version
Hi, Today I came across some bash code on a web page that loves Smalltalk, ah the horror ;-) http://car.mines-douai.fr/2014/09/csv2html/ The goal is to make it easier to look at CSV data, for which a conversion to HTML was done. To just look at CSV data in a nice tabular form, we do not have to leave Pharo at all. MultiColumnListModel new items: (FileLocator desktop / 'test.csv' readStreamDo: [ :in | (NeoCSVReader on: in) emptyFieldValue: ''; upToEnd ]); displayBlock: [ :x | x ]; title: 'CSV Data'; openWithSpec. Which results in this nice window: To do a conversion to HTML, debugging the code in Pharo should be preferable to doing the same with bash & sed (for most of us anyway). FileLocator desktop / 'csv.html' writeStreamDo: [ :out | | reader | out << '<html><head><title>CSV Data</title></head><body><table border=1>'. reader := NeoCSVReader on: (FileLocator desktop / 'test.csv') readStream. reader emptyFieldValue: ''. out << '<tr bgcolor=silver>'. reader readHeader do: [ :each | out << '<th>'; << each; << '</th>' ]. out << '</tr>'. reader do: [ :each | out << '<tr>'. each do: [ :td | out << '<td>'; << td; << '</td>' ]. out << '</table></body></html>'. reader close ]. Which gives the following output: NeoCSVReader is way more powerful in interpreting CSV files than a simple sed one-liner. Doing the same for a collection of files is easy. Maybe a little browser could even be written. Who knows, maybe Doru will add another tool to GT (TableViewer class>>#openStructuredOn: would do the trick I guess) ;-) Sven PS: The bash script was actually quite well written, even I could read/understand it. Thanks for sharing, it was the inspiration to do this little hack.
Hi Sven, Arg, you got us :-P Shame on us! You are completely right that we could have done that in Pharo. But, Zhi is working since mont on doing realistic robotics simulation on the cluster of the EMD. The goal is to use the SAME code both in simulation and in the real robots. For doing this, he is writing a lot (a LOT) of BASH scripts to automatically prepare simulations on the cluster nodes. Since he is not really fluent in Pharo and since it involves so much system scripting, he is doing it in BASH. I suspect that he took the least resistant path to code the csv to html ... Anyway, at some point we will move from this first prototype to another one so involve Pharo deeper using PhaROS and then we will have more Pharo in the loop ;-) Cheers, #Luc 2014-09-18 10:28 GMT+02:00 Sven Van Caekenberghe <sven@stfx.eu>:
Hi,
Today I came across some bash code on a web page that loves Smalltalk, ah the horror ;-)
http://car.mines-douai.fr/2014/09/csv2html/
The goal is to make it easier to look at CSV data, for which a conversion to HTML was done. To just look at CSV data in a nice tabular form, we do not have to leave Pharo at all.
MultiColumnListModel new items: (FileLocator desktop / 'test.csv' readStreamDo: [ :in | (NeoCSVReader on: in) emptyFieldValue: ''; upToEnd ]); displayBlock: [ :x | x ]; title: 'CSV Data'; openWithSpec.
Which results in this nice window:
To do a conversion to HTML, debugging the code in Pharo should be preferable to doing the same with bash & sed (for most of us anyway).
FileLocator desktop / 'csv.html' writeStreamDo: [ :out | | reader | out << '<html><head><title>CSV Data</title></head><body><table border=1>'. reader := NeoCSVReader on: (FileLocator desktop / 'test.csv') readStream. reader emptyFieldValue: ''. out << '<tr bgcolor=silver>'. reader readHeader do: [ :each | out << '<th>'; << each; << '</th>' ]. out << '</tr>'. reader do: [ :each | out << '<tr>'. each do: [ :td | out << '<td>'; << td; << '</td>' ]. out << '</table></body></html>'. reader close ].
Which gives the following output:
NeoCSVReader is way more powerful in interpreting CSV files than a simple sed one-liner. Doing the same for a collection of files is easy. Maybe a little browser could even be written. Who knows, maybe Doru will add another tool to GT (TableViewer class>>#openStructuredOn: would do the trick I guess) ;-)
Sven
PS: The bash script was actually quite well written, even I could read/understand it. Thanks for sharing, it was the inspiration to do this little hack.
debugging bash is soooooo boring and tedious. I would prefer to debug 100 times in Pharo. Stef On 18/9/14 11:17, Luc Fabresse wrote:
Hi Sven,
Arg, you got us :-P Shame on us! You are completely right that we could have done that in Pharo. But, Zhi is working since mont on doing realistic robotics simulation on the cluster of the EMD. The goal is to use the SAME code both in simulation and in the real robots. For doing this, he is writing a lot (a LOT) of BASH scripts to automatically prepare simulations on the cluster nodes. Since he is not really fluent in Pharo and since it involves so much system scripting, he is doing it in BASH. I suspect that he took the least resistant path to code the csv to html ...
Anyway, at some point we will move from this first prototype to another one so involve Pharo deeper using PhaROS and then we will have more Pharo in the loop ;-)
Cheers,
#Luc
2014-09-18 10:28 GMT+02:00 Sven Van Caekenberghe <sven@stfx.eu <mailto:sven@stfx.eu>>:
Hi,
Today I came across some bash code on a web page that loves Smalltalk, ah the horror ;-)
http://car.mines-douai.fr/2014/09/csv2html/
The goal is to make it easier to look at CSV data, for which a conversion to HTML was done. To just look at CSV data in a nice tabular form, we do not have to leave Pharo at all.
MultiColumnListModel new items: (FileLocator desktop / 'test.csv' readStreamDo: [ :in | (NeoCSVReader on: in) emptyFieldValue: ''; upToEnd ]); displayBlock: [ :x | x ]; title: 'CSV Data'; openWithSpec.
Which results in this nice window:
To do a conversion to HTML, debugging the code in Pharo should be preferable to doing the same with bash & sed (for most of us anyway).
FileLocator desktop / 'csv.html' writeStreamDo: [ :out | | reader | out << '<html><head><title>CSV Data</title></head><body><table border=1>'. reader := NeoCSVReader on: (FileLocator desktop / 'test.csv') readStream. reader emptyFieldValue: ''. out << '<tr bgcolor=silver>'. reader readHeader do: [ :each | out << '<th>'; << each; << '</th>' ]. out << '</tr>'. reader do: [ :each | out << '<tr>'. each do: [ :td | out << '<td>'; << td; << '</td>' ]. out << '</table></body></html>'. reader close ].
Which gives the following output:
NeoCSVReader is way more powerful in interpreting CSV files than a simple sed one-liner. Doing the same for a collection of files is easy. Maybe a little browser could even be written. Who knows, maybe Doru will add another tool to GT (TableViewer class>>#openStructuredOn: would do the trick I guess) ;-)
Sven
PS: The bash script was actually quite well written, even I could read/understand it. Thanks for sharing, it was the inspiration to do this little hack.
Excellent Sven ! Maybe the Douai guys have some really huge cvs that could not be processed by Pharo. On Thu, Sep 18, 2014 at 10:28 AM, Sven Van Caekenberghe <sven@stfx.eu> wrote:
Hi,
Today I came across some bash code on a web page that loves Smalltalk, ah the horror ;-)
http://car.mines-douai.fr/2014/09/csv2html/
The goal is to make it easier to look at CSV data, for which a conversion to HTML was done. To just look at CSV data in a nice tabular form, we do not have to leave Pharo at all.
MultiColumnListModel new items: (FileLocator desktop / 'test.csv' readStreamDo: [ :in | (NeoCSVReader on: in) emptyFieldValue: ''; upToEnd ]); displayBlock: [ :x | x ]; title: 'CSV Data'; openWithSpec.
Which results in this nice window:
To do a conversion to HTML, debugging the code in Pharo should be preferable to doing the same with bash & sed (for most of us anyway).
FileLocator desktop / 'csv.html' writeStreamDo: [ :out | | reader | out << '<html><head><title>CSV Data</title></head><body><table border=1>'. reader := NeoCSVReader on: (FileLocator desktop / 'test.csv') readStream. reader emptyFieldValue: ''. out << '<tr bgcolor=silver>'. reader readHeader do: [ :each | out << '<th>'; << each; << '</th>' ]. out << '</tr>'. reader do: [ :each | out << '<tr>'. each do: [ :td | out << '<td>'; << td; << '</td>' ]. out << '</table></body></html>'. reader close ].
Which gives the following output:
NeoCSVReader is way more powerful in interpreting CSV files than a simple sed one-liner. Doing the same for a collection of files is easy. Maybe a little browser could even be written. Who knows, maybe Doru will add another tool to GT (TableViewer class>>#openStructuredOn: would do the trick I guess) ;-)
Sven
PS: The bash script was actually quite well written, even I could read/understand it. Thanks for sharing, it was the inspiration to do this little hack.
-- Serge Stinckwich UCBN & UMI UMMISCO 209 (IRD/UPMC) Every DSL ends up being Smalltalk http://www.doesnotunderstand.org/
On 18/9/14 11:19, Serge Stinckwich wrote:
Excellent Sven !
Maybe the Douai guys have some really huge cvs that could not be processed by Pharo.
and could be processed by bash.... Moose manages MB of objects so I do not see why :) Serge you should trust Pharo more :)
On Thu, Sep 18, 2014 at 10:28 AM, Sven Van Caekenberghe <sven@stfx.eu <mailto:sven@stfx.eu>> wrote:
Hi,
Today I came across some bash code on a web page that loves Smalltalk, ah the horror ;-)
http://car.mines-douai.fr/2014/09/csv2html/
The goal is to make it easier to look at CSV data, for which a conversion to HTML was done. To just look at CSV data in a nice tabular form, we do not have to leave Pharo at all.
MultiColumnListModel new items: (FileLocator desktop / 'test.csv' readStreamDo: [ :in | (NeoCSVReader on: in) emptyFieldValue: ''; upToEnd ]); displayBlock: [ :x | x ]; title: 'CSV Data'; openWithSpec.
Which results in this nice window:
To do a conversion to HTML, debugging the code in Pharo should be preferable to doing the same with bash & sed (for most of us anyway).
FileLocator desktop / 'csv.html' writeStreamDo: [ :out | | reader | out << '<html><head><title>CSV Data</title></head><body><table border=1>'. reader := NeoCSVReader on: (FileLocator desktop / 'test.csv') readStream. reader emptyFieldValue: ''. out << '<tr bgcolor=silver>'. reader readHeader do: [ :each | out << '<th>'; << each; << '</th>' ]. out << '</tr>'. reader do: [ :each | out << '<tr>'. each do: [ :td | out << '<td>'; << td; << '</td>' ]. out << '</table></body></html>'. reader close ].
Which gives the following output:
NeoCSVReader is way more powerful in interpreting CSV files than a simple sed one-liner. Doing the same for a collection of files is easy. Maybe a little browser could even be written. Who knows, maybe Doru will add another tool to GT (TableViewer class>>#openStructuredOn: would do the trick I guess) ;-)
Sven
PS: The bash script was actually quite well written, even I could read/understand it. Thanks for sharing, it was the inspiration to do this little hack.
-- Serge Stinckwich UCBN & UMI UMMISCO 209 (IRD/UPMC) Every DSL ends up being Smalltalk http://www.doesnotunderstand.org/
sven I love this because to me it shows that we can really nicely manipulate data. On 18/9/14 10:28, Sven Van Caekenberghe wrote:
Hi,
Today I came across some bash code on a web page that loves Smalltalk, ah the horror ;-)
http://car.mines-douai.fr/2014/09/csv2html/
The goal is to make it easier to look at CSV data, for which a conversion to HTML was done. To just look at CSV data in a nice tabular form, we do not have to leave Pharo at all.
MultiColumnListModel new items: (FileLocator desktop / 'test.csv' readStreamDo: [ :in | (NeoCSVReader on: in) emptyFieldValue: ''; upToEnd ]); displayBlock: [ :x | x ]; title: 'CSV Data'; openWithSpec.
Which results in this nice window:
To do a conversion to HTML, debugging the code in Pharo should be preferable to doing the same with bash & sed (for most of us anyway).
FileLocator desktop / 'csv.html' writeStreamDo: [ :out | | reader | out << '<html><head><title>CSV Data</title></head><body><table border=1>'. reader := NeoCSVReader on: (FileLocator desktop / 'test.csv') readStream. reader emptyFieldValue: ''. out << '<tr bgcolor=silver>'. reader readHeader do: [ :each | out << '<th>'; << each; << '</th>' ]. out << '</tr>'. reader do: [ :each | out << '<tr>'. each do: [ :td | out << '<td>'; << td; << '</td>' ]. out << '</table></body></html>'. reader close ].
Which gives the following output:
NeoCSVReader is way more powerful in interpreting CSV files than a simple sed one-liner. Doing the same for a collection of files is easy. Maybe a little browser could even be written. Who knows, maybe Doru will add another tool to GT (TableViewer class>>#openStructuredOn: would do the trick I guess) ;-)
Sven
PS: The bash script was actually quite well written, even I could read/understand it. Thanks for sharing, it was the inspiration to do this little hack.
Am 18.09.2014 um 10:28 schrieb Sven Van Caekenberghe <sven@stfx.eu>:
Hi,
Today I came across some bash code on a web page that loves Smalltalk, ah the horror ;-)
http://car.mines-douai.fr/2014/09/csv2html/
The goal is to make it easier to look at CSV data, for which a conversion to HTML was done. To just look at CSV data in a nice tabular form, we do not have to leave Pharo at all.
MultiColumnListModel new items: (FileLocator desktop / 'test.csv' readStreamDo: [ :in | (NeoCSVReader on: in) emptyFieldValue: ''; upToEnd ]); What version of NeoCSV has >>emptyFieldValue:? (And where can I get it?) I havenât seen this method yetâ¦
Regards, Andreas
Hi Andreas, On 26 Sep 2014, at 22:25, Andreas Wacknitz <a.wacknitz@gmx.de> wrote:
Am 18.09.2014 um 10:28 schrieb Sven Van Caekenberghe <sven@stfx.eu>:
Hi,
Today I came across some bash code on a web page that loves Smalltalk, ah the horror ;-)
http://car.mines-douai.fr/2014/09/csv2html/
The goal is to make it easier to look at CSV data, for which a conversion to HTML was done. To just look at CSV data in a nice tabular form, we do not have to leave Pharo at all.
MultiColumnListModel new items: (FileLocator desktop / 'test.csv' readStreamDo: [ :in | (NeoCSVReader on: in) emptyFieldValue: ''; upToEnd ]); What version of NeoCSV has >>emptyFieldValue:? (And where can I get it?) I havenât seen this method yetâ¦
It was in #bleedingEdge, I made a new #stable version of ConfigurationOfNeoCSV (v11). You can use the Configuration Browser in Pharo 3.0 or load via Gofer (the project is on StHub as well). HTH, Sven
Am 27.09.2014 um 00:53 schrieb Sven Van Caekenberghe <sven@stfx.eu>:
Hi Andreas,
On 26 Sep 2014, at 22:25, Andreas Wacknitz <a.wacknitz@gmx.de> wrote:
Am 18.09.2014 um 10:28 schrieb Sven Van Caekenberghe <sven@stfx.eu>:
Hi,
Today I came across some bash code on a web page that loves Smalltalk, ah the horror ;-)
http://car.mines-douai.fr/2014/09/csv2html/
The goal is to make it easier to look at CSV data, for which a conversion to HTML was done. To just look at CSV data in a nice tabular form, we do not have to leave Pharo at all.
MultiColumnListModel new items: (FileLocator desktop / 'test.csv' readStreamDo: [ :in | (NeoCSVReader on: in) emptyFieldValue: ''; upToEnd ]); What version of NeoCSV has >>emptyFieldValue:? (And where can I get it?) I havenât seen this method yetâ¦
It was in #bleedingEdge, I made a new #stable version of ConfigurationOfNeoCSV (v11). You can use the Configuration Browser in Pharo 3.0 or load via Gofer (the project is on StHub as well).
HTH,
Sven
I got it via the newest Moose. Thanks a lot! Andreas
participants (5)
-
Andreas Wacknitz -
Luc Fabresse -
Serge Stinckwich -
stepharo -
Sven Van Caekenberghe