June 2016 - Pharo-users - lists.pharo.org

SQLite + JSON support via UDBCSQLite3 in Pharo
by Offray Vladimir Luna CÃ¡rdenas July 1, 2016

July 1, 2016

Hi all, I have finished my dummy data mock ups as you can see below (or in [1][2] ) [1] https://www.list.inf.unibe.ch/pipermail/moose-dev/2016-June/025799.html [2] https://offray.withknown.com/2016/data-selfie-dummy Now I'm ready to start injecting real data into them. Because data comes from a JSON dump, I would like to use the JSON1 extension of SQLite, [3][4], which means compiling it by myself from SQLite amalgamation and putting the binary in a place where UDBCSQLite3 is aware of it. I'm on a Linux 64 bits machine and I have sqlite2 32 bits binary from the distro repositories. When I linked the distro provided binary to the image location, UDBCSQLite3 works fine (but precompiled binary doesn't have JSON1 extension enabled), but when I put there my compiled binary with JSON1 support instead, UDBC complains about "external module not found". How can I made UDBCSQLite3 aware of my compiled binary ? [3] https://www.sqlite.org/json1.html [4] http://www.samadhiweb.com/blog/2016.04.24.sqlite.json.html Thanks, Offray

2 3

If you have to do web data scraping, what tool would you use?
by Bernardo Ezequiel Contreras June 29, 2016

June 29, 2016

Hi, Imagine that you have to do some data scraping work, what tool would you use? I know about ZnClient, Soup, NeoCSV, NeoJSON, is there something else that i'm not aware of it? thanks. -- Bernardo E.C. Sent from a cheap desktop computer in South America.

6 8

Re: [Pharo-users] Issue with NeoCSVReader
by Joachim Tuchel June 29, 2016

June 29, 2016

I guess Seb is right. The file cannot be read by Excel as well. So without having analysed this any further, it seems to me like the number of fields differs from row to row. NeoCSV does not handle this kind of "edge case". By defintion, each row in CSV has the same number of fields - even if you could possibly argue exceptions to this rule could be handled. OTOH, what does a missing field in a row usually mean? Is it the last one? One from the middle? is so, which one? So I think you should first check if the file is valid csv and if not, how you can get a valid one. If not, I guess you have to roll your own parser that foolows the "omission rules" of that file format. Joachim

4 4

Re: [Pharo-users] Issue with NeoCSVReader
by Alexandre Bergel June 29, 2016

June 29, 2016

Thanks Sebastian! Apparently, it is related to UTF encoding. The following code works well c := (ZnEasy get: 'https://github.com/sudar/pig-samples/raw/master/data/tweets.csv') contents. c := ZnCharacterEncoder utf8 decodeBytes: c. content := c readStream. lines := (NeoCSVReader on: content) skipHeader; upToEnd. Strange Alexandre > On Jun 28, 2016, at 5:54 PM, Sebastian Heidbrink via Pharo-users <pharo-users(a)lists.pharo.org> wrote: > > > From: Sebastian Heidbrink <sheidev(a)yahoo.de> > Subject: Re: [Pharo-users] Issue with NeoCSVReader > Date: June 28, 2016 at 5:53:44 PM GMT-4 > To: Any question about pharo is welcome <pharo-users(a)lists.pharo.org> > > > Hi Alexandre, > > I do not have access to a pharo image right now. But I had a look into your csv file. > There are rows that do not include any or to few data. I think NeoCSVReader can not handle that and expects a "proper" file > > I will check tonight, in case nobody else comes up with additional information by then. > > To be continued > Sebastian > > > > Am 28.06.2016 um 14:41 schrieb Alexandre Bergel: >> Hi! >> >> I have a simple use of NeoCSVReader, but I get a rollback. >> >> -=-=-=-=-=-=-=-=-= >> content := (ZnEasy get: 'https://github.com/sudar/pig-samples/raw/master/data/tweets.csv') contents readStream. >> lines := (NeoCSVReader on: content) >> skipHeader; >> upToEnd. >> -=-=-=-=-=-=-=-=-= >> >> The url points to a .csv file with a header. No idea why the code . >> >> I loaded the csv reader using: >> Gofer new >> smalltalkhubUser: 'SvenVanCaekenberghe' project: 'Neo'; >> package: 'ConfigurationOfNeoCSV'; load. >> (Smalltalk at: #ConfigurationOfNeoCSV) loadBleedingEdge. >> >> Alexandre > > > > > -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

2 2

Pharo Sprint Friday, 29 July
by Marcus Denker June 29, 2016

June 29, 2016

We will organize a Pharo sprint / Moose dojo Friday, 29 July, starting at 10:00am. (Local Time Paris/Berlin/â¦.). Remotely, you can join us on Slack or the IRC channel #pharo on irc.freenode.net <http://irc.freenode.net/> server. During the sprint, we will try to synchronize local and remote Pharo sprinters. Locally, there will be: - Inria Lille, Building B, third floor (RMoD offices). (As the building is not open to the public, please contact us before in case of visiting) - Santiago de Chile (starting a bit later due to time-zone). DCC University of Chile. Marcus

1 0

Issue with NeoCSVReader
by Alexandre Bergel June 28, 2016

June 28, 2016

Hi! I have a simple use of NeoCSVReader, but I get a rollback. -=-=-=-=-=-=-=-=-= content := (ZnEasy get: 'https://github.com/sudar/pig-samples/raw/master/data/tweets.csv') contents readStream. lines := (NeoCSVReader on: content) skipHeader; upToEnd. -=-=-=-=-=-=-=-=-= The url points to a .csv file with a header. No idea why the code . I loaded the csv reader using: Gofer new smalltalkhubUser: 'SvenVanCaekenberghe' project: 'Neo'; package: 'ConfigurationOfNeoCSV'; load. (Smalltalk at: #ConfigurationOfNeoCSV) loadBleedingEdge. Alexandre -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

2 1

accepting method without creating variable and code generation
by Peter Uhnak June 28, 2016

June 28, 2016

Hi, is it possible to accept a method without creating instance variable? E.g. ~~~~~~~~~~~~~~~~~~~~~~~~~~ Object subclass: #MyObject slots: { } classVariables: { } category: 'Category' ~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~~~~ MyObject>>addValue: aValue container add: aValue ~~~~~~~~~~~~~~~~~~~~~~~~~~ Now normally when I would try to compile the method I would get the "Unknown variable 'container'" warning that will force me to either create temporary or instance variable; I would like to somehow ignore that, because the method will actually never get called. My objective is use this method as a template for code generation, so I would then take this method, apply some code transformation and compile it into different object. Of course I could do ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ MyObject>>addValueTemplate ^ 'MyObject>>addValue: aValue container add: aValue' ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ But then I would lose code highlighting, which is quite error-prone for more complex snippets. If you have a better approach, I am all ears. :) Thanks, Peter

8 8

[ANN] Pharo Consortium New Bronze Member: FINWorks
by Marcus Denker June 28, 2016

June 28, 2016

The Pharo Consortium is very happy to announce that FINWorks has joined the Consortium as a Bronze Member. FINWorks: http://finworks.biz FINWorks provides software solutions and automation in the financial sector. Our main area of focus is investment administration, especially back office solutions for LISP (Linked Investment Service Provider or Fund Supermarkets), Benefit Administrators, Unit Trust Companies, Asset Managers, Independent Financial Advisors (IFA) and other financial service providers Pharo Consortium: http://consortium.pharo.org The goal of the Pharo Consortium is to allow companies and institutions to support the ongoing development and future of Pharo. Individuals can support Pharo via the Pharo Association: - http://association.pharo.org - https://salt.bountysource.com/teams/pharo

1 0

parameters of the virtual machine
by Alexandre Bergel June 28, 2016

June 28, 2016

Hi, The Cog virtual machine expose some very useful parameters. However, some of them are a bit obscure to me. For example, what are the following parameters? What do they mean? 46 size of machine code zone, in bytes 59 number of check event calls since startup (read-only) 60 number of stack page overflows since startup (read-only; Cog VMs only) 61 number of stack page divorces since startup (read-only; Cog VMs only) Is there a way to get access to the cache? How many caches does Cog has? I guess it has - a method call cache (associating (object,symbol) -> compiled method - a cache for the JIT-compiled methods right? Are there other cache? How can I access them? In particular to query about their fill. Cheers, Alexandre -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

3 5

[dtabase] Looking for a report band editor
by sitepublique＠free.fr June 27, 2016

June 27, 2016

Hi, I'm new with pharo and smalltalk and I would like to use it to start a new database application. But I need to find out a report band editor and I can't find anything about this into the pharo projets catalog... A report band exxemple is like : XtraReports : https://documentation.devexpress.com/#XtraReports/CustomDocument2590 Lazreport (LAzarus/pascal) : http://wiki.lazarus.freepascal.org/LazReport_Tutorial etc. Do you know a report band editor with pharo (or other smalltalk implementation ?) Thank you for your help.

1 0