April 2016 - Pharo-users - lists.pharo.org

Re: [Pharo-users] [Moose-dev] Crash when using Athens/Roassal?

by Esteban Lorenzano

thanks Alex, I might be interested on those crashes/images too :) Esteban > On 13 Apr 2016, at 11:58, Alexandre Bergel <alexandre.bergel(a)me.com> wrote: > > Hi! > > In case you are using Athens or Roassal, you may have noticed a loss of stability since we have moved to Spur and the new FFI. > I would like to identify the cause of it and I may have an idea. What I would like to ask you, is in case you have experienced this problem, can you send (directly) me the crash.dmp file created next to your image please? > > Cheers, > Alexandre > -- > _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: > Alexandre Bergel http://www.bergel.eu > ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. > > > > _______________________________________________ > Moose-dev mailing list > Moose-dev(a)list.inf.unibe.ch > https://www.list.inf.unibe.ch/listinfo/moose-dev

April 13, 2016

Crash when using Athens/Roassal?

by Alexandre Bergel

Hi! In case you are using Athens or Roassal, you may have noticed a loss of stability since we have moved to Spur and the new FFI. I would like to identify the cause of it and I may have an idea. What I would like to ask you, is in case you have experienced this problem, can you send (directly) me the crash.dmp file created next to your image please? Cheers, Alexandre -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

April 13, 2016

Re: [Pharo-users] [ANN] General WebBrowser package for Pharo4 and Pharo 5 onwards

by Rob Rothwell

> > > # Usage > > WebBrowser openOn: 'http://www.pharo.org' > Fantastic...this is a nice example of using UFFI to call a LibC command, and since it is just using open(1), you can also do something like: WebBrowser openOn: '/users/rob/desktop/enterprisepharo.pdf' To generically open a file! Take care, Rob

April 13, 2016

Re: [Pharo-users] SQLite bridge crashed Pharo 5.

by Offray Vladimir Luna CÃ¡rdenas

Torsten has given me the answer on how to install the new SQLite bridge for UFFI (with the proper disclaimer about being work in progress ;-) ). Gofer it smalltalkhubUser: 'TorstenBergmann' project: 'UDBC'; configuration; load. (Smalltalk at: #ConfigurationOfUDBC) loadBleedingEdge Cheers, Offray On 13/04/16 08:33, Offray Vladimir Luna CÃ¡rdenas wrote: > Thanks Mariano, > > So my suspicion was right and I was managing improperly the SQLite > connections and not making a explicit closing of them. I could improve > the code, but I can't find the package which provides SQLiteConnection > (on pharo 4 it was NBSQLite). How can I find/install it? > > Cheers, > > Offray > > On 12/04/16 20:03, Mariano Martinez Peck wrote: >> >> What looks not related to memory issue is that the crash seems to >> happen in #close: >> >> Smalltalk stack dump: >> 0xffc655d4 SqliteLibrary>close: 0x9726108: a(n) SqliteLibrary >> 0xffc655f4 SQLiteConnection>close 0xc672d08: a(n) SQLiteConnection >> 0xffc65610 SQLiteConnection>finalize 0xc672d08: a(n) SQLiteConnection >> 0xffc65630 WeakFinalizerItem>finalizeValues 0xc692b60: a(n) >> WeakFinalizerItem >> >> The idea is obvious...and I did exactly the same for SqueakDBX (now >> OpenDBXDriver / Garage).... register the connections into the >> WeakRegistry so that they are automatically closed without having the >> user to manually do so. I remember I had a case where the user WAS >> already doing an explicit close and I would crash very much like this >> case when I was trying to close a connection that was already closed. >> >> I don't have Sqlite library handy, but could it be something similar? >> >> >> On Tue, Apr 12, 2016 at 9:49 PM, Offray Vladimir Luna CÃ¡rdenas >> <offray.luna(a)mutabit.com> wrote: >> >> Hi, >> >> On 12/04/16 16:51, Stephan Eggermont wrote: >> >> On 12/04/16 22:44, Offray Vladimir Luna CÃ¡rdenas wrote: >> >> I'm working with visualizations a external dataset which >> contains 270k >> records. So the best strategy seems to bridge pharo with >> SQLite to keep >> requirements low while using Roassal to visualize >> aggregated information >> that is obtained from querying the database. >> >> >> It won't fit in image? >> >> >> I tried with RTTabTable and NeoCVS but they can not load the >> data. I made a test drawing 150k points and the image starts to >> lag and trying to query the data becomes inefficient compared to >> query the data on SQLite. For the moment I'll export the query >> results to CVS, but I'll hope to have the SQLite bridge working soon. >> >> Offray >> >> >> >> >> -- >> Mariano >> http://marianopeck.wordpress.com >

April 13, 2016

Re: [Pharo-users] SQLite bridge crashed Pharo 5.

by Offray Vladimir Luna CÃ¡rdenas

Thanks Mariano, So my suspicion was right and I was managing improperly the SQLite connections and not making a explicit closing of them. I could improve the code, but I can't find the package which provides SQLiteConnection (on pharo 4 it was NBSQLite). How can I find/install it? Cheers, Offray On 12/04/16 20:03, Mariano Martinez Peck wrote: > > What looks not related to memory issue is that the crash seems to > happen in #close: > > Smalltalk stack dump: > 0xffc655d4 SqliteLibrary>close: 0x9726108: a(n) SqliteLibrary > 0xffc655f4 SQLiteConnection>close 0xc672d08: a(n) SQLiteConnection > 0xffc65610 SQLiteConnection>finalize 0xc672d08: a(n) SQLiteConnection > 0xffc65630 WeakFinalizerItem>finalizeValues 0xc692b60: a(n) > WeakFinalizerItem > > The idea is obvious...and I did exactly the same for SqueakDBX (now > OpenDBXDriver / Garage).... register the connections into the > WeakRegistry so that they are automatically closed without having the > user to manually do so. I remember I had a case where the user WAS > already doing an explicit close and I would crash very much like this > case when I was trying to close a connection that was already closed. > > I don't have Sqlite library handy, but could it be something similar? > > > On Tue, Apr 12, 2016 at 9:49 PM, Offray Vladimir Luna CÃ¡rdenas > <offray.luna(a)mutabit.com <mailto:offray.luna@mutabit.com>> wrote: > > Hi, > > On 12/04/16 16:51, Stephan Eggermont wrote: > > On 12/04/16 22:44, Offray Vladimir Luna CÃ¡rdenas wrote: > > I'm working with visualizations a external dataset which > contains 270k > records. So the best strategy seems to bridge pharo with > SQLite to keep > requirements low while using Roassal to visualize > aggregated information > that is obtained from querying the database. > > > It won't fit in image? > > > I tried with RTTabTable and NeoCVS but they can not load the data. > I made a test drawing 150k points and the image starts to lag and > trying to query the data becomes inefficient compared to query the > data on SQLite. For the moment I'll export the query results to > CVS, but I'll hope to have the SQLite bridge working soon. > > Offray > > > > > -- > Mariano > http://marianopeck.wordpress.com

April 13, 2016

Re: [Pharo-users] SQLite bridge crashed Pharo 5.

by Carlo

Hi I've recently been playing with medical provider data sets which are quite large, also around 270K records. I'm using a Moose image Pharo5.0 Latest update: #50643 on a Mac OS X. The initial issue I had was with memory settings for the VM. This has been increased and the image ranges from 800MB to 1.3GB and has been fine. There have been occasional crashes/hangs but this is to do with memory limits and GC. Typically this occurs when making class format changes to existing instances of data e.g. new variables introduced to a working image with a large data set. To counter this I have a base image which I update the code and then import the data (CSV for now) using NeoCSV. This process takes about 30 seconds so it's not too painful. The other issue I've come across is a slow down in querying the data sets using the Playground. I profiled the code and found that the culprit to be GLMTreeMorphModel>>explicitlySelectMultipleItems: which is terribly slow as it iterates over the entire data set. I've made a modification to prevent the expensive iteration when there are more than 50000 records to be displayed e.g. self roots size > 50000 ifTrue: [ ^ self ]. I'm also using Teapot to be able to perform easy querying of the 2 data sets and to build an HTML comparison view of the records. This uses the in-memory OO model to populate the html. Teapot to be able to pull a STON representation into a different image, then building instances for performing querying or simple reporting. The Playground workspace to query and analyse the data cheaply e.g. self collect: [ :each | each disciplineCode ] as: Bag. Then using the customised view to quickly see a distribution of values. Anyway the reason for this long-winded email is to hopefully provide some useful feedback but more to thank everyone involved in building a powerful environment. I'd hate to name people, because I'm sure to miss most, but the efforts of people like Sven (Neo*, STON), Doru (Moose*), Avi (ROE, BTREE) are appreciated. I know there are a lot of hands behind the scenes to make Pharo, from the fast VM to the UI, so thanks to all. Regards Carlo On 13 Apr 2016, at 2:49 AM, Offray Vladimir Luna CÃ¡rdenas <offray.luna(a)mutabit.com> wrote: Hi, On 12/04/16 16:51, Stephan Eggermont wrote: > On 12/04/16 22:44, Offray Vladimir Luna CÃ¡rdenas wrote: >> I'm working with visualizations a external dataset which contains 270k >> records. So the best strategy seems to bridge pharo with SQLite to keep >> requirements low while using Roassal to visualize aggregated information >> that is obtained from querying the database. > > It won't fit in image? > I tried with RTTabTable and NeoCVS but they can not load the data. I made a test drawing 150k points and the image starts to lag and trying to query the data becomes inefficient compared to query the data on SQLite. For the moment I'll export the query results to CVS, but I'll hope to have the SQLite bridge working soon. Offray

April 13, 2016

Re: [Pharo-users] FFI return by reference

by Rob Rothwell

On Wed, Apr 13, 2016 at 8:52 AM, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: > Hi, > > Just checkedâ¦ contrary to what I believed, strings are passed by copy (not > by reference, as ByteArray)â¦ logical for safety but with penalty on > performance... so yes, using a ByteArray is the correct way to do it. (Or > an external value holder, which is a glorified way for passing a ByteArray, > but this probably do not work fine for âchar*" because I didnât preview it > :P) > > Hello, I've never used UFFI before, but would like to call setxattr and getxattr in LibC on OS X (which also pass strings). I don't have a lot of Mac or Unix background, but I have past experience fiddling with parameters to call external Windows libraries from VB. Is there any general information about UFFI usage anywhere, or is reviewing this thread my best place to start? Thank you, Rob

April 13, 2016

Re: [Pharo-users] First impressions, was About Box

by Alistair Grant

On Tue, Apr 12, 2016 at 09:28:07PM +0200, stepharo wrote: > Le 12/4/16 19:51, Alistair Grant a Ã©crit : > > * I'm glad that being able to run headless mode is easy, as I'd like to > > use Pharo for scripting. > Me too. We are starting a new iteration on this. We got a student whose job > is to convert > bash script to pharo and identify problem so if you want to share effort you > are welcome. I'd be happy to, thanks. Please let me know what I need to do to get involved (and remember that this is my hobby and I don't get as much time as I'd like, so my responses won't always be as fast as we'd like). Thanks! Alistair P.S. I'm still putting together my response to all the other comments in this thread.

April 13, 2016

Re: [Pharo-users] SQLite bridge crashed Pharo 5.

by Offray Vladimir Luna CÃ¡rdenas

Hi, I don't not want to blindly load/print *everything* but I do want swiftly query *anything*, which is usual in exploratory computing, especially in the first phases. That's where a proper interface between Pharo and SQLite is needed and I would like to help in having it, at least reporting the issues on Pharo 4 and now on Pharo 5. Meanwhile I will query and export results to csv files, which is suboptimal, but lets me advance while I have more clues about what's now working or I'm not doing well. Cheers, Offray On 13/04/16 01:09, stepharo wrote: > but you can have your objects in memory and you do not have to blindly > print everything or put everything in a table. > with moose sometimes we have 600K objects in an array. > > I think that we need more clever stream to filter what we want to load. > > Le 13/4/16 02:49, Offray Vladimir Luna CÃ¡rdenas a Ã©crit : >> Hi, >> >> On 12/04/16 16:51, Stephan Eggermont wrote: >>> On 12/04/16 22:44, Offray Vladimir Luna CÃ¡rdenas wrote: >>>> I'm working with visualizations a external dataset which contains 270k >>>> records. So the best strategy seems to bridge pharo with SQLite to >>>> keep >>>> requirements low while using Roassal to visualize aggregated >>>> information >>>> that is obtained from querying the database. >>> >>> It won't fit in image? >>> >> >> I tried with RTTabTable and NeoCVS but they can not load the data. I >> made a test drawing 150k points and the image starts to lag and >> trying to query the data becomes inefficient compared to query the >> data on SQLite. For the moment I'll export the query results to CVS, >> but I'll hope to have the SQLite bridge working soon. >> >> Offray >> >> > >

April 13, 2016

[Bug - Pharo 5.0] Remove a class but not remove for RPackage

by Yann Dubois

Hello, When I delete a class, a window pop to inform me that some methods use this class. So I remove the methods because they are not usefull without my class to removed. But when I close the window, the methods stay on the Browser, so I remove this methods on the Browser. Then, I remove an other class and "BOOM" an error appears, the key which represents my class is not present in the SystemDictionnary (it's normal), but I can find the key in the RPackage metaclasses.

April 13, 2016