- Pharo-users - lists.pharo.org

Re: [Pharo-users] [ANN] General WebBrowser package for Pharo4 and Pharo 5 onwards

by Rob Rothwell

> > > # Usage > > WebBrowser openOn: 'http://www.pharo.org' > Fantastic...this is a nice example of using UFFI to call a LibC command, and since it is just using open(1), you can also do something like: WebBrowser openOn: '/users/rob/desktop/enterprisepharo.pdf' To generically open a file! Take care, Rob

April 13, 2016

Re: [Pharo-users] SQLite bridge crashed Pharo 5.

by Offray Vladimir Luna CÃ¡rdenas

Torsten has given me the answer on how to install the new SQLite bridge for UFFI (with the proper disclaimer about being work in progress ;-) ). Gofer it smalltalkhubUser: 'TorstenBergmann' project: 'UDBC'; configuration; load. (Smalltalk at: #ConfigurationOfUDBC) loadBleedingEdge Cheers, Offray On 13/04/16 08:33, Offray Vladimir Luna CÃ¡rdenas wrote: > Thanks Mariano, > > So my suspicion was right and I was managing improperly the SQLite > connections and not making a explicit closing of them. I could improve > the code, but I can't find the package which provides SQLiteConnection > (on pharo 4 it was NBSQLite). How can I find/install it? > > Cheers, > > Offray > > On 12/04/16 20:03, Mariano Martinez Peck wrote: >> >> What looks not related to memory issue is that the crash seems to >> happen in #close: >> >> Smalltalk stack dump: >> 0xffc655d4 SqliteLibrary>close: 0x9726108: a(n) SqliteLibrary >> 0xffc655f4 SQLiteConnection>close 0xc672d08: a(n) SQLiteConnection >> 0xffc65610 SQLiteConnection>finalize 0xc672d08: a(n) SQLiteConnection >> 0xffc65630 WeakFinalizerItem>finalizeValues 0xc692b60: a(n) >> WeakFinalizerItem >> >> The idea is obvious...and I did exactly the same for SqueakDBX (now >> OpenDBXDriver / Garage).... register the connections into the >> WeakRegistry so that they are automatically closed without having the >> user to manually do so. I remember I had a case where the user WAS >> already doing an explicit close and I would crash very much like this >> case when I was trying to close a connection that was already closed. >> >> I don't have Sqlite library handy, but could it be something similar? >> >> >> On Tue, Apr 12, 2016 at 9:49 PM, Offray Vladimir Luna CÃ¡rdenas >> <offray.luna(a)mutabit.com> wrote: >> >> Hi, >> >> On 12/04/16 16:51, Stephan Eggermont wrote: >> >> On 12/04/16 22:44, Offray Vladimir Luna CÃ¡rdenas wrote: >> >> I'm working with visualizations a external dataset which >> contains 270k >> records. So the best strategy seems to bridge pharo with >> SQLite to keep >> requirements low while using Roassal to visualize >> aggregated information >> that is obtained from querying the database. >> >> >> It won't fit in image? >> >> >> I tried with RTTabTable and NeoCVS but they can not load the >> data. I made a test drawing 150k points and the image starts to >> lag and trying to query the data becomes inefficient compared to >> query the data on SQLite. For the moment I'll export the query >> results to CVS, but I'll hope to have the SQLite bridge working soon. >> >> Offray >> >> >> >> >> -- >> Mariano >> http://marianopeck.wordpress.com >

April 13, 2016

Re: [Pharo-users] SQLite bridge crashed Pharo 5.

by Offray Vladimir Luna CÃ¡rdenas

Thanks Mariano, So my suspicion was right and I was managing improperly the SQLite connections and not making a explicit closing of them. I could improve the code, but I can't find the package which provides SQLiteConnection (on pharo 4 it was NBSQLite). How can I find/install it? Cheers, Offray On 12/04/16 20:03, Mariano Martinez Peck wrote: > > What looks not related to memory issue is that the crash seems to > happen in #close: > > Smalltalk stack dump: > 0xffc655d4 SqliteLibrary>close: 0x9726108: a(n) SqliteLibrary > 0xffc655f4 SQLiteConnection>close 0xc672d08: a(n) SQLiteConnection > 0xffc65610 SQLiteConnection>finalize 0xc672d08: a(n) SQLiteConnection > 0xffc65630 WeakFinalizerItem>finalizeValues 0xc692b60: a(n) > WeakFinalizerItem > > The idea is obvious...and I did exactly the same for SqueakDBX (now > OpenDBXDriver / Garage).... register the connections into the > WeakRegistry so that they are automatically closed without having the > user to manually do so. I remember I had a case where the user WAS > already doing an explicit close and I would crash very much like this > case when I was trying to close a connection that was already closed. > > I don't have Sqlite library handy, but could it be something similar? > > > On Tue, Apr 12, 2016 at 9:49 PM, Offray Vladimir Luna CÃ¡rdenas > <offray.luna(a)mutabit.com <mailto:offray.luna@mutabit.com>> wrote: > > Hi, > > On 12/04/16 16:51, Stephan Eggermont wrote: > > On 12/04/16 22:44, Offray Vladimir Luna CÃ¡rdenas wrote: > > I'm working with visualizations a external dataset which > contains 270k > records. So the best strategy seems to bridge pharo with > SQLite to keep > requirements low while using Roassal to visualize > aggregated information > that is obtained from querying the database. > > > It won't fit in image? > > > I tried with RTTabTable and NeoCVS but they can not load the data. > I made a test drawing 150k points and the image starts to lag and > trying to query the data becomes inefficient compared to query the > data on SQLite. For the moment I'll export the query results to > CVS, but I'll hope to have the SQLite bridge working soon. > > Offray > > > > > -- > Mariano > http://marianopeck.wordpress.com

April 13, 2016

Re: [Pharo-users] SQLite bridge crashed Pharo 5.

by Carlo

Hi I've recently been playing with medical provider data sets which are quite large, also around 270K records. I'm using a Moose image Pharo5.0 Latest update: #50643 on a Mac OS X. The initial issue I had was with memory settings for the VM. This has been increased and the image ranges from 800MB to 1.3GB and has been fine. There have been occasional crashes/hangs but this is to do with memory limits and GC. Typically this occurs when making class format changes to existing instances of data e.g. new variables introduced to a working image with a large data set. To counter this I have a base image which I update the code and then import the data (CSV for now) using NeoCSV. This process takes about 30 seconds so it's not too painful. The other issue I've come across is a slow down in querying the data sets using the Playground. I profiled the code and found that the culprit to be GLMTreeMorphModel>>explicitlySelectMultipleItems: which is terribly slow as it iterates over the entire data set. I've made a modification to prevent the expensive iteration when there are more than 50000 records to be displayed e.g. self roots size > 50000 ifTrue: [ ^ self ]. I'm also using Teapot to be able to perform easy querying of the 2 data sets and to build an HTML comparison view of the records. This uses the in-memory OO model to populate the html. Teapot to be able to pull a STON representation into a different image, then building instances for performing querying or simple reporting. The Playground workspace to query and analyse the data cheaply e.g. self collect: [ :each | each disciplineCode ] as: Bag. Then using the customised view to quickly see a distribution of values. Anyway the reason for this long-winded email is to hopefully provide some useful feedback but more to thank everyone involved in building a powerful environment. I'd hate to name people, because I'm sure to miss most, but the efforts of people like Sven (Neo*, STON), Doru (Moose*), Avi (ROE, BTREE) are appreciated. I know there are a lot of hands behind the scenes to make Pharo, from the fast VM to the UI, so thanks to all. Regards Carlo On 13 Apr 2016, at 2:49 AM, Offray Vladimir Luna CÃ¡rdenas <offray.luna(a)mutabit.com> wrote: Hi, On 12/04/16 16:51, Stephan Eggermont wrote: > On 12/04/16 22:44, Offray Vladimir Luna CÃ¡rdenas wrote: >> I'm working with visualizations a external dataset which contains 270k >> records. So the best strategy seems to bridge pharo with SQLite to keep >> requirements low while using Roassal to visualize aggregated information >> that is obtained from querying the database. > > It won't fit in image? > I tried with RTTabTable and NeoCVS but they can not load the data. I made a test drawing 150k points and the image starts to lag and trying to query the data becomes inefficient compared to query the data on SQLite. For the moment I'll export the query results to CVS, but I'll hope to have the SQLite bridge working soon. Offray

April 13, 2016

Re: [Pharo-users] FFI return by reference

by Rob Rothwell

On Wed, Apr 13, 2016 at 8:52 AM, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: > Hi, > > Just checkedâ¦ contrary to what I believed, strings are passed by copy (not > by reference, as ByteArray)â¦ logical for safety but with penalty on > performance... so yes, using a ByteArray is the correct way to do it. (Or > an external value holder, which is a glorified way for passing a ByteArray, > but this probably do not work fine for âchar*" because I didnât preview it > :P) > > Hello, I've never used UFFI before, but would like to call setxattr and getxattr in LibC on OS X (which also pass strings). I don't have a lot of Mac or Unix background, but I have past experience fiddling with parameters to call external Windows libraries from VB. Is there any general information about UFFI usage anywhere, or is reviewing this thread my best place to start? Thank you, Rob

April 13, 2016

Re: [Pharo-users] First impressions, was About Box

by Alistair Grant

On Tue, Apr 12, 2016 at 09:28:07PM +0200, stepharo wrote: > Le 12/4/16 19:51, Alistair Grant a Ã©crit : > > * I'm glad that being able to run headless mode is easy, as I'd like to > > use Pharo for scripting. > Me too. We are starting a new iteration on this. We got a student whose job > is to convert > bash script to pharo and identify problem so if you want to share effort you > are welcome. I'd be happy to, thanks. Please let me know what I need to do to get involved (and remember that this is my hobby and I don't get as much time as I'd like, so my responses won't always be as fast as we'd like). Thanks! Alistair P.S. I'm still putting together my response to all the other comments in this thread.

April 13, 2016

Re: [Pharo-users] SQLite bridge crashed Pharo 5.

by Offray Vladimir Luna CÃ¡rdenas

Hi, I don't not want to blindly load/print *everything* but I do want swiftly query *anything*, which is usual in exploratory computing, especially in the first phases. That's where a proper interface between Pharo and SQLite is needed and I would like to help in having it, at least reporting the issues on Pharo 4 and now on Pharo 5. Meanwhile I will query and export results to csv files, which is suboptimal, but lets me advance while I have more clues about what's now working or I'm not doing well. Cheers, Offray On 13/04/16 01:09, stepharo wrote: > but you can have your objects in memory and you do not have to blindly > print everything or put everything in a table. > with moose sometimes we have 600K objects in an array. > > I think that we need more clever stream to filter what we want to load. > > Le 13/4/16 02:49, Offray Vladimir Luna CÃ¡rdenas a Ã©crit : >> Hi, >> >> On 12/04/16 16:51, Stephan Eggermont wrote: >>> On 12/04/16 22:44, Offray Vladimir Luna CÃ¡rdenas wrote: >>>> I'm working with visualizations a external dataset which contains 270k >>>> records. So the best strategy seems to bridge pharo with SQLite to >>>> keep >>>> requirements low while using Roassal to visualize aggregated >>>> information >>>> that is obtained from querying the database. >>> >>> It won't fit in image? >>> >> >> I tried with RTTabTable and NeoCVS but they can not load the data. I >> made a test drawing 150k points and the image starts to lag and >> trying to query the data becomes inefficient compared to query the >> data on SQLite. For the moment I'll export the query results to CVS, >> but I'll hope to have the SQLite bridge working soon. >> >> Offray >> >> > >

April 13, 2016

[Bug - Pharo 5.0] Remove a class but not remove for RPackage

by Yann Dubois

Hello, When I delete a class, a window pop to inform me that some methods use this class. So I remove the methods because they are not usefull without my class to removed. But when I close the window, the methods stay on the Browser, so I remove this methods on the Browser. Then, I remove an other class and "BOOM" an error appears, the key which represents my class is not present in the SystemDictionnary (it's normal), but I can find the key in the RPackage metaclasses.

April 13, 2016

Re: [Pharo-users] Conditional external dependencies in a Metacello BaselineOf?

by Dale Henrichs

Damien, Peter's got the proper script ... When you lock a Metacello project, you are registering a repository with a project name, so no need to "load Baseline", the name and local repository are enogh to the job ... then do you normal load ... you do have to use the `Metacello new` form of project loading for the lock to take effect: Metacello new baseline: '...'; repository: '...'; onWarningLog; load Peter's script is a good example ... Dale On 4/13/16 1:40 AM, Peter UhnÃ¡k wrote: > Yes, I've been using this approach for some time. > > https://github.com/peteruhnak/pharo-scripts/blob/master/config/5.0/dynacase… > > > > On Wed, Apr 13, 2016 at 2:24 AM, Damien Pollet > <damien.pollet+pharo(a)gmail.com <mailto:damien.pollet+pharo@gmail.com>> > wrote: > > Oh, nice! > > Just to be sure, because 2:15am is not the best time to start > playing with codeâ¦ if I understood correctly, I'd load the > depended-upon baseline from gitfiletree, lock it, and then that > would take precedence over the github:// repo specified in the > baseline of the main project? > > I'll try tomorrow, thanks :) > > On 13 April 2016 at 00:38, Dale Henrichs > <dale.henrichs(a)gemtalksystems.com > <mailto:dale.henrichs@gemtalksystems.com>> wrote: > > Damien, > > You want to use a a lock[1]. Look at the section on locking a > `filetree://` repo [2]--- should be similar for locking your > gitfiletree repo ... > > When you load you may want to use `onWarningLog`, because > locks do generate Warnings telling you the the lock is being > honored (i.e., the load is taking place from the local clone, > not github as specified in the baseline) ... > > Dale > > [1] > https://github.com/dalehenrich/metacello-work/blob/master/docs/LockCommandR… > [2] > https://github.com/dalehenrich/metacello-work/blob/master/docs/LockCommandR… > > > > On 04/12/2016 11:18 AM, Damien Pollet wrote: > > I have a couple projects that I develop together; the > first depending on the second, and both managed on GitHub > (in separate repositories). > > The BaselineOf therefore expresses the dependency using > repository: 'github://â¦' > However, I'd like to locally change that to gitfiletree:// > so that I can build new development images from scratch, > with both projects ready to commit to gitfiletree, with > minimal repo juggling and code reloading ? > > Is there a way to achieve that? Metacello project > attributes? a git submodule? > > -- > Damien Pollet > type less, do more [ | ] > http://people.untyped.org/damien.pollet > > > > >

April 13, 2016

Re: [Pharo-users] FFI return by reference

by Esteban Lorenzano

Hi, Just checkedâ¦ contrary to what I believed, strings are passed by copy (not by reference, as ByteArray)â¦ logical for safety but with penalty on performance... so yes, using a ByteArray is the correct way to do it. (Or an external value holder, which is a glorified way for passing a ByteArray, but this probably do not work fine for âchar*" because I didnât preview it :P) Esteban > On 13 Apr 2016, at 05:24, Nicolai Hess <nicolaihess(a)gmail.com> wrote: > > > > 2016-04-11 15:10 GMT+02:00 Esteban Lorenzano <estebanlm(a)gmail.com <mailto:estebanlm@gmail.com>>: > > > On 11 Apr 2016, at 06:24, Thibault Raffaillac <thibault.raffaillac(a)inria.fr <mailto:thibault.raffaillac@inria.fr>> wrote: > > > >>> 1) Declare a class variable > >>> > >>> MyClass class>>initialize > >>> INT_PTR := FFIExternalValueHolder ofType: ?int?. > >> > >> as a larger explanation, this will create an anonymous subclass to keep ?int? > >> values, than later you can use as a type in your function call. Some people > >> would call this obscure, but is a good way of solving this problem (I > >> adopted it from old NB). > >> If you want to have a named class instead an anonymous class, you can just > >> subclass FFIExternalValueHolder: > >> > >> FFIExternalValueHolder subclass: #MyIntPtr > >> > >> and then implement typeDecl class method > >> > >> MyIntPtr class>>typeDecl > >> ^ ?int' > >> > >> and this will work as the anonymous class > > > > The second option is definitely what I want. > > Personally my option would be to put my types in a class pool and use them, not to extendâ¦ > but option is there so you can choose what you want :) > > > I am trying to expose a function returning several ints, as in SDL2>>mouseStateX: y: (excluding the possibility to return a Point). > > However I would rather not define my own int holder, can't we have generic holders to rely on? > > I will not add for the moment that predefined types value holdersâ¦ We would need to add one for each type we support to be consistent, and document it, and add tests. > And btwâ¦ you do have a generic holderâ¦ is just that you need to refine it to what you want :) > You could always use a ByteArray and took values later (some functions in Athens do it like that). The advantage of this approach (using plain ByteArrays) is that you do not need to change function signature at the cost of needing to do manually what the value holder does for you. > > Hi Esteban, > > is this the way it should be done for Strings ? > For example, old NBOpenGL had this Windows method to get the Window Title: > > getWindowText: hWnd buffer: lpString bufferSize: nMaxCount > <primitive: #primitiveNativeCall module: #NativeBoostPlugin> > > ^self nbCall: #(int GetWindowTextA(HWND hWnd, char* lpString, int nMaxCount)) > module: #user32 > > called as: > > getWindowText > | len str | > str := ByteString new: 1000. > len := self getWindowText: self buffer: str bufferSize: 1000. > ^ str first: len. > > > When I just modify the ffiCall to > > getWindowText: hWnd buffer: lpString bufferSize: nMaxCount > > ^self ffiCall: #(int GetWindowTextA(HWND hWnd, char* lpString, int nMaxCount)) module: #user32 > > I get just an empty String. > > But If I call it with: > > | len str | > str := ByteArray new: 1000. > len := self getWindowText: self buffer: str bufferSize: 1000. > ^ String fromByteArray: (str first: len). > > I get the real string text. Is this the way to go? > > > > > My advise is that you go with what you need, we can consider add predefined value holders later. > > Esteban > > > > > Thibault > >

April 13, 2016