[Pharo-project] Statistic tools in Pharo
Hi! Is there a statistic library in Pharo? Computing the correlation, linear regression, ... Cheers, Alexandre -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.
On Wed, Sep 29, 2010 at 1:07 AM, Alexandre Bergel <alexandre@bergel.eu> wrote:
Hi!
Is there a statistic library in Pharo? Computing the correlation, linear regression, ...
Not really but there is some work on Random numbers generator : http://www.squeaksource.com/Random.html I'm also interested by some probabilistic library. -- Serge Stinckwich UMI UMMISCO 209 (IRD/UPMC), Hanoi, Vietnam Every DSL ends up being Smalltalk http://doesnotunderstand.org/
On 9/28/2010 1:07 PM, Alexandre Bergel wrote:
Hi!
Is there a statistic library in Pharo? Computing the correlation, linear regression, ...
Cheers, Alexandre In a conversation with Stef earlier, he pointed me toward http://www.squeaksource.com/DHBNumerical.html
I haven't explored it yet, so am not familiar with its methods. Maybe it can meet some of your needs. Jimmie
On Wed, Sep 29, 2010 at 8:42 AM, Jimmie Houchin <jlhouchin@gmail.com> wrote:
 On 9/28/2010 1:07 PM, Alexandre Bergel wrote:
Hi!
Is there a statistic library in Pharo? Computing the correlation, linear regression, ...
Cheers, Alexandre
In a conversation with Stef earlier, he pointed me toward http://www.squeaksource.com/DHBNumerical.html
I haven't explored it yet, so am not familiar with its methods.
Maybe it can meet some of your needs.
Yes, interesting, but what is the licence ? -- Serge Stinckwich UMI UMMISCO 209 (IRD/UPMC), Hanoi, Vietnam Every DSL ends up being Smalltalk http://doesnotunderstand.org/
On 9/28/2010 8:52 PM, Serge Stinckwich wrote:
On Wed, Sep 29, 2010 at 8:42 AM, Jimmie Houchin<jlhouchin@gmail.com> wrote:
On 9/28/2010 1:07 PM, Alexandre Bergel wrote:
Hi!
Is there a statistic library in Pharo? Computing the correlation, linear regression, ...
Cheers, Alexandre In a conversation with Stef earlier, he pointed me toward http://www.squeaksource.com/DHBNumerical.html
I haven't explored it yet, so am not familiar with its methods.
Maybe it can meet some of your needs. Yes, interesting, but what is the licence I didn't even look initially. Since it was on SqueakSource I just kind of assumed it was Squeak friendly. Unfortunately it is not.
From http://sourceforge.net/projects/dhbnumerics/#more the license is LGPL.
Project admins are: http://sourceforge.net/project/memberlist.php?group_id=53783 Adriaan van Os, Donald MacQueen, Joseph Whitesell, Roger Whitney, Sean Glazier Does anybody here have sufficient access to any of these people or DHB himself to request a Squeak/Pharo friendly license. Thanks. Jimmie
Thanks Jimmie. About half of the tests are red. This library is about linear Algebra. Not really about statistics. But thanks for the link! Alexandre On 28 Sep 2010, at 21:42, Jimmie Houchin wrote:
On 9/28/2010 1:07 PM, Alexandre Bergel wrote:
Hi!
Is there a statistic library in Pharo? Computing the correlation, linear regression, ...
Cheers, Alexandre In a conversation with Stef earlier, he pointed me toward http://www.squeaksource.com/DHBNumerical.html
I haven't explored it yet, so am not familiar with its methods.
Maybe it can meet some of your needs.
Jimmie
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.
On Sep 29, 2010, at 2:47 34PM, Alexandre Bergel wrote:
Thanks Jimmie. About half of the tests are red. This library is about linear Algebra. Not really about statistics. But thanks for the link!
Alexandre
If it's the same as what you can find in VW, in addition to linear algebra, it includes numerical methods for quite a few probability distributions as well though. Cheers, Henry
Thanks Jimmie. About half of the tests are red. This library is about linear Algebra. Not really about statistics. But thanks for the link!
Alexandre
If it's the same as what you can find in VW, in addition to linear algebra, it includes numerical methods for quite a few probability distributions as well though.
Ok, thanks for the input! Alexandre -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.
Le 29 sept. 2010 à 15:39, Alexandre Bergel a écrit :
Thanks Jimmie. About half of the tests are red. This library is about linear Algebra. Not really about statistics. But thanks for the link!
Alexandre
If it's the same as what you can find in VW, in addition to linear algebra, it includes numerical methods for quite a few probability distributions as well though.
Ok, thanks for the input!
FWIW, I plan to implement Bayesian Network in Smalltalk... Nevertheless, it will be more a research project... Until now, I haven't found any project nor code in that direction... except maybe SBN (Simple Bayesian Network) in ruby... Cheers
Alexandre -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
Ok. I am personally more interested in regression models Alexandre On 2 Oct 2010, at 07:15, Cédrick Béler wrote:
Le 29 sept. 2010 à 15:39, Alexandre Bergel a écrit :
Thanks Jimmie. About half of the tests are red. This library is about linear Algebra. Not really about statistics. But thanks for the link!
Alexandre
If it's the same as what you can find in VW, in addition to linear algebra, it includes numerical methods for quite a few probability distributions as well though.
Ok, thanks for the input!
FWIW, I plan to implement Bayesian Network in Smalltalk... Nevertheless, it will be more a research project...
Until now, I haven't found any project nor code in that direction... except maybe SBN (Simple Bayesian Network) in ruby...
Cheers
Alexandre -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.
I've been lurking on this thread because I also need a lot of statistics in my work, but as already wrote in another thread on far but related subject: I think we are better of if we get the FFI or Alien or its successor to work in such a way that makes it easy to interface with existing, thoroughly tested and continuously developed functionality for these specific areas. I presently work a lot with R http://www.r-project.org/ and I remember an embryonic interface to it was done in Dolphin Smalltalk (which is Windows only), besides seem a former associate testing it a little, I went not any further on exploring it. BTW, going to wishful mode I _think_ having connection to packages of this calibre (another one I'll like to have easy access is GNUPlot) would be even better if we could get the image inside a morphic object which would work as a graphics device for these programs. . . my .0199999. . . []s Em 02/10/2010 11:24, Alexandre Bergel < alexandre@bergel.eu > escreveu: Ok. I am personally more interested in regression models Alexandre On 2 Oct 2010, at 07:15, Cédrick Béler wrote:
Le 29 sept. 2010 à 15:39, Alexandre Bergel a écrit :
Thanks Jimmie. About half of the tests are red. This library is about linear Algebra. Not really about statistics. But thanks for the link!
Alexandre
If it's the same as what you can find in VW, in addition to linear algebra, it includes numerical methods for quite a few probability distributions as well though.
Ok, thanks for the input!
FWIW, I plan to implement Bayesian Network in Smalltalk... Nevertheless, it will be more a research project...
Until now, I haven't found any project nor code in that direction... except maybe SBN (Simple Bayesian Network) in ruby...
Cheers
Alexandre -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
I recently became disillusioned with gnuplot and overall suggest prodding and helping the PLplot developers to improve their product. The breaking point for me was plotting ~500k sample time series and watching Pharo+gnuplot struggle with marshaling data into and out of text or worse, fighting with barely documented methods for moving binary data into gnuplot. Remember my questions about a Linux analog to Windows device contexts (one of the few things MS got right)? Ground zero for this. My PLplot interface will likely appear "soon." It needs to be cleaned up with 1.1.1 in mind, as does (much more so) code that I will make available for AccesIO USB A/D hardware. For numerical calculations, I agree that well-worn code (which can be hard to find) is of great value. GSL is pretty good. One thing that irritates me no end is that they use their vectors and matrices just enough to be a major pain but not at all consistently. They also need to be scolded for making .so's (GSL and BLAS) that can't be loaded separately - they know about it - don't hold your breath. Callbacks are sorely needed on our end[*]. When I have something worthy of release, I'll let you know; no promises about Windows support, though I won't deliberatly sabotage it - I simply don't care (and it feels GOOD<g>). R is both friend and foe. In general, I prepare data using Smalltalk (so I widen or lengthen data frames in Pharo rather than trying to figure out R syntax for such things). Rejecting garbage, to a point, happens in R. I generally prefer to let R arrive at statistical measures (p-values, correlation coeffs, etc.) that are going to leave the nest. My late Friday PM submission (now we wait...) contains numbers generated with various libraries, massaged in R, graphs from R and PLplot and nothing from gnuplot (which I was using just a couple of months ago). One scary thing: PLplot is only now growing a formalized way to create legends, which gnuplot does very well. But if you deal with large numbers of points, gnuplot can become slow and pedantic. The usual excuses such as "if you have that much data, you can't see them anyway..." don't really cut it. There is something to be said for plotting everything and letting what Tufte would call ink density tell part of the story, especially with time series where peaks/outliers are interesting (downsampling will generally distort the message). [*] Sig, yes, I know... :) With the release of 1.1.1 and completion (for now) of my grant proposal, I need to start looking at undoing any damage that I have caused in the name of avoiding underscores. Some things are arguably nicer for it, but most suffered mightily. I am thinking exclusively of exernal interfacing; some of the stuff was named in a way that expects underscore to be present, and removing them makes a hell of a mess. Time to fix that (thanks to all how have made it possible!!!), get daily operations on 1.1.1 and then to begin playing with NativeBoost. I see there are pre-built Cog vms. Is there a way to either build Cog+NB or to transfer the NB plugin built elsewhere to Cog? Sounds like a good problem to have. Bill -----Original Message----- From: pharo-project-bounces@lists.gforge.inria.fr [mailto:pharo-project-bounces@lists.gforge.inria.fr] On Behalf Of csrabak@bol.com.br Sent: Saturday, October 02, 2010 7:29 PM To: Pharo-project@lists.gforge.inria.fr Subject: Re: [Pharo-project] Statistic tools in Pharo I've been lurking on this thread because I also need a lot of statistics in my work, but as already wrote in another thread on far but related subject: I think we are better of if we get the FFI or Alien or its successor to work in such a way that makes it easy to interface with existing, thoroughly tested and continuously developed functionality for these specific areas. I presently work a lot with R http://www.r-project.org/ and I remember an embryonic interface to it was done in Dolphin Smalltalk (which is Windows only), besides seem a former associate testing it a little, I went not any further on exploring it. BTW, going to wishful mode I _think_ having connection to packages of this calibre (another one I'll like to have easy access is GNUPlot) would be even better if we could get the image inside a morphic object which would work as a graphics device for these programs. . . my .0199999. . . []s Em 02/10/2010 11:24, Alexandre Bergel < alexandre@bergel.eu > escreveu: Ok. I am personally more interested in regression models Alexandre On 2 Oct 2010, at 07:15, Cédrick Béler wrote:
Le 29 sept. 2010 à 15:39, Alexandre Bergel a écrit :
Thanks Jimmie. About half of the tests are red. This library is about linear Algebra. Not really about statistics. But thanks for the link!
Alexandre
If it's the same as what you can find in VW, in addition to linear algebra, it includes numerical methods for quite a few probability distributions as well though.
Ok, thanks for the input!
FWIW, I plan to implement Bayesian Network in Smalltalk... Nevertheless, it will be more a research project...
Until now, I haven't found any project nor code in that direction... except maybe SBN (Simple Bayesian Network) in ruby...
Cheers
Alexandre -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
_______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
-- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project _______________________________________________ Pharo-project mailing list Pharo-project@lists.gforge.inria.fr http://lists.gforge.inria.fr/cgi-bin/mailman/listinfo/pharo-project
participants (8)
-
Alberto Bacchelli -
Alexandre Bergel -
csrabak@bol.com.br -
Cédrick Béler -
Henrik Johansen -
Jimmie Houchin -
Schwab,Wilhelm K -
Serge Stinckwich