May 2011 - Pharo-dev - lists.pharo.org

Re: [Pharo-project] Basic tricks for improving a serializer?

by Sven Van Caekenberghe

Mariano, On 17 May 2011, at 15:21, Mariano Martinez Peck wrote: > Now Igor told us for example, to use a buffer like this: > > | bufferStream | > bufferStream := ByteArray new writeStream. > > (FLSerializer on: bufferStream) > serialize: anArrayToSerialize. > > aFileStream nextPutAll: bufferStream contents. > > and that it at least 2 times faster than we were doing.... I guess it is because it goes to the disk only once. But MultiByteFileStream uses a buffer, doesn't it ? The disadvantage of the above is that you buffer everything before you write. Furthermore you are growing the buffer all the time (recopying contents) which is not too efficient. Some time ago we had a discussion about this and then I implemented ZnBufferedWriteStream (it should be in Core 1.3), have a look. It was just a quick hack, but it worked in speeding up writing. Sven

May 17, 2011

Re: [Pharo-project] I give up. Squeaksource has lost lot of versions again

by StÃ©phane Ducasse

> > >> Now this is why ESUG payed objectFusion to propose a new application. >> > > Is there a plan to provide a migration from squeaksource to new system? > Because if not, then i'm afraid, most people will keep using SqS > and imagine how many configs/wiki pages and other stuff needs to be updated. not that I know. I would give a certain amount of time to people to migrate (with their own little fingers) put all the mcz on a ftp somewhere close squeaksource > I'd prefer to fully replace SqS with new system at some day without > need of migrating projects by all developers and updating > links/configs etc. > > >> >> Now again if you give me one engineer full time I'm sure that we can do that. >> Do you think that svn or git where created from the air without sponsoring......? >> Just curious. >> >> Stef >> > > > -- > Best regards, > Igor Stasenko AKA sig. >

May 17, 2011

[Pharo-project] Basic tricks for improving a serializer?

by Mariano Martinez Peck

Hi guys. Together with Martin we are developing a fast object graph serializer called Fuel. The idea is to use a pickle format similar to VW Parcels. Right now we are able to correctly serialize (almost) all kind of objects (from different classes and so on). The algorithm is working quite well and we are already quite fast. We also know how to encode more or less efficient some of the "primitive" classes like Floats, SmallIntegers, ByteString, ByteArray, etc, etc. What we really don't know anything about streams. For example, until now, we were using just a MultiByteFileStream and doing all the time things like #next: #nextPutAll: #nextWordPut: etc... Now Igor told us for example, to use a buffer like this: | bufferStream | bufferStream := ByteArray new writeStream. (FLSerializer on: bufferStream) serialize: anArrayToSerialize. aFileStream nextPutAll: bufferStream contents. and that it at least 2 times faster than we were doing.... I guess it is because it goes to the disk only once. But MultiByteFileStream uses a buffer, doesn't it ? For reading (deserialization) we are not doing nothing special. We just open the file stream and we read with #next #nextString ... etc. Another thing is which kind of file stream should we use. MultiByteFileStream ? StandardFileStream ? So...before spending time in some optimizations, are there "known" things that we should check? Thanks in advance, -- Mariano http://marianopeck.wordpress.com

May 17, 2011

Re: [Pharo-project] [TODO] 1.2.2

by Marcus Denker

All green, all done. https://gforge.inria.fr/frs/download.php/28551/Pharo-1.2.2-12353.zip https://gforge.inria.fr/frs/download.php/28546/PharoCore-1.2.2-12353.zip What remains to be done is to update the One-Click and the website. On May 16, 2011, at 9:10 AM, Marcus Denker wrote: > Core > ----- > -> All Tests Green > -> No known Bugs reported > -> Version number set to 1.2.2 > -> New pre-build uploaded, will be linked as current stable core soon. > > From now on, 1.2 will stay in "release" mode, we will just fix bugs that happen, but > there will be no dedicted "1.2.3" release. > (For 1.3, we will do the same: no point release, just an eternal stream of bug fixes in 1.3 Release > The version number is just 1.3 plus the update number, that's enough) > > Full > ---- > Failing Tests: 4 > Open Bugs: 1 > > http://code.google.com/p/pharo/issues/list?can=2&q=milestone=1.2.2-DevImage > Issue 4166: Failing Tests: OBFakeBrowserTest (ConfigurationOfOmniBrowser needs update) > > So somone needs to take the current 1.3 of OB Metacello and sync the 1.2 config to load the > same packaged. Should not be hard to do. > > > -- > Marcus Denker -- http://www.marcusdenker.de > INRIA Lille -- Nord Europe. Team RMoD. > -- Marcus Denker -- http://www.marcusdenker.de INRIA Lille -- Nord Europe. Team RMoD.

May 17, 2011

Re: [Pharo-project] SqueakDBX and MacOS X

by Olivier Auverlot

Hi Luc, > 2) ensure that your dylib is compiled for the right architecture > (32bit) considering that current VMs are 32bits > Perhaps this is your problem? > what gives: > > $ lipo -info libopendbx.dylib Non-fat file: libopendbx.dylib is architecture: x86_64 Bingo ! The library is compiled in 64 bits :-( In fact, all my files (except the library for PostgreSQL) are in 64 bits... Thanks ;-) Olivier

May 17, 2011

Re: [Pharo-project] SqueakDBX and MacOS X

by Luc Fabresse

Hi Olivier, IIRC, you should: 1) fix the location problem by putting symlink in the right place. 2) ensure that your dylib is compiled for the right architecture (32bit) considering that current VMs are 32bits Perhaps this is your problem? what gives: $ lipo -info libopendbx.dylib #Luc 2011/5/17 Olivier Auverlot <olivier.auverlot(a)gmail.com> > Hi, > > I try to use SqueakDBX on Mac OS X 10.6. I have downloaded and compiled the > libraries for PostgreSQL, MySQL and finaly compiled and installed openDBX. > > CPPFLAGS="-I/opendbx/PostgreSQL/9.0/include -I/opendbx/mysql/5.0/include" > LDFLAGS="-L/opendbx/PostgreSQL/9.0/lib -L/opendbx/mysql/5.0/lib" > ./configure --disable-utils --with-backends="pgsql mysql sqlite3" > > Now, I have in /usr/local/lib: > > -rwxr-xr-x 1 root wheel 17040 17 mai 09:10 libopendbx.1.dylib > -rw-r--r-- 1 root wheel 32584 17 mai 09:10 libopendbx.a > lrwxr-xr-x 1 root wheel 18 17 mai 09:10 libopendbx.dylib -> > libopendbx.1.dylib > -rwxr-xr-x 1 root wheel 1001 17 mai 09:10 libopendbx.la > -rwxr-xr-x 1 root wheel 74624 17 mai 09:10 libopendbxplus.1.dylib > -rw-r--r-- 1 root wheel 385056 17 mai 09:10 libopendbxplus.a > lrwxr-xr-x 1 root wheel 22 17 mai 09:10 libopendbxplus.dylib -> > libopendbxplus.1.dylib > -rwxr-xr-x 1 root wheel 1054 17 mai 09:10 libopendbxplus.la > > and in /usr/local/opendbx : > -rwxr-xr-x 1 root wheel 17232 17 mai 09:10 libmysqlbackend.1.so > -rw-r--r-- 1 root wheel 38960 17 mai 09:10 libmysqlbackend.a > -rwxr-xr-x 1 root wheel 1051 17 mai 09:10 libmysqlbackend.la > lrwxr-xr-x 1 root wheel 20 17 mai 09:10 libmysqlbackend.so -> > libmysqlbackend.1.so > -rwxr-xr-x 1 root wheel 16904 17 mai 09:10 libpgsqlbackend.1.so > -rw-r--r-- 1 root wheel 28624 17 mai 09:10 libpgsqlbackend.a > -rwxr-xr-x 1 root wheel 1036 17 mai 09:10 libpgsqlbackend.la > lrwxr-xr-x 1 root wheel 20 17 mai 09:10 libpgsqlbackend.so -> > libpgsqlbackend.1.so > -rwxr-xr-x 1 root wheel 16856 17 mai 09:10 libsqlite3backend.1.so > -rw-r--r-- 1 root wheel 25936 17 mai 09:10 libsqlite3backend.a > -rwxr-xr-x 1 root wheel 1053 17 mai 09:10 libsqlite3backend.la > lrwxr-xr-x 1 root wheel 22 17 mai 09:10 libsqlite3backend.so -> > libsqlite3backend.1.so > > ok... > > I have downloaded the OneClick distribution of Pharo 1.2.1 and installed > SqueakDBX and GlorpDBX. > > Gofer new squeaksource: 'MetacelloRepository'; > package: 'ConfigurationOfSqueakDBX'; > load. > > ConfigurationOfSqueakDBX project latestVersion load. > > Gofer new squeaksource: 'MetacelloRepository'; > package: 'ConfigurationOfGlorpDBX'; > load. > > ConfigurationOfGlorpDBX project latestVersion load. > > Now, I try to do a SQL request to MySQL: > > connect > | conn connectionSettings result | > > connectionSettings := DBXConnectionSettings > host: 'mysql.domaine.fr' > port: '3306' > database: 'test' > userName: 'username' > userPassword: 'hello'. > > conn := DBXConnection > platform: DBXMySQLPlatform new > settings: connectionSettings. > > conn connect. > > conn open. > result := conn execute: 'SELECT * from data'. > > DBXTranscript show: result. > > conn close. > > But I get an error : 'Unable to find function address' > > SqueakDBX didn't found the libraries ? I have try to copy the librairies in > /usr/lib and /usr/lib/opendbx but with no results. In the Resources > subdirectory, I have created a symbolic link to > /usr/local/lib/libopendbx.dylib but without progress. > > ln -s /usr/local/lib/libopendbx.dylib opendbx > > I get the same error :-( > > If i modify the info.plist file to set the SqueakDebug key at 1 and the > SqueakPluginsBuiltInOrLocalOnly key at false, I can see the search of > librairies by the SqueakVM. The SqueakVM doesn't seem to try to load the > openddbx libraries. > > You can download the log file at > http://www.auverlot.fr/squeakdbx/squeakdbx.txt > > My previous tests under Linux have worked fine but i didn't find a solution > with Mac OS X. Someone has an idea for help me ??? > > Thanks for your help. > > Best regards > Olivier > www.auverlot.fr > > >

May 17, 2011

Re: [Pharo-project] Filesystem-cwp.120 is broken

by Lukas Renggli

> I just downloaded Filesystem-cwp.120... it is empty, and that makes ConfigurationOfFilesystem to not load correctly. If you read the comment of Filesystem-cwp.120 you see that this is intentional. The package was split quite some time ago into various independent ones. Lukas -- Lukas Renggli www.lukas-renggli.ch

May 17, 2011

[Pharo-project] SqueakDBX and MacOS X

by Olivier Auverlot

Hi, I try to use SqueakDBX on Mac OS X 10.6. I have downloaded and compiled the libraries for PostgreSQL, MySQL and finaly compiled and installed openDBX. CPPFLAGS="-I/opendbx/PostgreSQL/9.0/include -I/opendbx/mysql/5.0/include" LDFLAGS="-L/opendbx/PostgreSQL/9.0/lib -L/opendbx/mysql/5.0/lib" ./configure --disable-utils --with-backends="pgsql mysql sqlite3" Now, I have in /usr/local/lib: -rwxr-xr-x 1 root wheel 17040 17 mai 09:10 libopendbx.1.dylib -rw-r--r-- 1 root wheel 32584 17 mai 09:10 libopendbx.a lrwxr-xr-x 1 root wheel 18 17 mai 09:10 libopendbx.dylib -> libopendbx.1.dylib -rwxr-xr-x 1 root wheel 1001 17 mai 09:10 libopendbx.la -rwxr-xr-x 1 root wheel 74624 17 mai 09:10 libopendbxplus.1.dylib -rw-r--r-- 1 root wheel 385056 17 mai 09:10 libopendbxplus.a lrwxr-xr-x 1 root wheel 22 17 mai 09:10 libopendbxplus.dylib -> libopendbxplus.1.dylib -rwxr-xr-x 1 root wheel 1054 17 mai 09:10 libopendbxplus.la and in /usr/local/opendbx : -rwxr-xr-x 1 root wheel 17232 17 mai 09:10 libmysqlbackend.1.so -rw-r--r-- 1 root wheel 38960 17 mai 09:10 libmysqlbackend.a -rwxr-xr-x 1 root wheel 1051 17 mai 09:10 libmysqlbackend.la lrwxr-xr-x 1 root wheel 20 17 mai 09:10 libmysqlbackend.so -> libmysqlbackend.1.so -rwxr-xr-x 1 root wheel 16904 17 mai 09:10 libpgsqlbackend.1.so -rw-r--r-- 1 root wheel 28624 17 mai 09:10 libpgsqlbackend.a -rwxr-xr-x 1 root wheel 1036 17 mai 09:10 libpgsqlbackend.la lrwxr-xr-x 1 root wheel 20 17 mai 09:10 libpgsqlbackend.so -> libpgsqlbackend.1.so -rwxr-xr-x 1 root wheel 16856 17 mai 09:10 libsqlite3backend.1.so -rw-r--r-- 1 root wheel 25936 17 mai 09:10 libsqlite3backend.a -rwxr-xr-x 1 root wheel 1053 17 mai 09:10 libsqlite3backend.la lrwxr-xr-x 1 root wheel 22 17 mai 09:10 libsqlite3backend.so -> libsqlite3backend.1.so ok... I have downloaded the OneClick distribution of Pharo 1.2.1 and installed SqueakDBX and GlorpDBX. Gofer new squeaksource: 'MetacelloRepository'; package: 'ConfigurationOfSqueakDBX'; load. ConfigurationOfSqueakDBX project latestVersion load. Gofer new squeaksource: 'MetacelloRepository'; package: 'ConfigurationOfGlorpDBX'; load. ConfigurationOfGlorpDBX project latestVersion load. Now, I try to do a SQL request to MySQL: connect | conn connectionSettings result | connectionSettings := DBXConnectionSettings host: 'mysql.domaine.fr' port: '3306' database: 'test' userName: 'username' userPassword: 'hello'. conn := DBXConnection platform: DBXMySQLPlatform new settings: connectionSettings. conn connect. conn open. result := conn execute: 'SELECT * from data'. DBXTranscript show: result. conn close. But I get an error : 'Unable to find function address' SqueakDBX didn't found the libraries ? I have try to copy the librairies in /usr/lib and /usr/lib/opendbx but with no results. In the Resources subdirectory, I have created a symbolic link to /usr/local/lib/libopendbx.dylib but without progress. ln -s /usr/local/lib/libopendbx.dylib opendbx I get the same error :-( If i modify the info.plist file to set the SqueakDebug key at 1 and the SqueakPluginsBuiltInOrLocalOnly key at false, I can see the search of librairies by the SqueakVM. The SqueakVM doesn't seem to try to load the openddbx libraries. You can download the log file at http://www.auverlot.fr/squeakdbx/squeakdbx.txt My previous tests under Linux have worked fine but i didn't find a solution with Mac OS X. Someone has an idea for help me ??? Thanks for your help. Best regards Olivier www.auverlot.fr

May 17, 2011

[Pharo-project] Filesystem-cwp.120 is broken

by Esteban Lorenzano

Hi, I just downloaded Filesystem-cwp.120... it is empty, and that makes ConfigurationOfFilesystem to not load correctly. Cheers, Esteban

May 17, 2011

[Pharo-project] [update 1.3] #13204

by Marcus Denker

13204 ----- Issue 4022: Symbol readFrom: Issue 4228: Failing Tests: CollectionsTests.Strings.StringTest.testWithNoLineLongerThan ... with this 1.3 Core should be Green. -- Marcus Denker -- http://www.marcusdenker.de INRIA Lille -- Nord Europe. Team RMoD.

May 17, 2011