- Pharo-users - lists.pharo.org

Re: [Pharo-users] Glorp + NBSQLite3

by Esteban A. Maringolo

2014-10-06 14:11 GMT-03:00 Sanjay-M <sm(a)planage.com>: > what I was saying was supposing we write a server that alone only accesses > the SQLite database. Users behave like clients accessing the server over > TCP/IP. > and the text i pointed to in my earlier mail detailed how such a scenario > could be implemented. > If someone could write a small sample with say one class then it could be > easier to understand / implement But that has nothing to do with SQLite nor any other persistence solution. In fact most web applications work that way, where the messaging runs over HTTP (and hence TCP/IP) and the server responds to them. NBSQLite3 is a good solution for self contained applications, where you can distribute everything without requiring the installation/configuration of any third party DB server. If you can't have a web server in your network environment (i.e. intranet/LAN) how will you have any other TCP/IP based server? I mean, if you want to run a Pharo image as your server tier, unless you have certain port/policies restrictions, it will make no difference whether you run an HTTP server or your [put your custom protocol here] server. Regards!

Oct. 6, 2014

Re: [Pharo-users] Glorp + NBSQLite3

by Sanjay-M

what I was saying was supposing we write a server that alone only accesses the SQLite database. Users behave like clients accessing the server over TCP/IP. and the text i pointed to in my earlier mail detailed how such a scenario could be implemented. If someone could write a small sample with say one class then it could be easier to understand / implement ----- --- Regards, Sanjay -- View this message in context: http://forum.world.st/Glorp-NBSQLite3-tp4779996p4783001.html Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.

Oct. 6, 2014

Re: [Pharo-users] NeoCSVReader skipEmptyLines?

by Sven Van Caekenberghe

In #bleedingEdge: === Name: Neo-CSV-Core-SvenVanCaekenberghe.21 Author: SvenVanCaekenberghe Time: 6 October 2014, 5:49:01.691696 pm UUID: a6faeef3-aaa7-460f-a815-8e77b62f9906 Ancestors: Neo-CSV-Core-SvenVanCaekenberghe.20 Added NeoCSVReader>>#addIgnoredFields: Added NeoCSVReader>>#select:[thenDo:] to skip empty or other records Added NeoCSVReaderTests>>#testSkippingEmptyRecords === Name: Neo-CSV-Tests-SvenVanCaekenberghe.18 Author: SvenVanCaekenberghe Time: 6 October 2014, 5:49:36.206743 pm UUID: 95d87278-4398-41d3-96ed-83705d5488ce Ancestors: Neo-CSV-Tests-SvenVanCaekenberghe.17 Added NeoCSVReader>>#addIgnoredFields: Added NeoCSVReader>>#select:[thenDo:] to skip empty or other records Added NeoCSVReaderTests>>#testSkippingEmptyRecords === Here is the test: testSkippingEmptyRecords | input output | input := '1,2,3\\4,5,6\,,\7,8,9' withCRs. output := (NeoCSVReader on: input readStream) select: [ :each | each notEmpty and: [ (each allSatisfy: #isNil) not ] ]. self assert: output equals: #(#('1' '2' '3') #('4' '5' '6') #('7' '8' '9')). output := (NeoCSVReader on: input readStream) emptyFieldValue: ''; select: [ :each | each notEmpty and: [ (each allSatisfy: #isEmpty) not ] ]. self assert: output equals: #(#('1' '2' '3') #('4' '5' '6') #('7' '8' '9')) Regards, Sven On 05 Oct 2014, at 02:39, Esteban A. Maringolo <emaringolo(a)gmail.com> wrote: > 2014-10-04 10:47 GMT-03:00 Sven Van Caekenberghe <sven(a)stfx.eu>: >> Esteban, >> >> On 04 Oct 2014, at 02:42, Esteban A. Maringolo <emaringolo(a)gmail.com> wrote: >> >>> Sven, >>> >>> Is it possible to skip blank/empty lines in NeoCSVReader? >>> >>> So if a line is empty or contains ",,,,,,,," it would be skipped from >>> the iteration. >>> >>> Does it already provider such feature? (I couldn't find any setting >>> related with this). >>> >>> Esteban A. Maringolo >> >> Could you elaborate a bit on the use case ? > > Yes, users upload a CSV file with the proper columns (sometimes they > don't, but that's another story), and because they export/copy the CSV > from Excel most of > the times there are *lots* (might be hundreds) of empty lines at the > end, it is, lines > with separators only, or even blank lines. > >> My first reaction would be that you have to deal with these yourself afterwards. > > When dealing with "array based" records, it is, with no #recordClass > defined it would be easier. Because you can check whether all the > values of the array are empty or nil. So on each iteration (#next) you > could return the value array if it isn't empty or send #next again > until you get a record with any data. > > When working with a record class I think you can't do this, because it > seems you instantiate the record before iterating through each field > of the record. > >> What would be the definition of an empty record ? What about empty quoted fields ? > > An empty record of a four columns CSV file would look like: > ,,, > or (if some columns are quoted) > ,"","", > > I don't see how a record like that could be of any use. > > Best regards! > > Esteban A. Maringolo > > >> PS: I got your other contribution, I think it is OK to add, thanks. > > Great!

Oct. 6, 2014

Re: [Pharo-users] Glorp + NBSQLite3

by Esteban A. Maringolo

Pierce, Thank you for the answers. Is the wrapper thread safe? I understan the library is thread-safe per se (at least in Android+Java it is), so using the wrapper in Pharo (single-threaded at the OS level) wouldn't cause issues. But I don't know how NativeBoost plays here. Regards! Esteban A. Maringolo 2014-09-25 13:40 GMT-03:00 Pierce Ng <pierce(a)samadhiweb.com>: > On Wed, Sep 24, 2014 at 01:33:02PM -0300, Esteban A. Maringolo wrote: >> How does SQLite scale in terms of table size and so on? > > According to https://www.sqlite.org/whentouse.html: > > An SQLite database is limited in size to 140 terabytes (2^47 bytes, 128 > tibibytes). And even if it could handle larger databases, SQLite stores the > entire database in a single disk file and many filesystems limit the maximum > size of files to something less than this. > > SQLite will normally work fine as the database backend to a website. But if > you website is so busy that you are thinking of splitting the database > component off onto a separate machine, then you should definitely consider > using an enterprise-class client/server database engine instead of SQLite. > > >> I was surprised to know it is based on an old version of PostgreSQL >> according to this presentation: >> http://www.pgcon.org/2014/schedule/events/736.en.html > > That is a very interesting talk. As it says, SQLite is a replacement for > fopen(), not a replacement for PostgreSQL. In the context of my writing tools > and applications in Smalltalk, I'd like to enjoy SQLite's robustness, hence > my interest in having/building a good Smalltalk wrapper. > > Pierce > >

Oct. 6, 2014

Re: [Pharo-users] Glorp + NBSQLite3

by Esteban A. Maringolo

Sanjay-M <sm(a)planage.com> wrote: > I was wondering if this approach could be adopted in developing a > Client/Server application with a separate server component accessing the > SQLite database (on a separate machine). > If a template / model can be developed i am sure this can be very useful in > creating larger multi-user applications even at the cost of some duplication > / redundant effort. > I am thinking of situations where we cannot have a web server even on the > intranet - more like traditional servers accessed over TCP/IP Sorry but I can't follow your question. SQLite is a file based RDBMS engine, designed to be accessed locally and not through TCP/IP. If what you need to do is run over a network PostgreSQL will provide you with such feature (plus a lot others). Remember: âSQLite is not a replacement for PostgreSQL [or any other RDBMS]. SQLite is a replacement for fopen().â Regards. Esteban A. Maringolo

Oct. 6, 2014

Re: [Pharo-users] Glorp + NBSQLite3

by Sanjay-M

I am thinking of situations where we cannot have a web server even on the intranet - more like traditional servers accessed over TCP/IP ----- --- Regards, Sanjay -- View this message in context: http://forum.world.st/Glorp-NBSQLite3-tp4779996p4782972.html Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.

Oct. 6, 2014

Re: [Pharo-users] Glorp + NBSQLite3

by Pierce Ng

On Fri, Oct 03, 2014 at 09:19:15PM -0700, Sanjay-M wrote: > I was wondering if this approach could be adopted in developing a > Client/Server application with a separate server component accessing the > SQLite database (on a separate machine). Using HTTP/S as the client-server protocol, have the web app server manage data persistence, be it SQLite, GOODS or Gemstone, ...? Pierce

Oct. 6, 2014

Re: [Pharo-users] Glorp + NBSQLite3

by Pierce Ng

On Fri, Oct 03, 2014 at 10:44:43PM +0200, stepharo wrote: > Cool what is NBSQLite3 (a nativeboost version)? Nice. Would be nice > once you API stabilize that we get a chapter or on NBSQLite3 :) Yes, NativeBoost interface to SQLite. Yes, I plan to write a chapter on it. :-) Pierce

Oct. 6, 2014

Re: [Pharo-users] Android VM update

by kilon alios

cant wait to test this on android , hope it becomes available via play store :) On Mon, Oct 6, 2014 at 12:57 PM, Annick Fron <list(a)afceurope.com> wrote: > Hi, > > Should I load the new versions of FFI and Alien as well ? from September > 30th ? > > Annick > > Le 6 oct. 2014 Ã 11:30, Jean Baptiste Arnaud <jbaptiste.arnaud(a)gmail.com> > a Ã©crit : > > Hi, > I just comeback from holiday, and I realise that I do not have done a > announcement yet. > Now the prototype of the Pharo Android VM work. > - Event is managed > - Resolution up to 1080p is managed. > - Most of the plugins seems worked. > - File plugin allow you to browse the sd card. > Next: > - fix the generator then jenkins. Merge with Pharo/Cog main and Make it > available for the public. > - die under the mountain of bug entry open by the first public release. First > release will be perfect and bugless. > - allow easy personalisation of the packaging, allow you to rename and > change icon easily (for your own application, Squeak/Pharo Android VM, > Phratch, DR geo, etc.). > - refined the jumpout logic for have a better graphical update and a > better idle process (less consumption, faster reactive UI, UI updating > during heavy computation, etc. ). > - package the android feature in the android plugin, show/hide the > keyboard via primitive, etc. etc. + init configuration. > - a lot of cool idea but later > > Here is a youtube video to show the result: > http://youtu.be/lB9UV9Z7Kss > > You can forward this to other mailing list, I do not have access to all of > them. > > Best Regards > Dr Arnaud > jbaptiste.arnaud(a)gmail.com > > > > > > > > > >

Oct. 6, 2014

Re: [Pharo-users] Android VM update

by Annick Fron

Hi, Should I load the new versions of FFI and Alien as well ? from September 30th ? Annick Le 6 oct. 2014 Ã 11:30, Jean Baptiste Arnaud <jbaptiste.arnaud(a)gmail.com> a Ã©crit : > Hi, > I just comeback from holiday, and I realise that I do not have done a announcement yet. > Now the prototype of the Pharo Android VM work. > - Event is managed > - Resolution up to 1080p is managed. > - Most of the plugins seems worked. > - File plugin allow you to browse the sd card. > Next: > - fix the generator then jenkins. Merge with Pharo/Cog main and Make it available for the public. > - die under the mountain of bug entry open by the first public release. First release will be perfect and bugless. > - allow easy personalisation of the packaging, allow you to rename and change icon easily (for your own application, Squeak/Pharo Android VM, Phratch, DR geo, etc.). > - refined the jumpout logic for have a better graphical update and a better idle process (less consumption, faster reactive UI, UI updating during heavy computation, etc. ). > - package the android feature in the android plugin, show/hide the keyboard via primitive, etc. etc. + init configuration. > - a lot of cool idea but later > > Here is a youtube video to show the result: > http://youtu.be/lB9UV9Z7Kss > > You can forward this to other mailing list, I do not have access to all of them. > > Best Regards > Dr Arnaud > jbaptiste.arnaud(a)gmail.com > > > > > > > >

Oct. 6, 2014