November 2016 - Pharo-users

Re: [Pharo-users] ZnClient GET, but just the content of the <head> tag?

by Sven Van Caekenberghe

Paul, > On 26 Nov 2016, at 18:31, PAUL DEBRUICKER <pdebruic(a)gmail.com> wrote: > > This is a micro optimization if there ever was one but I wondered if it was possible to stop downloading and get the entity once the </head> tag has been received. > > Right now I download the whole page, parse it with Soup, then extract the tags I want from the head. Which works fine. e.g. > > head:=((Soup fromString: (ZnEasy get: 'http://pharo.org') entity) > findChildTag: 'html') findChildTag: 'head'. This would only be useful for large pages. Dealing with the content of resources (like parsing HTML) is outside the scope of Zinc. However, I can help you get started. What you want to do is use streaming. That gives you access to the content of a resource using a direct stream, so you could decide to stop reading (but then you have to close the connection, else you need to read everything anyway). Start by having a look at ZnClient>>#downloadTo: and ZnStreamingEntity. What you want to do is more or less the following. ZnClient new url: 'http://pharo.org'; streaming: true; get. At this point, the request is done, the response is in, but the entity of the response is not yet read. When you ask for the entity, you get a ZnStreamingEntity which holds the stream that you then have to read from. You can check the response (and its header) for meta info. Your next challenge then is to process this stream so that you can parse it in a real streaming fashion. I don't know if Soup can do this. Sven

Nov. 26, 2016

ZnClient GET, but just the content of the <head> tag?

by PAUL DEBRUICKER

This is a micro optimization if there ever was one but I wondered if it was possible to stop downloading and get the entity once the </head> tag has been received. Right now I download the whole page, parse it with Soup, then extract the tags I want from the head. Which works fine. e.g. head:=((Soup fromString: (ZnEasy get: 'http://pharo.org') entity) findChildTag: 'html') findChildTag: 'head'.

Nov. 26, 2016

Re: [Pharo-users] [SmaCC] Partial Installation

by Dimitris Chloupis

The version does not matter, the configuration get the github repo as is . So it always get the latest code. I tested also with metacello command, same problem. On Sat, 26 Nov 2016 at 00:12, Thierry Goubier <thierry.goubier(a)gmail.com> wrote: > Le 25/11/2016 Ã 17:10, Dimitris Chloupis a Ã©crit : > > Are you on Pharo 6 latest image and latest VM ? > > > > Curl get.pharo.org/alpha+vmLatest <http://get.pharo.org/alpha+vmLatest> > > > > Then open package browser and try to install Ephestos > > The configuration browser is still pointing at an older version of > Ephestos (or I should not try to load the stable version?). > > Thierry > > > On Fri, 25 Nov 2016 at 17:15, Thierry Goubier <thierry.goubier(a)gmail.com > > <mailto:thierry.goubier@gmail.com>> wrote: > > > > 2016-11-25 14:34 GMT+01:00 Dimitris Chloupis <kilon.alios(a)gmail.com > > <mailto:kilon.alios@gmail.com>>: > > > > I am afraid it does not work , I updated as you described my > > baseline > > > > > https://github.com/kilon/Ephestos/blob/master/BaselineOfEphestos.package/Ba… > > > > and it gives me > > > > Error: Name not found: SmaCC-Python > > > > > > That's strange. As far as I can see, I use the exact same code in a > > baseline of mine without errors. > > > > I'll try some tests over the week-end. > > > > Thierry > > > > > > > > > > On Fri, Nov 25, 2016 at 2:31 PM Thierry Goubier > > <thierry.goubier(a)gmail.com <mailto:thierry.goubier@gmail.com>> > > wrote: > > > > Hi Kilon, > > > > 2016-11-25 12:13 GMT+01:00 Dimitris Chloupis > > <kilon.alios(a)gmail.com <mailto:kilon.alios@gmail.com>>: > > > > Hey there , I would like to install from SmaCC only > > Python and C++ parsers , any idea how to add that to my > > baseline as a dependency ? > > > > > > Just load the SmaCC-Python package. There is no C++ parser. > > > > Use the following: > > > > spec > > baseline: 'SmaCC' > > with: [ spec repository: > > 'github://ThierryGoubier/SmaCC' ]; > > import: 'SmaCC'. > > spec package: <yourPackage> with: [ spec requires: > > #('SmaCC-Python') ] > > > > Regards, > > > > Thierry > > > > > > > > > > --- > > ÎÏÏÏ ÏÎ¿ e-mail ÎµÎ»ÎÎ³ÏÎ¸Î·ÎºÎµ Î³Î¹Î± Î¹Î¿ÏÏ Î±ÏÏ ÏÎ¿ ÏÏÏÎ³ÏÎ±Î¼Î¼Î± Avast > > antivirus. > > https://www.avast.com/antivirus > > > > > > > > >

Nov. 25, 2016

Re: [Pharo-users] [SmaCC] Partial Installation

by Thierry Goubier

Le 25/11/2016 Ã 17:10, Dimitris Chloupis a Ã©crit : > Are you on Pharo 6 latest image and latest VM ? > > Curl get.pharo.org/alpha+vmLatest <http://get.pharo.org/alpha+vmLatest> > > Then open package browser and try to install Ephestos The configuration browser is still pointing at an older version of Ephestos (or I should not try to load the stable version?). Thierry > On Fri, 25 Nov 2016 at 17:15, Thierry Goubier <thierry.goubier(a)gmail.com > <mailto:thierry.goubier@gmail.com>> wrote: > > 2016-11-25 14:34 GMT+01:00 Dimitris Chloupis <kilon.alios(a)gmail.com > <mailto:kilon.alios@gmail.com>>: > > I am afraid it does not work , I updated as you described my > baseline > > https://github.com/kilon/Ephestos/blob/master/BaselineOfEphestos.package/Ba… > > and it gives me > > Error: Name not found: SmaCC-Python > > > That's strange. As far as I can see, I use the exact same code in a > baseline of mine without errors. > > I'll try some tests over the week-end. > > Thierry > > > > > On Fri, Nov 25, 2016 at 2:31 PM Thierry Goubier > <thierry.goubier(a)gmail.com <mailto:thierry.goubier@gmail.com>> > wrote: > > Hi Kilon, > > 2016-11-25 12:13 GMT+01:00 Dimitris Chloupis > <kilon.alios(a)gmail.com <mailto:kilon.alios@gmail.com>>: > > Hey there , I would like to install from SmaCC only > Python and C++ parsers , any idea how to add that to my > baseline as a dependency ? > > > Just load the SmaCC-Python package. There is no C++ parser. > > Use the following: > > spec > baseline: 'SmaCC' > with: [ spec repository: > 'github://ThierryGoubier/SmaCC' ]; > import: 'SmaCC'. > spec package: <yourPackage> with: [ spec requires: > #('SmaCC-Python') ] > > Regards, > > Thierry > > > > > --- > ÎÏÏÏ ÏÎ¿ e-mail ÎµÎ»ÎÎ³ÏÎ¸Î·ÎºÎµ Î³Î¹Î± Î¹Î¿ÏÏ Î±ÏÏ ÏÎ¿ ÏÏÏÎ³ÏÎ±Î¼Î¼Î± Avast > antivirus. > https://www.avast.com/antivirus > > >

Nov. 25, 2016

Re: [Pharo-users] [ANN] CPPBridge: One Ring to rule them ALL

by Dimitris Chloupis

Great news for windows users , CPP is ported to Windows. Again like linux and macos it has its own class called "CPPBridgeWin" where all Windows methods are located and comes with two examples with reading and writing to the shared memory. In your github-cache of your pharo folder inside the CPP subfolder you will find two subfolders one called simply CPP which shows the Windows Visual C++ version of writing and create the shared memory and a CPPReceive subfolder that contains the Windows Visual C++ version for reading from the shared memory . Both come with their own project files so they can be opened easily inside Visual Studio Community edition which is free to download and use. Both are tested on latest 64 bit Windows 10. One thing I forgot to mention and this applies to the whole CPP project is that C++ is completely optional. That means that shared memory could be shared instead of between a C++ application and Pharo application , instead we can have multiple pharo images executing at the same time sharing the same exact memory. This is useful for those of you who work with very big data and you dont like the idea of it being garbage collected or copied in all your images running at the same time. This way you save memory , you have access to manual memory management with all its pitfalls (yes a wrong pointer will crash your pharo application in an instant) and advantages (it does not get any faster than shared memory with manual memory management, this is the method your OS uses to do pretty much everything data orientated and for loading DLLs). Because CPP supports file mapping that means the data is auto saved into the file , one file for all pharo images running at the same time , this way you can store the live state like you do with a regular pharo image and feel safe that you will never need to worry about forgeting to save the file like you do with pharo images. Essentially that means you can completely bypass C++ and do it all in just pharo code. As always everything is commented and documented . --- ÎÏÏÏ ÏÎ¿ e-mail ÎµÎ»ÎÎ³ÏÎ¸Î·ÎºÎµ Î³Î¹Î± Î¹Î¿ÏÏ Î±ÏÏ ÏÎ¿ ÏÏÏÎ³ÏÎ±Î¼Î¼Î± Avast antivirus. https://www.avast.com/antivirus

Nov. 25, 2016

Re: [Pharo-users] NeoCSVWriter automatic quotes

by Sven Van Caekenberghe

Peter, > On 25 Nov 2016, at 19:35, Peter Uhnak <i.uhnak(a)gmail.com> wrote: > > Hi, > > is it/would it be possible to modify NeoCSVWriter to add quotes only where necessary? So only if the written value contains the separator (is there any other case that would require the quotes?). > > Thanks, > Peter Why exactly do you want this ? CSV is a pretty simple format, having a field quoted in one line and not in another already sounds like being a bit too clever, though it does seem to be allowed. The idea of having different field writers was to choose the most efficient one for your data (types). You can configure a writer per field (column). If you have numbers, raw gives you the fastest performance. Doing optional quoting would always require more than one pass, if not many more, over the string, possibly generating more garbage. (Like in your example implementation). There are 3 reasons to do quoting: embedded separator, embedded newline, embedded quote (you forgot the newline case). All that being said, maybe an #optionalQuoted field writer could be a reasonable configureable option, but I would not make it the default. Again, why do you want this ? Sven

Nov. 25, 2016

Re: [Pharo-users] NeoCSVWriter automatic quotes

by Peter Uhnak

So basically something like this, ``` NeoCSVWriter>>writeMaybeQuotedField: object | string | string := object asString. string := string copyReplaceAll: '"' with: '""'. ((string includes: $") or: [ string includes: separator ]) ifTrue: [ writeStream nextPut: $"; nextPutAll: string; nextPut: $" ] ifFalse: [ writeStream nextPutAll: string ] ``` Peter On Fri, Nov 25, 2016 at 07:35:29PM +0100, Peter Uhnak wrote: > Hi, > > is it/would it be possible to modify NeoCSVWriter to add quotes only where necessary? So only if the written value contains the separator (is there any other case that would require the quotes?). > > Thanks, > Peter

Nov. 25, 2016

NeoCSVWriter automatic quotes

by Peter Uhnak

Hi, is it/would it be possible to modify NeoCSVWriter to add quotes only where necessary? So only if the written value contains the separator (is there any other case that would require the quotes?). Thanks, Peter

Nov. 25, 2016

Re: [Pharo-users] [SmaCC] Partial Installation

by Dimitris Chloupis

Are you on Pharo 6 latest image and latest VM ? Curl get.pharo.org/alpha+vmLatest Then open package browser and try to install Ephestos On Fri, 25 Nov 2016 at 17:15, Thierry Goubier <thierry.goubier(a)gmail.com> wrote: > 2016-11-25 14:34 GMT+01:00 Dimitris Chloupis <kilon.alios(a)gmail.com>: > > I am afraid it does not work , I updated as you described my baseline > > > https://github.com/kilon/Ephestos/blob/master/BaselineOfEphestos.package/Ba… > > and it gives me > > Error: Name not found: SmaCC-Python > > > That's strange. As far as I can see, I use the exact same code in a > baseline of mine without errors. > > I'll try some tests over the week-end. > > Thierry > > > > > On Fri, Nov 25, 2016 at 2:31 PM Thierry Goubier <thierry.goubier(a)gmail.com> > wrote: > > Hi Kilon, > > 2016-11-25 12:13 GMT+01:00 Dimitris Chloupis <kilon.alios(a)gmail.com>: > > Hey there , I would like to install from SmaCC only Python and C++ parsers > , any idea how to add that to my baseline as a dependency ? > > > Just load the SmaCC-Python package. There is no C++ parser. > > Use the following: > > spec > baseline: 'SmaCC' > with: [ spec repository: > 'github://ThierryGoubier/SmaCC' ]; > import: 'SmaCC'. > spec package: <yourPackage> with: [ spec requires: #('SmaCC-Python') ] > > Regards, > > Thierry > > > > > --- > ÎÏÏÏ ÏÎ¿ e-mail ÎµÎ»ÎÎ³ÏÎ¸Î·ÎºÎµ Î³Î¹Î± Î¹Î¿ÏÏ Î±ÏÏ ÏÎ¿ ÏÏÏÎ³ÏÎ±Î¼Î¼Î± Avast antivirus. > https://www.avast.com/antivirus > > > >

Nov. 25, 2016

Re: [Pharo-users] [SmaCC] Partial Installation

by Thierry Goubier

2016-11-25 14:34 GMT+01:00 Dimitris Chloupis <kilon.alios(a)gmail.com>: > I am afraid it does not work , I updated as you described my baseline > > https://github.com/kilon/Ephestos/blob/master/BaselineOfEphestos.package/ > BaselineOfEphestos.class/instance/baseline..st > > and it gives me > > Error: Name not found: SmaCC-Python > That's strange. As far as I can see, I use the exact same code in a baseline of mine without errors. I'll try some tests over the week-end. Thierry > > > On Fri, Nov 25, 2016 at 2:31 PM Thierry Goubier <thierry.goubier(a)gmail.com> > wrote: > >> Hi Kilon, >> >> 2016-11-25 12:13 GMT+01:00 Dimitris Chloupis <kilon.alios(a)gmail.com>: >> >> Hey there , I would like to install from SmaCC only Python and C++ >> parsers , any idea how to add that to my baseline as a dependency ? >> >> >> Just load the SmaCC-Python package. There is no C++ parser. >> >> Use the following: >> >> spec >> baseline: 'SmaCC' >> with: [ spec repository: 'github://ThierryGoubier/SmaCC' >> ]; >> import: 'SmaCC'. >> spec package: <yourPackage> with: [ spec requires: #('SmaCC-Python') ] >> >> Regards, >> >> Thierry >> >> >> >> >> --- >> ÎÏÏÏ ÏÎ¿ e-mail ÎµÎ»ÎÎ³ÏÎ¸Î·ÎºÎµ Î³Î¹Î± Î¹Î¿ÏÏ Î±ÏÏ ÏÎ¿ ÏÏÏÎ³ÏÎ±Î¼Î¼Î± Avast antivirus. >> https://www.avast.com/antivirus >> >> >> >>

Nov. 25, 2016