- Pharo-users - lists.pharo.org

Re: [Pharo-users] Automation of MS Office from Pharo

by tesonep＠gmail.com

Hi!!! This was a great report. I have submitted a fix in the master of Pharo-COM. Basically the problem was to free twice the BSTR in the Variant. It was being free in the access to the value and in the free of the struct. Why it works with other BSTR when they are smaller, I cannot know. I have added another smoke test using Word Can you try the fix? Thanks, both for helping me with the reports, they were great. On Wed, Apr 8, 2020 at 9:37 AM PBKResearch <peter(a)pbkresearch.co.uk> wrote: > > Tomaz, that was my understanding from the VBA piece you cited yesterday. So presumably it must be something in Pharo-Com which imposes the limits we have seen. I am OK at the moment, because all this work is just an exploration of possibilities; I can wait until you and Pablo have sorted it out. But from the results of your tests, a maximum of 16K in 64-bit systems must be a serious limitation, so something in Pharo-Com needs fixing. > > > > For my immediate work, I shall continue exporting the full text using MailItem.SaveAs; my further processing uses files I have exported manually in this way, so itâs not a problem. > > > > Thanks > > > > Peter Kenny > > > > From: Pharo-users <pharo-users-bounces(a)lists.pharo.org> On Behalf Of TomaÅ¾ Turk > Sent: 08 April 2020 07:58 > To: Any question about pharo is welcome <pharo-users(a)lists.pharo.org> > Subject: Re: [Pharo-users] Automation of MS Office from Pharo > > > > Thanks, Stephane, for the acknowledgement. Peter, as I understand, the limits in COM BSTR data type are defined by the header's length prefix (which is 4 bytes) and software implementatios - for instance, string data type in Visual Basic for Applications is described as "a variable-length string can contain up to approximately 2 billion (2^31) characters", which is in line with the BSTR header. I'm not sure if the OS architecture (32 and 64 bit) influences these values. > > > > Best wishes, > > Tomaz > > > > -- Pablo Tesone. tesonep(a)gmail.com

April 8, 2020

Re: [Pharo-users] Automation of MS Office from Pharo

by PBKResearch

Tomaz, that was my understanding from the VBA piece you cited yesterday. So presumably it must be something in Pharo-Com which imposes the limits we have seen. I am OK at the moment, because all this work is just an exploration of possibilities; I can wait until you and Pablo have sorted it out. But from the results of your tests, a maximum of 16K in 64-bit systems must be a serious limitation, so something in Pharo-Com needs fixing. For my immediate work, I shall continue exporting the full text using MailItem.SaveAs; my further processing uses files I have exported manually in this way, so itâs not a problem. Thanks Peter Kenny From: Pharo-users <pharo-users-bounces(a)lists.pharo.org> On Behalf Of TomaÅ¾ Turk Sent: 08 April 2020 07:58 To: Any question about pharo is welcome <pharo-users(a)lists.pharo.org> Subject: Re: [Pharo-users] Automation of MS Office from Pharo Thanks, Stephane, for the acknowledgement. Peter, as I understand, the limits in COM BSTR data type are defined by the header's length prefix (which is 4 bytes) and software implementatios - for instance, string data type in Visual Basic for Applications is described as "a variable-length string can contain up to approximately 2 billion (2^31) characters", which is in line with the BSTR header. I'm not sure if the OS architecture (32 and 64 bit) influences these values. Best wishes, Tomaz

April 8, 2020

Re: [Pharo-users] Can't able to understand the code

by Guillermo Polito

Hi Shawon, where did you get the docs? Have you tried the latest version (january/february this year) http://books.pharo.org/booklet-uffi/ <http://books.pharo.org/booklet-uffi/> ? > El 8 abr 2020, a las 4:44, shawon58 <shawonhoque58(a)gmail.com> escribiÃ³: > > actually i am just exploring UFFI from the pdf "Calling Foreign Functions > with Pharo" there one section is for external objects so i cant understand > that code what i attach as screenshot above. can u able to explain what > actually happen here ?? > > > > -- > Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html >

April 8, 2020

Re: [Pharo-users] Automation of MS Office from Pharo

by TomaÅ¾ Turk

Thanks, Stephane, for the acknowledgement. Peter, as I understand, the limits in COM BSTR data type are defined by the header's length prefix (which is 4 bytes) and software implementatios - for instance, string data type in Visual Basic for Applications is described as "a variable-length string can contain up to approximately 2 billion (2^31) characters", which is in line with the BSTR header. I'm not sure if the OS architecture (32 and 64 bit) influences these values. Best wishes, Tomaz

April 8, 2020

Re: [Pharo-users] Can't able to understand the code

by shawon58

actually i am just exploring UFFI from the pdf "Calling Foreign Functions with Pharo" there one section is for external objects so i cant understand that code what i attach as screenshot above. can u able to explain what actually happen here ?? -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

April 8, 2020

Re: [Pharo-users] Automation of MS Office from Pharo

by PBKResearch

Hi Tomaz Yes, that is exactly the problem I had, and the limit of 260K characters is consistent with my tests. I can get round it by saving the HTML to disk using the MailItem.SaveAs method, and then reading the file back from disk. I would try doing that with a memory disk, but I suspect the SaveAs method will not like writing to it. An alternative would be to use the MailItem.Body property, which only has the text of the message and so is much shorter. I would really need my own parser to read such a file, and I canât load PetitParser or PetitParser2 into Pharo 8. Presumably Pharo-Com should handle a long string more gracefully than just crashing the VM. But if these limits are intrinsic to COM in Windows, rather than Pharo-Com, there may be no way round it so itâs back to SaveAs. Thanks for confirming that itâs not down to an error of mine. Peter Kenny From: Pharo-users <pharo-users-bounces(a)lists.pharo.org> On Behalf Of TomaÅ¾ Turk Sent: 07 April 2020 21:27 To: Any question about pharo is welcome <pharo-users(a)lists.pharo.org> Subject: Re: [Pharo-users] Automation of MS Office from Pharo Thanks, Peter. I checked out the Outlook COM interface, noticed that the MailItem.HTMLBody property returns a string, which is implemented as BSTR in COM (more on this here: https://bytecomb.com/vba-internals-string-variables-and-pointers-in-depth/) I tested the maximum lengths of strings with Word and my images crash under these circumstances: - Pharo 8.0 64 bit when returning ByteString is longer than 16.379 characters - Pharo 8.0 32 bit when returning ByteString is longer than 260.080 characters (approximately). 64 bit image crashes without any warning, however the 32 bit one crashes with I presume this is the same behaviour as you report, Peter. I'm attaching the crash.dmp from 32 bit image. I believe that the crash happens when calling COMDispatchInstance>>propertyNamed: with the lengthy string to be returned. Pablo, I hope you have some time to check this, my knowledge ends somewhere here ... :-| Thanks and best wishes, Tomaz

April 7, 2020

Re: [Pharo-users] Automation of MS Office from Pharo

by TomaÅ¾ Turk

Thanks, Peter. I checked out the Outlook COM interface, noticed that the MailItem.HTMLBody property returns a string, which is implemented as BSTR in COM (more on this here: https://bytecomb.com/vba-internals-string-variables-and-pointers-in-depth/) I tested the maximum lengths of strings with Word and my images crash under these circumstances: - Pharo 8.0 64 bit when returning ByteString is longer than 16.379 characters - Pharo 8.0 32 bit when returning ByteString is longer than 260.080 characters (approximately). 64 bit image crashes without any warning, however the 32 bit one crashes with I presume this is the same behaviour as you report, Peter. I'm attaching the crash.dmp from 32 bit image. I believe that the crash happens when calling COMDispatchInstance>>propertyNamed: with the lengthy string to be returned. Pablo, I hope you have some time to check this, my knowledge ends somewhere here ... :-| Thanks and best wishes, Tomaz

April 7, 2020

Re: [Pharo-users] [Pharo-dev] Cover for PBE8

by Esteban Maringolo

There is also Pixabay: https://pixabay.com/images/search/lighthouse/ Regards! Esteban A. Maringolo On Tue, Apr 7, 2020 at 11:18 AM Torsten Bergmann <astares(a)gmx.de> wrote: > > For free pictures I guess one could use: > > https://unsplash.com/about > https://www.pexels.com > > If you check there for "lighthouse" you will find nice ones like: > - https://www.pexels.com/photo/gray-and-black-rock-formation-1113552/ > - https://images.unsplash.com/photo-1556290287-14de2be0657b?ixlib=rb-1.2.1&ix… > > You can even get the "spiral" effect there: > > https://unsplash.com/s/photos/spiral > https://www.pexels.com/search/spiral/

April 7, 2020

Re: [Pharo-users] Automation of MS Office from Pharo

by PBKResearch

Hello TomaÅ¾ I have been working out how to make your debugging easier. If you have MS Outlook to explore with, I have an extract from my Outlook Data File I can send you, together with a code snippet to run in a playground. With these it should be easy to reproduce the error. HTH Peter Kenny From: Pharo-users <pharo-users-bounces(a)lists.pharo.org> On Behalf Of PBKResearch Sent: 07 April 2020 18:28 To: 'TomaÅ¾ Turk' <tomaz.turk(a)ef.uni-lj.si>; 'Any question about pharo is welcome' <pharo-users(a)lists.pharo.org> Subject: Re: [Pharo-users] Automation of MS Office from Pharo Hello TomaÅ¾ I have been exploring today, to try to narrow down where the problem appears. Itâs difficult to give you some code to reproduce the problem, because you would need to have my Outlook Data File, or an extract of it, plus MS Outlook to run it on. If you want that, I will try to work out how to produce a minimum extract to show the problem. Meanwhile, I can describe what the problem seems to be. All my work has been done in a playground. I can set up a connection to my Outlook Data File and navigate through it to the folder of interest, which contains editions of a newsletter in German. I then inspect one of the items in the folder, which is a COMDispatchInstance and an instance of the object MailItem. My interest is the property HTMLBody of the MailItem, which is as you expect the complete code to display the newsletter. If I inspect the HTMLBody property for most MailItems, it displays with no problem. In some cases, however, as soon as I click âinspect itâ, there is a message saying the VM has crashed, and the system closes with a crash dump. I donât think there is a problem with the fact that I am displaying the property value in an inspector. I tried instead to assign it to a variable in the playground. As soon as I clicked âdo itâ the whole Pharo app closed down, with no message or crash dump. I have tried to find some common factor in the items which will cause the crash, and the one thing I can find is the size of HTMLBody, or equivalently the size of the MailItem. The HTMLBody displays as a WideString in the inspector, and it works fine for an object of about 230K characters. With another message about 10% larger, the VM crash occurred. I have no knowledge of COM interfacing, except what I have picked up in the last two days, but I have been trying to find a general description of a problem which would give the results I have seen. If a COM object has a property which is a BSTRString, and if the string is a WideString with more than about 250K characters, is there some internal buffer overflow? â the crash dump has several mentions of âStack Overflowâ, though I canât really follow it. That is about all I can explain â sorry itâs a bit long-winded. If you want more information, or an extract of my Outlook data file, just let me know. Thanks for your help. Peter Kenny From: Pharo-users <pharo-users-bounces(a)lists.pharo.org <mailto:pharo-users-bounces@lists.pharo.org> > On Behalf Of TomaÅ¾ Turk Sent: 07 April 2020 16:30 To: Any question about pharo is welcome <pharo-users(a)lists.pharo.org <mailto:pharo-users@lists.pharo.org> > Subject: Re: [Pharo-users] Automation of MS Office from Pharo Dear Peter, I'm glad that you find the package useful! Can you please explain a little bit more about your code, because it's not obvious from your description at which stage the problem occurs. Could you trace it with the debugger, and/or possibly post here the piece of code that fails? Thanks and best wishes, Tomaz ------ Original Message ------ From: "PBKResearch" <peter(a)pbkresearch.co.uk <mailto:peter@pbkresearch.co.uk> > To: "Any question about pharo is welcome" <pharo-users(a)lists.pharo.org <mailto:pharo-users@lists.pharo.org> > Sent: 6. 04. 2020 19:15:16 Subject: Re: [Pharo-users] Automation of MS Office from Pharo Hello Pablo (and TomaÅ¾) You asked for feedback; after a day of experiments, I have good news and bad news. The good news is that I have been able to navigate through my Outlook Data File, find my way to an e-mail of interest and examine the fields of interest. This means I am 90% of the way to my objective. All I want is to get the HTML code from the message body and pass it to XMLHTMLParser for further analysis. I found it not too difficult to work this out; the fact that a COMDispatchInstance can display all its internals in a playground page meant that I could work it out interactively as a playground exercise. I am still discovering things about the interface; I have only just found out that I can select an item from a list by quoting its name as an argument, rather than its number in the list. I am sure my clumsy code can be tidied up still. I can get to the 100% point in the job by exporting the contents of the e-mail to disk in HTML format, using the SaveAs procedure of the MailItem object. I can then read it back from disk into the parser. But this seems a bit clunky. The content of an HTML mail item is available in the HTMLBody property of the MailItem, so I should be able to pass it programmatically to the parser without going near the disk. This is where I run into trouble. In most of the cases I tried, this worked fine; I could display the HTML body text as a WideString in the playground, assign it to a variable and do whatever I wanted. However, for just one e-mail I tried, as soon as I selected âDo it and goâ in the playground, a message came up that the VM had crashed; the application closed, leaving only a crash dump. I cannot find anything unusual about the message that failed in this way, except that when I save it, it produces a larger file than any of the others (just over 1MB, against up to 300KB for the ones that worked). Could there be a limit on the size of some internal buffer? I thought it worth while mentioning this now, because crashing the VM is generally undesirable. I can solve my problems safely using the SaveAs route, so itâs not a problem for me. Hope this helps; if you want more details, let me know. Overall I am very happy with this library. Peter Kenny From: Pharo-users <pharo-users-bounces(a)lists.pharo.org <mailto:pharo-users-bounces@lists.pharo.org> > On Behalf Of tesonep(a)gmail.com <mailto:tesonep@gmail.com> Sent: 06 April 2020 11:24 To: Any question about pharo is welcome <pharo-users(a)lists.pharo.org <mailto:pharo-users@lists.pharo.org> > Subject: Re: [Pharo-users] Automation of MS Office from Pharo Hi Peter, First, thanks to try to use Pharo-COM, that is great, I love to have users for it and find it is useful. Secondly, the Pharo 7 problem is an error I have introduced. It is clear that some changes I have done to support the new version of UFFI (the framework in Pharo to handle FFI calls) have broken the Pharo 7 version, so I will fix it to maintain compatibility. It is great that you were able to make it work! Cheers, On Mon, Apr 6, 2020 at 12:18 PM PBKResearch <peter(a)pbkresearch.co.uk <mailto:peter@pbkresearch.co.uk> > wrote: Hello TomaÅ¾ Many thanks for your patient explanation. I should have been able to work out for myself how the Word test works, and indeed I realized some of it when I came to shut down the Word instance and its two documents. But it was late at night, and I should have packed up before then. My last test last night showed that basically I have cracked it for my job of automating Outlook. I have been able to connect to my running instance of Outlook, open my application and interrogate the names of my top-level folders. From now on it should be just a matter of understanding the MS documentation of the Outlook model. However, all this is with Pharo-Com installed in a new Pharo 8 image. I have no idea what went wrong with my first effort on Pharo 7. But I shanât worry about that â I shall gradually move all my bits and pieces to P8. I shall try to work it out myself from here, but I shall come back if I get stuck. Thanks again Peter Kenny From: Pharo-users <pharo-users-bounces(a)lists.pharo.org <mailto:pharo-users-bounces@lists.pharo.org> > On Behalf Of TomaÅ¾ Turk Sent: 06 April 2020 08:04 To: Any question about pharo is welcome <pharo-users(a)lists.pharo.org <mailto:pharo-users@lists.pharo.org> > Subject: Re: [Pharo-users] Automation of MS Office from Pharo Hello Peter, If you look at the code in the Word test you will notice that the test firstly - creates a new Word instance, - makes it visible to the end user, - then adds an empty document to the documents collection with the text "Hello from Pharo!" - then it tests whether it can receive the same text back from Word. After that, the test - adds a new empty document to the documents collection with the text "Hello from Pharo! Some additional text. ", this time as an array of two texts - it activates this second document (this imitates the end user's window activation on the desktop) - then it tests whether it can receive the same text back from Word. If you look at the Task Manager, you'll notice that you have one Word process with two open documents: Namely, for each document Word creates a new, separate window - the documents are not displayed in one "Word application window", but separately - that's a normal behavior for some versions of MS Office, and it happens also if you open several documents directly in Word. So, there is just one Word instance. 'finalize' clears the references to the Word instance, it doesn't close the program by itself. If you want to do that, you can send Quit message to Word before you destroy the reference (https://docs.microsoft.com/en-us/office/vba/api/word.application.quit(metho…) Similar behaviour is with Outlook, here's one example: https://www.excelcommand.com/excel-help/excel-how-to.php?i=124116 The calling among COM objects is asynchronous, and it's usually wise to wrap it in error handling structures. Please tell us how it goes. Best wishes, Tomaz ------ Original Message ------ From: "PBKResearch" <peter(a)pbkresearch.co.uk <mailto:peter@pbkresearch.co.uk> > To: "Any question about pharo is welcome" <pharo-users(a)lists.pharo.org <mailto:pharo-users@lists.pharo.org> > Sent: 5.4.2020 23:18:02 Subject: Re: [Pharo-users] Automation of MS Office from Pharo Pablo - a final update before I close for the night. The Word test on the pharo 8 version comes up green. The strange error message is nowhere to be seen in any Pharo 8 runs. The result is not what I expected; I finish up with two Word documents open, one with the first message, the other with the two messages. I thought the 'finalize' command would close it down. Anyway, it looks as if I need to switch to P8 to use Pharo-Com. I shall continue testing tomorrow on P8. Sorry for the late-night hassle. Peter -- Pablo Tesone. tesonep(a)gmail.com <mailto:tesonep@gmail.com>

April 7, 2020

Re: [Pharo-users] Hi-DPI Support

by tbrunz

By the way, I moved the location of my script into a new repository: https://github.com/tbrunz/pharo-support -t -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

April 7, 2020