November 2019 - Pharo-users

Re: [Pharo-users] [ANN] XMLParserHTML moved to GitHub

by PBKResearch

Sean I used Soup a few times, but found it difficult to interpret the output, because the parse did not seem to reflect the hierarchy of the nodes in the original; in particular, sibling nodes were not necessarily at the same level in the Soup. XMLHTMLParser always gets the structure right, in my experience. I think this is essential if you want to use Xpath to process the parse. The worked examples in the scraping booklet show how the parser and Xpath can work together. HTH Peter Kenny -----Original Message----- From: Pharo-users <pharo-users-bounces(a)lists.pharo.org> On Behalf Of Sean P. DeNigris Sent: 30 November 2019 16:43 To: pharo-users(a)lists.pharo.org Subject: Re: [Pharo-users] [ANN] XMLParserHTML moved to GitHub cedreek wrote > To me, far better than using Soup. Ah, interesting! I use Soup almost exclusively. What did you find superior about XMLParserHTML? I may give it a try... cedreek wrote > Google chrome pharo integration helps top to scrap complex full JS web > site like google ;) Also interesting! Any publicly available examples? How does one load "Google chrome pharo integration"? Also, there is often the "poor man's" way (albeit requiring manual intervention) by inspecting the Ajax http requests in a developer console and then recreating directly in Pharo. ----- Cheers, Sean -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

Nov. 30, 2019

Re: [Pharo-users] [ANN] XMLParserHTML moved to GitHub

by CÃ©drick BÃ©ler

I couldnât get it from Zn as (I think) there are some js lib that defer the full rendering. I have the same problem with a site in France (leboncoin). They use https://datadome.co <https://datadome.co/> to complicate webscrapping. So an headless browser is the only solution I know. Cheers, CÃ©drick > Le 1 dÃ©c. 2019 Ã 00:23, Esteban Maringolo <emaringolo(a)gmail.com> a Ã©crit : > > Why use Chrome instead of ZnClient? To get a "real" render of the > content? (including JS and whatnot). > > Regards! > > > Esteban A. Maringolo > > On Sat, Nov 30, 2019 at 8:11 PM CÃ©drick BÃ©ler <cdrick65(a)gmail.com> wrote: >> >> >>> >>> Also interesting! Any publicly available examples? How does one load "Google >>> chrome pharo integration Â»? >> >> "https://github.com/astares/Pharo-Chrome" >> "https://github.com/akgrant43/Pharo-Chrome Â» >> >> Cheers, >> >> CÃ©drick >> >> >

Nov. 30, 2019

Re: [Pharo-users] [ANN] XMLParserHTML moved to GitHub

by Esteban Maringolo

Why use Chrome instead of ZnClient? To get a "real" render of the content? (including JS and whatnot). Regards! Esteban A. Maringolo On Sat, Nov 30, 2019 at 8:11 PM CÃ©drick BÃ©ler <cdrick65(a)gmail.com> wrote: > > > > > > Also interesting! Any publicly available examples? How does one load "Google > > chrome pharo integration Â»? > > "https://github.com/astares/Pharo-Chrome" > "https://github.com/akgrant43/Pharo-Chrome Â» > > Cheers, > > CÃ©drick > >

Nov. 30, 2019

Re: [Pharo-users] [ANN] XMLParserHTML moved to GitHub

by CÃ©drick BÃ©ler

> > Also interesting! Any publicly available examples? How does one load "Google > chrome pharo integration Â»? "https://github.com/astares/Pharo-Chrome" "https://github.com/akgrant43/Pharo-Chrome Â» Cheers, CÃ©drick

Nov. 30, 2019

Re: [Pharo-users] [ANN] XMLParserHTML moved to GitHub

by CÃ©drick BÃ©ler

Just a quick try to scrap a query from google search (using Chrome plugin + XMLHTMLParser + Path) : Really coolâ¦ and in few lines you get your own Â« google Â» powered search engine ;-). Nevertheless this is a bit slow (5 seconds for one page, around 20s for the 5 from the script (I think this might be doable to speed things a bit). HTH, CÃ©drick PS: code below in text searches := OrderedCollection new. query := 'black friday' urlEncoded. "chrome plugin" browser := GoogleChrome new. browser headless: true. browser open. page := browser firstTab. 0 to: 50 by: 10 do: [:paging | page get: 'https://www.google.com/search?q=',query,'&start=', paging asString. result := page html. dom := result parseHTML. "uses XMLHTMLParser" searches addAll: (dom xpath: '//div[@class="g"]/div/div/div/a/@href'). ]. searches size "64". searches first. "href=""https://www.fnac.com/black-friday""" "xpath cheat sheet: https://gist.github.com/LeCoupa/8c305ec8c713aad07b14"

Nov. 30, 2019

Re: [Pharo-users] [ANN] XMLParserHTML moved to GitHub

by CÃ©drick BÃ©ler

> ï»¿cedreek wrote >> To me, far better than using Soup. > > Ah, interesting! I use Soup almost exclusively. What did you find superior > about XMLParserHTML? I may give it a try... > Itâs mainly xpath which I find easier than navigating the html tree with soup or even The xmlHtmlparser. I usually copy the xpath form a web inspector. I have to tweak it a bit though. > > cedreek wrote >> Google chrome pharo integration helps top to scrap complex full JS web >> site like google ;) > > Also interesting! Any publicly available examples? How does one load "Google > chrome pharo integration"? Also, there is often the "poor man's" way (albeit > requiring manual intervention) by inspecting the Ajax http requests in a > developer console and then recreating directly in Pharo. > I just tried it once. There is a google chrome plugin that allows to use chrome headless to get the fully loaded html page. I need to try it again. A simple example Iâd like to do is to scrap google and remove advertised content ^^ This is btw Torsten package: https://github.com/astares/Pharo-Chrome Happy scrapping ;-) And thx Torsten for all ^^ Cedrick > > > ----- > Cheers, > Sean > -- > Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html >

Nov. 30, 2019

Re: [Pharo-users] [ANN] XMLParserHTML moved to GitHub

by Sean P. DeNigris

cedreek wrote > To me, far better than using Soup. Ah, interesting! I use Soup almost exclusively. What did you find superior about XMLParserHTML? I may give it a try... cedreek wrote > Google chrome pharo integration helps top to scrap complex full JS web > site like google ;) Also interesting! Any publicly available examples? How does one load "Google chrome pharo integration"? Also, there is often the "poor man's" way (albeit requiring manual intervention) by inspecting the Ajax http requests in a developer console and then recreating directly in Pharo. ----- Cheers, Sean -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

Nov. 30, 2019

Re: [Pharo-users] [ANN] XMLParserHTML moved to GitHub

by Esteban Maringolo

Great! I just added a link to the README.md of the project and created a PR, because it is very likely that if you're parsing HTML you're doing some scrapping. :-) Esteban A. Maringolo On Fri, Nov 29, 2019 at 2:18 PM CÃ©drick BÃ©ler <cdrick65(a)gmail.com> wrote: > > Stef and other wrote this book a while ago: > > http://books.pharo.org/booklet-Scraping/html/scrapingbook.html > > Basically XMLHtmlParser + XPath > > To me, far better than using Soup. > Google chrome pharo integration helps top to scrap complex full JS web site like google ;)

Nov. 29, 2019

Re: [Pharo-users] [ANN] XMLParserHTML moved to GitHub

by CÃ©drick BÃ©ler

Stef and other wrote this book a while ago: http://books.pharo.org/booklet-Scraping/html/scrapingbook.html Basically XMLHtmlParser + XPath To me, far better than using Soup. Google chrome pharo integration helps top to scrap complex full JS web site like google ;) Cheers, Cedrick > Le 29 nov. 2019 Ã 15:41, Esteban Maringolo <emaringolo(a)gmail.com> a Ã©crit : > > ï»¿Thank you Torsten, > > I wasn't aware of this tool, I'm already using it to scrap content > from a website and fed a Pharo driven system :) > > The XML integration in the Inspector is great too. > > Regards! > > Esteban A. Maringolo > >> On Tue, Nov 19, 2019 at 8:40 AM Torsten Bergmann <astares(a)gmx.de> wrote: >> >> Hi, >> >> the STHub -> PharoExtras project "XMLParserHTML" >> >> was now moved from http://smalltalkhub.com/#!/~PharoExtras/XMLParserHTML to >> https://github.com/pharo-contributions/XML-XMLParserHTML including the FULL HISTORY >> >> The old STHub repo was marked as obsolete - but is linking to the new one. I've also >> setup an CI job: https://travis-ci.org/pharo-contributions/XML-XMLParserHTML >> which is green for Pharo 7. Some cleanups, class comments and docu was applied as you can >> see from commit history. >> >> The new version is tagged in git as version 1.6.0 (with a moveable tag 1.6.x in case further >> hotfixes are required). >> >> You can load using >> >> Metacello new >> baseline: 'XMLParserHTML'; >> repository: 'github://pharo-contributions/XML-XMLParserHTML/src'; >> load. >> >> or from catalog in Pharo 7 or 8. >> >> Attached is current dependency graph. >> >> More to come soon ... >> >> Bye >> T. >

Nov. 29, 2019

Re: [Pharo-users] [ANN] XMLParserHTML moved to GitHub

by Esteban Maringolo

Thank you Torsten, I wasn't aware of this tool, I'm already using it to scrap content from a website and fed a Pharo driven system :) The XML integration in the Inspector is great too. Regards! Esteban A. Maringolo On Tue, Nov 19, 2019 at 8:40 AM Torsten Bergmann <astares(a)gmx.de> wrote: > > Hi, > > the STHub -> PharoExtras project "XMLParserHTML" > > was now moved from http://smalltalkhub.com/#!/~PharoExtras/XMLParserHTML to > https://github.com/pharo-contributions/XML-XMLParserHTML including the FULL HISTORY > > The old STHub repo was marked as obsolete - but is linking to the new one. I've also > setup an CI job: https://travis-ci.org/pharo-contributions/XML-XMLParserHTML > which is green for Pharo 7. Some cleanups, class comments and docu was applied as you can > see from commit history. > > The new version is tagged in git as version 1.6.0 (with a moveable tag 1.6.x in case further > hotfixes are required). > > You can load using > > Metacello new > baseline: 'XMLParserHTML'; > repository: 'github://pharo-contributions/XML-XMLParserHTML/src'; > load. > > or from catalog in Pharo 7 or 8. > > Attached is current dependency graph. > > More to come soon ... > > Bye > T.

Nov. 29, 2019

[ANN] Next Pharo Sprint: Nov 29

by Marcus Denker

We will organize a Pharo sprint / Moose dojo Nov 29, starting at 10:00am. (Local Time Paris). Goals of this sprint: - Pharo 8: Fix issues from tracker https://github.com/pharo-project/pharo/issues <https://github.com/pharo-project/pharo/issues> Remote Sprint: Remotely, you can join us on Discord. During the sprint, we synchronize local and remote Pharo sprinters: http://pharo.org/contribute-events <http://pharo.org/contribute-events> We have added a Board to coordinate the work: https://github.com/orgs/pharo-project/projects/9 <https://github.com/orgs/pharo-project/projects/9> Known Local Sprint meetings - Lille/France: It will be at the Inria Lille, Building B, third floor (RMoD offices). As the building is not open to the public, please contact us before if you plan to come A list of all Pharo Event of the year an be found here: https://association.pharo.org/events <https://association.pharo.org/events>

Nov. 25, 2019

Re: [Pharo-users] open spec window to handle exception and pause execution

by Paul DeBruicker

Thanks Richard. That helped me figure it out. I ended up doing: [ [self testCondition] whileTrue:[ self doSomeStuff] ] on: MyNotification do:[:ex | |presenter | presenter:=MyPresenter forException: ex . presenter openWithSpec. Smalltalk ui theme runModal: presenter window] Which does what I want Richard Sargent wrote > Paul, I'm going by memory and not Pharo specific. > > I believe the default handling of the end of the exception block is > implicitly equivalent to ex return: nil. > > So, to get further handling of the exception, you need to #pass it or > otherwise resignal it. Then the development environment will catch and > handle the unhandled exception. > > > On Wed, Nov 20, 2019, 20:53 PAUL DEBRUICKER < > pdebruic@ > > wrote: > >> Hi - >> >> I have a subclass of ComposablePresenter (lets call it MyPresenter) that >> seems to work how I want. When doing some processing I'd like to open >> MyPresenter when an exception occurs and pass it the exception e.g. >> >> >> [ [self testCondition] whileTrue:[ self doSomeStuff] ] >> on: MyNotification >> do:[:ex | self openMyPresenterWith: ex] >> >> But that just results in lots of MyPresenter windows opening while the >> execution of the #whileTrue: loop runs its course. >> >> >> How do I pause the loop so I can use the MyPresenter window to modify and >> fix the condition that raised the MyNotification? >> >> The MyPresenter window just edits the contents of a couple Dictionaries >> so >> isn't too tricky but it isn't really as easy to do in a debugger as it is >> clicking a radio button and a "do it" button. >> >> >> Thanks >> -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

Nov. 23, 2019

Re: [Pharo-users] Glorp + P3 + SQLite

by Pavel Krivanek

Hi Todd, we want to do some more testing before merging it into the upstream repository. -- Pavel Ät 21. 11. 2019 v 14:34 odesÃlatel Todd Blanchard via Pharo-users < pharo-users(a)lists.pharo.org> napsal: > Hi Pavel, > > I've just gotten around to figuring out BaslineOf and packages. I see > this work is in a branch on your own repository. > > Do you plan to do a pull request back to the original repository? I feel > like we have database code all over the place and no clear "official" > versions. > > Stll trying to figure out what is current and what is obsolete (Garage?) > > On Oct 19, 2019, at 5:18 AM, Pavel Krivanek <pavel.krivanek(a)gmail.com> > wrote: > > Btw. there exists an updated version of Glorp: > github://pavel-krivanek/glorp:8.3.1-23-baseline > But the compatibility of it with SQLite was never tested > > -- Pavel > > so 19. 10. 2019 v 10:27 odesÃlatel Todd Blanchard via Pharo-users < > pharo-users(a)lists.pharo.org> napsal: > >> I loaded GLORP+P3 without issue. >> >> Trying to load SQLite3 - it also wants to load GLORP which complains of >> conflict. >> >> For P3 I used: >> >> Metacello new >> baseline: 'P3'; >> repository: 'github://svenvc/P3'; >> load: 'glorp'. >> >> >> >> For SQLite: >> >> Metacello new >> repository: 'github://PierceNg/glorp-sqlite3:pharo7'; >> baseline: 'GlorpSQLite'; >> load. >> >> >> but this fails with a conflict. I suspect the conflict is it wants to >> load in glorp again. >> >> I would also like to have mysql driver at some point. >> >> Any tips for getting these to play nice together would be great. >> > >

Nov. 21, 2019

Re: [Pharo-users] Glorp + P3 + SQLite

by Todd Blanchard

Hi Pavel, I've just gotten around to figuring out BaslineOf and packages. I see this work is in a branch on your own repository. Do you plan to do a pull request back to the original repository? I feel like we have database code all over the place and no clear "official" versions. Stll trying to figure out what is current and what is obsolete (Garage?) > On Oct 19, 2019, at 5:18 AM, Pavel Krivanek <pavel.krivanek(a)gmail.com> wrote: > > Btw. there exists an updated version of Glorp: > github://pavel-krivanek/glorp:8.3.1-23-baseline > But the compatibility of it with SQLite was never tested > > -- Pavel > > so 19. 10. 2019 v 10:27 odesÃlatel Todd Blanchard via Pharo-users <pharo-users(a)lists.pharo.org <mailto:pharo-users@lists.pharo.org>> napsal: > I loaded GLORP+P3 without issue. > > Trying to load SQLite3 - it also wants to load GLORP which complains of conflict. > > For P3 I used: > > Metacello new > baseline: 'P3'; > repository: 'github://svenvc/P3 <>'; > load: 'glorp'. > > > For SQLite: > > Metacello new > repository: 'github://PierceNg/glorp-sqlite3:pharo7 <>'; > baseline: 'GlorpSQLite'; > load. > > but this fails with a conflict. I suspect the conflict is it wants to load in glorp again. > > I would also like to have mysql driver at some point. > > Any tips for getting these to play nice together would be great.

Nov. 21, 2019

Re: [Pharo-users] open spec window to handle exception and pause execution

by Richard Sargent

Paul, I'm going by memory and not Pharo specific. I believe the default handling of the end of the exception block is implicitly equivalent to ex return: nil. So, to get further handling of the exception, you need to #pass it or otherwise resignal it. Then the development environment will catch and handle the unhandled exception. On Wed, Nov 20, 2019, 20:53 PAUL DEBRUICKER <pdebruic(a)gmail.com> wrote: > Hi - > > I have a subclass of ComposablePresenter (lets call it MyPresenter) that > seems to work how I want. When doing some processing I'd like to open > MyPresenter when an exception occurs and pass it the exception e.g. > > > [ [self testCondition] whileTrue:[ self doSomeStuff] ] > on: MyNotification > do:[:ex | self openMyPresenterWith: ex] > > But that just results in lots of MyPresenter windows opening while the > execution of the #whileTrue: loop runs its course. > > > How do I pause the loop so I can use the MyPresenter window to modify and > fix the condition that raised the MyNotification? > > The MyPresenter window just edits the contents of a couple Dictionaries so > isn't too tricky but it isn't really as easy to do in a debugger as it is > clicking a radio button and a "do it" button. > > > Thanks >

Nov. 21, 2019

open spec window to handle exception and pause execution

by PAUL DEBRUICKER

Hi - I have a subclass of ComposablePresenter (lets call it MyPresenter) that seems to work how I want. When doing some processing I'd like to open MyPresenter when an exception occurs and pass it the exception e.g. [ [self testCondition] whileTrue:[ self doSomeStuff] ] on: MyNotification do:[:ex | self openMyPresenterWith: ex] But that just results in lots of MyPresenter windows opening while the execution of the #whileTrue: loop runs its course. How do I pause the loop so I can use the MyPresenter window to modify and fix the condition that raised the MyNotification? The MyPresenter window just edits the contents of a couple Dictionaries so isn't too tricky but it isn't really as easy to do in a debugger as it is clicking a radio button and a "do it" button. Thanks

Nov. 21, 2019

Pharo Techtalk Nov 21

by Marcus Denker

Hi, Next techtalk will be *this* week (Nov 21): Topic: Discussion around Contributing to Pharo8 The idea is to discuss on Discord and may do some examples liveâ¦ Calendar entry: https://association.pharo.org/event-3419546 (sorry for the late announceâ¦ )

Nov. 19, 2019

Re: [Pharo-users] [ANN] XMLParser moved to GitHub

by Sven Van Caekenberghe

> On 19 Nov 2019, at 15:15, Torsten Bergmann <astares(a)gmx.de> wrote: > > Nonetheless do not thank me - we should thank all the contributors who have added code > over the past years. Especially monty who did a lot of implementation work - the XML support stuff is > really well written code which is covered by over 6800 unit tests. Yes indeed, it is a great package tackling a complex subject.

Nov. 19, 2019

Re: [Pharo-users] [ANN] XMLParser moved to GitHub

by Torsten Bergmann

Hi Sven, yes - took a while. And thanks for helping / giving me the right advice on Discord to fiddle with the encoding issues I found in some old mcz files. For now I focused on Pharo loading only - leaving aside the #gemstone part as I do not have an installation here. So I defer the work for checking the "gemstone compatibility" packages to people who actually need this. Should not be too hard as they are also included in the GH project as well - but might require adopting the baslines and further loading tests. Nonetheless do not thank me - we should thank all the contributors who have added code over the past years. Especially monty who did a lot of implementation work - the XML support stuff is really well written code which is covered by over 6800 unit tests. I hope that GitHub allows us to manage it even better in the future. At least we are not bound to STHub anymore. Step by step it goes ... BTW: There is now also a channel #xml on Discord so people can discuss related issues and "pharo-contributors" can align on moving on with the packages. Thanks T. > Gesendet: Dienstag, 19. November 2019 um 12:53 Uhr > Von: "Sven Van Caekenberghe" <sven(a)stfx.eu> > An: "Any question about pharo is welcome" <pharo-users(a)lists.pharo.org> > Betreff: Re: [Pharo-users] [ANN] XMLParser moved to GitHub > > Great! > > Thank you for this effort, it was probably much harder than it looks. >

Nov. 19, 2019

Re: [Pharo-users] [ANN] XMLParser moved to GitHub

by Cyril Ferlicot

On Tue, Nov 19, 2019 at 12:33 PM Torsten Bergmann <astares(a)gmx.de> wrote: > > Hi, > > the STHub -> PharoExtras project "XMLParser" > > was now moved from http://smalltalkhub.com/#!/~PharoExtras/XMLParser to > https://github.com/pharo-contributions/XML-XMLParser including the FULL HISTORY > > The old STHub repo was marked as obsolete - but is linking to the new one. I've also > setup an CI job: https://travis-ci.org/pharo-contributions/XML-XMLParser > which is green for Pharo 7. Some cleanups, class comments and docu was applied as you can > see from commit history. > > The new version is tagged in git as version 3.5.0 (with a moveable tag 3.5.x in case further > hotfixes are required). > > If you want to load use > > Metacello new > baseline: 'XMLParser'; > repository: 'github://pharo-contributions/XML-XMLParser/src'; > load. > > or try to load from catalog in Pharo 7 and 8. > > For referencing in own baselines I would suggest to use the 3.5.x tag line: > > ---------------------------------------------------------------------------------------------------- > xmlParserOn: spec > spec > baseline: 'XMLParser' > with: [ > spec > loads: #('Core'); > repository: 'github://pharo-contributions/XML-XMLParser:3.5.x/src' ]. > spec > project: 'XMLParser Tests' copyFrom: 'XMLParser' with: [ spec loads: #('Tests') ]; > project: 'XMLParser Tools' copyFrom: 'XMLParser' with: [ spec loads: #('Tools') ] > ---------------------------------------------------------------------------------------------------- > > Currently there is a dependency on OrderPreservingDictionary project which will be thrown out in > a later iteration (see attached graph and [1] for more details). > > More to come soon ... > > Have fun > T. > > [1] https://lists.pharo.org/pipermail/pharo-users_lists.pharo.org/2019-November… Thank you very much for this effort! I'll migrate my projects depending on it this week probably! -- Cyril Ferlicot https://ferlicot.fr

Nov. 19, 2019

Re: [Pharo-users] [ANN] XMLParser moved to GitHub

by Esteban Maringolo

+1 Thanks for the effort. Not only migrated the code, but also polished it, documented, and setup a CI for it. Regards! Esteban A. Maringolo On Tue, Nov 19, 2019 at 8:53 AM Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > > Great! > > Thank you for this effort, it was probably much harder than it looks. > > > On 19 Nov 2019, at 12:32, Torsten Bergmann <astares(a)gmx.de> wrote: > > > > Hi, > > > > the STHub -> PharoExtras project "XMLParser" > > > > was now moved from http://smalltalkhub.com/#!/~PharoExtras/XMLParser to > > https://github.com/pharo-contributions/XML-XMLParser including the FULL HISTORY > > > > The old STHub repo was marked as obsolete - but is linking to the new one. I've also > > setup an CI job: https://travis-ci.org/pharo-contributions/XML-XMLParser > > which is green for Pharo 7. Some cleanups, class comments and docu was applied as you can > > see from commit history. > > > > The new version is tagged in git as version 3.5.0 (with a moveable tag 3.5.x in case further > > hotfixes are required). > > > > If you want to load use > > > > Metacello new > > baseline: 'XMLParser'; > > repository: 'github://pharo-contributions/XML-XMLParser/src'; > > load. > > > > or try to load from catalog in Pharo 7 and 8. > > > > For referencing in own baselines I would suggest to use the 3.5.x tag line: > > > > ---------------------------------------------------------------------------------------------------- > > xmlParserOn: spec > > spec > > baseline: 'XMLParser' > > with: [ > > spec > > loads: #('Core'); > > repository: 'github://pharo-contributions/XML-XMLParser:3.5.x/src' ]. > > spec > > project: 'XMLParser Tests' copyFrom: 'XMLParser' with: [ spec loads: #('Tests') ]; > > project: 'XMLParser Tools' copyFrom: 'XMLParser' with: [ spec loads: #('Tools') ] > > ---------------------------------------------------------------------------------------------------- > > > > Currently there is a dependency on OrderPreservingDictionary project which will be thrown out in > > a later iteration (see attached graph and [1] for more details). > > > > More to come soon ... > > > > Have fun > > T. > > > > [1] https://lists.pharo.org/pipermail/pharo-users_lists.pharo.org/2019-November… > > <xmlparser.png> > >

Nov. 19, 2019

[ANN] Pastell moved to GitHub

by Torsten Bergmann

Hi, the STHub -> PharoExtras project "Pastell" (XPath-like DSL that makes navigation in XML DOM trees easier) was now moved from http://smalltalkhub.com/#!/~PharoExtras/Pastell to https://github.com/pharo-contributions/XML-Pastell including the FULL HISTORY The old STHub repo was marked as obsolete - but is linking to the new one. I've also setup an CI job: https://travis-ci.org/pharo-contributions/XML-Pastell which is green for Pharo 7. Some cleanups, class comments and docu was applied as you can see from commit history. The new version is tagged in git as version 1.6.0 (with a moveable tag 1.6.x in case further hotfixes are required). You can load using Metacello new baseline: 'Pastell'; repository: 'github://pharo-contributions/XML-Pastell/src'; load. or from catalog in Pharo 7 or 8. Attached is current dependency graph. SIDE NOTE: ========== If you want to load Pastell and XPath [1] into the same image you will see in Iceberg they have colliding methods. Currently one can not share them since either XPath or Pastell tests are green depending on which one are used. This already was the case in the STHub project versions. I would suggest to only use Pastell or XPath until this could possibly be sorted out in the future. Bye T. [1] https://lists.pharo.org/pipermail/pharo-users_lists.pharo.org/2019-November…

Nov. 19, 2019

Re: [Pharo-users] [ANN] XMLParser moved to GitHub

by Sven Van Caekenberghe

Great! Thank you for this effort, it was probably much harder than it looks. > On 19 Nov 2019, at 12:32, Torsten Bergmann <astares(a)gmx.de> wrote: > > Hi, > > the STHub -> PharoExtras project "XMLParser" > > was now moved from http://smalltalkhub.com/#!/~PharoExtras/XMLParser to > https://github.com/pharo-contributions/XML-XMLParser including the FULL HISTORY > > The old STHub repo was marked as obsolete - but is linking to the new one. I've also > setup an CI job: https://travis-ci.org/pharo-contributions/XML-XMLParser > which is green for Pharo 7. Some cleanups, class comments and docu was applied as you can > see from commit history. > > The new version is tagged in git as version 3.5.0 (with a moveable tag 3.5.x in case further > hotfixes are required). > > If you want to load use > > Metacello new > baseline: 'XMLParser'; > repository: 'github://pharo-contributions/XML-XMLParser/src'; > load. > > or try to load from catalog in Pharo 7 and 8. > > For referencing in own baselines I would suggest to use the 3.5.x tag line: > > ---------------------------------------------------------------------------------------------------- > xmlParserOn: spec > spec > baseline: 'XMLParser' > with: [ > spec > loads: #('Core'); > repository: 'github://pharo-contributions/XML-XMLParser:3.5.x/src' ]. > spec > project: 'XMLParser Tests' copyFrom: 'XMLParser' with: [ spec loads: #('Tests') ]; > project: 'XMLParser Tools' copyFrom: 'XMLParser' with: [ spec loads: #('Tools') ] > ---------------------------------------------------------------------------------------------------- > > Currently there is a dependency on OrderPreservingDictionary project which will be thrown out in > a later iteration (see attached graph and [1] for more details). > > More to come soon ... > > Have fun > T. > > [1] https://lists.pharo.org/pipermail/pharo-users_lists.pharo.org/2019-November… > <xmlparser.png>

Nov. 19, 2019

[ANN] XPath moved to GitHub

by Torsten Bergmann

Hi, the STHub -> PharoExtras project "XPath" was now moved from http://smalltalkhub.com/#!/~PharoExtras/XPath to https://github.com/pharo-contributions/XML-XPath including the FULL HISTORY The old STHub repo was marked as obsolete - but is linking to the new one. I've also setup an CI job: https://travis-ci.org/pharo-contributions/XML-XPath which is green for Pharo 7. Some cleanups, class comments and docu was applied as you can see from commit history. The new version is tagged in git as version 2.2.0 (with a moveable tag 2.2.x in case further hotfixes are required). You can load using Metacello new baseline: 'XPath'; repository: 'github://pharo-contributions/XML-XPath/src'; load. or from catalog in Pharo 7 or 8. Attached is current dependency graph. More to come soon ... Bye T.

Nov. 19, 2019

XMLParserStAX moved to GitHub

by Torsten Bergmann

Hi, the STHub -> PharoExtras project "XMLParserStAX" was now moved from http://smalltalkhub.com/#!/~PharoExtras/XMLParserStAX to https://github.com/pharo-contributions/XML-XMLParserStAX including the FULL HISTORY The old STHub repo was marked as obsolete - but is linking to the new one. I've also setup an CI job: https://travis-ci.org/pharo-contributions/XML-XMLParserStAX which is green for Pharo 7. Some cleanups, class comments and docu was applied as you can see from commit history. The new version is tagged in git as version 1.4.0 (with a moveable tag 1.4.x in case further hotfixes are required). You can load using Metacello new baseline: 'XMLParserStAX'; repository: 'github://pharo-contributions/XML-XMLParserStAX/src'; load. or from catalog in Pharo 7 or 8. Attached is current dependency graph. More to come soon ... Bye T.

Nov. 19, 2019

[ANN] XMLParserHTML moved to GitHub

by Torsten Bergmann

Hi, the STHub -> PharoExtras project "XMLParserHTML" was now moved from http://smalltalkhub.com/#!/~PharoExtras/XMLParserHTML to https://github.com/pharo-contributions/XML-XMLParserHTML including the FULL HISTORY The old STHub repo was marked as obsolete - but is linking to the new one. I've also setup an CI job: https://travis-ci.org/pharo-contributions/XML-XMLParserHTML which is green for Pharo 7. Some cleanups, class comments and docu was applied as you can see from commit history. The new version is tagged in git as version 1.6.0 (with a moveable tag 1.6.x in case further hotfixes are required). You can load using Metacello new baseline: 'XMLParserHTML'; repository: 'github://pharo-contributions/XML-XMLParserHTML/src'; load. or from catalog in Pharo 7 or 8. Attached is current dependency graph. More to come soon ... Bye T.

Nov. 19, 2019

[ANN] XMLParser moved to GitHub

by Torsten Bergmann

Hi, the STHub -> PharoExtras project "XMLParser" was now moved from http://smalltalkhub.com/#!/~PharoExtras/XMLParser to https://github.com/pharo-contributions/XML-XMLParser including the FULL HISTORY The old STHub repo was marked as obsolete - but is linking to the new one. I've also setup an CI job: https://travis-ci.org/pharo-contributions/XML-XMLParser which is green for Pharo 7. Some cleanups, class comments and docu was applied as you can see from commit history. The new version is tagged in git as version 3.5.0 (with a moveable tag 3.5.x in case further hotfixes are required). If you want to load use Metacello new baseline: 'XMLParser'; repository: 'github://pharo-contributions/XML-XMLParser/src'; load. or try to load from catalog in Pharo 7 and 8. For referencing in own baselines I would suggest to use the 3.5.x tag line: ---------------------------------------------------------------------------------------------------- xmlParserOn: spec spec baseline: 'XMLParser' with: [ spec loads: #('Core'); repository: 'github://pharo-contributions/XML-XMLParser:3.5.x/src' ]. spec project: 'XMLParser Tests' copyFrom: 'XMLParser' with: [ spec loads: #('Tests') ]; project: 'XMLParser Tools' copyFrom: 'XMLParser' with: [ spec loads: #('Tools') ] ---------------------------------------------------------------------------------------------------- Currently there is a dependency on OrderPreservingDictionary project which will be thrown out in a later iteration (see attached graph and [1] for more details). More to come soon ... Have fun T. [1] https://lists.pharo.org/pipermail/pharo-users_lists.pharo.org/2019-November…

Nov. 19, 2019

[ANN] OrderPreservingDictionary version 1.5.0

by Torsten Bergmann

After - BitmapCharacterSet [1] - XMLWriter [2] were moved to "pharo-contributions" GitHub I also did a pass on OrderPreservingDictionary: https://github.com/pharo-contributions/OrderPreservingDictionary which is now available as 1.5.0 version (and also as moving tag 1.5.x in case we provide further hotfixes). Basically cleanups were applied: - add missing comments - cleanup packaging - fixing typos - adding tools group for GT extensions - align CI definitions with projects like Seaside - CI green again (throwing out non-working Gemstone, volunteers welcomed) - fix catalog entry - deprecating http://smalltalkhub.com/#!/~PharoExtras/OrderPreservingDictionary and http://smalltalkhub.com/#!/~Pharo/OrderPreservingDictionary You can load it using Metacello new baseline: 'OrderPreservingDictionary'; repository: 'github://pharo-contributions/OrderPreservingDictionary/src'; load or via catalog in Pharo 7 and 8. SIDE NOTE: ========== As of today XMLWriter still requires the "OrderPreservingDictionary" project as a dependency. OrderPreservingDictionary could be replaced by OrderedDictionary (same code, in the standard image) - I will do a pass on that later on. For now I focus on moving the XML stuff to GitHub first. [1] https://lists.pharo.org/pipermail/pharo-users_lists.pharo.org/2019-October/… [2] https://lists.pharo.org/pipermail/pharo-users_lists.pharo.org/2019-October/…

Nov. 19, 2019

Re: [Pharo-users] transactional saving of images

by JuliÃ¡n Maestri

Agree, sounds like a good idea. As far as I know newer versions do not do this. On Mon, Nov 18, 2019, 07:17 Marcus Denker <marcus.denker(a)inria.fr> wrote: > > > > On 15 Nov 2019, at 11:15, Siemen Baader <siemenbaader(a)gmail.com> wrote: > > > > Hi, > > > > I have had a few occasions where I broke an image because I either ran > out of disk space or had an endless loop that grew my image endlessly (I > think). > > > > But why does Pharo not save the image & .changes file in hidden files > named eg ~Pharo.image while it saves? Then it can rename them when saving > was successful. Many unix programs do this. > > > > (I'm using pharo 6.1 so don't know if newer versions do this) > > > Hi, > > I think this sounds like a good idea. > > Marcus > > > > >

Nov. 18, 2019

Tech talk & demo of Pharo in SoCal this Wednesday

by tbrunz

For those who will be in Southern California this week, I will be giving a talk & demo of Pharo this Wednesday night in Pasadena. Details here: https://www.meetup.com/SGVTech/events/266517925/ -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

Nov. 18, 2019

Re: [Pharo-users] transactional saving of images

by Marcus Denker

> On 15 Nov 2019, at 11:15, Siemen Baader <siemenbaader(a)gmail.com> wrote: > > Hi, > > I have had a few occasions where I broke an image because I either ran out of disk space or had an endless loop that grew my image endlessly (I think). > > But why does Pharo not save the image & .changes file in hidden files named eg ~Pharo.image while it saves? Then it can rename them when saving was successful. Many unix programs do this. > > (I'm using pharo 6.1 so don't know if newer versions do this) > Hi, I think this sounds like a good idea. Marcus

Nov. 18, 2019

Re: [Pharo-users] WebDav and CalDav in Pharo ?

by CÃ©drick BÃ©ler

> Hi CÃ©drik, > > I did some updates some time ago which I didnât push. Let me check how these work. Cool :). Also, would you mind doing a GitHub repo for this project ? I didnât find it on your account :) > I have to warn you though that Iâm not doing a lot with Pharo at the moment ... family first ð¶ Cool :) No problem and not urgent anyway, Thank you Udo, CÃ©drick > > CU, > > Udo > > Sent from my iPhone > >> On 18. Nov 2019, at 10:26, CÃ©drick BÃ©ler <cdrick65(a)gmail.com> wrote: >> >> ï»¿Hi all, >> >> I do some experiments with iCal. For now I serve a full calendar over HTTP. Not bad, but it is read only. >> >> Iâd like to try CalDAV. I was looking for it, and also webDAV. >> >> Gofer it >> smalltalkhubUser: 'UdoSchneider' project: 'FileSystemNetwork'; >> configuration; >> load. >> #ConfigurationOfFileSystemNetwork asClass project stableVersion load: 'Webdav' >> >> Iâve found the project of Udo, but it doesnât load on P8. I think this is due to the stream refactoring. Right now the image hung. Iâll try maybe to load it manually. But I was wondering oof there were other alternatives ? >> >> >> TIA, >> >> CÃ©drick

Nov. 18, 2019

Re: [Pharo-users] WebDav and CalDav in Pharo ?

by Udo Schneider

Hi CÃ©drik, I did some updates some time ago which I didnât push. Let me check how these work. I have to warn you though that Iâm not doing a lot with Pharo at the moment ... family first ð¶ CU, Udo Sent from my iPhone > On 18. Nov 2019, at 10:26, CÃ©drick BÃ©ler <cdrick65(a)gmail.com> wrote: > > ï»¿Hi all, > > I do some experiments with iCal. For now I serve a full calendar over HTTP. Not bad, but it is read only. > > Iâd like to try CalDAV. I was looking for it, and also webDAV. > > Gofer it > smalltalkhubUser: 'UdoSchneider' project: 'FileSystemNetwork'; > configuration; > load. > #ConfigurationOfFileSystemNetwork asClass project stableVersion load: 'Webdav' > > Iâve found the project of Udo, but it doesnât load on P8. I think this is due to the stream refactoring. Right now the image hung. Iâll try maybe to load it manually. But I was wondering oof there were other alternatives ? > > > TIA, > > CÃ©drick

Nov. 18, 2019

WebDav and CalDav in Pharo ?

by CÃ©drick BÃ©ler

Hi all, I do some experiments with iCal. For now I serve a full calendar over HTTP. Not bad, but it is read only. Iâd like to try CalDAV. I was looking for it, and also webDAV. Gofer it smalltalkhubUser: 'UdoSchneider' project: 'FileSystemNetwork'; configuration; load. #ConfigurationOfFileSystemNetwork asClass project stableVersion load: 'Webdav' Iâve found the project of Udo, but it doesnât load on P8. I think this is due to the stream refactoring. Right now the image hung. Iâll try maybe to load it manually. But I was wondering oof there were other alternatives ? TIA, CÃ©drick

Nov. 18, 2019

Re: [Pharo-users] Where did all the Comments Go?

by Sven Van Caekenberghe

> On 15 Nov 2019, at 18:10, AndrewBlack <apblack(a)pdx.edu> wrote: > >> $ open Pharo.image > > Pharo runs, and so does Iceberg, but the image that it's running is my > broken Pharo launcher image, not the new one that was just downloaded, and > the VM running it is a 32-bit VM, because MacOS warns me that it is out of > date, and that it won't keep working for much longer. > > So clearly Zeroconf is not, and I have issues with broken bits of old Pharos > on this particular computer, but I'm no closer to figuring out how to > actually run Pharo again. Try: $ ./pharo-ui Pharo.image Unless you did not yet download the VM. You can download both using $ curl get.pharo.org/64/70+vm | bash on macOS and Linux Sven

Nov. 15, 2019

Re: [Pharo-users] Where did all the Comments Go?

by AndrewBlack

I gave up working on this issue back in September because I had other things to do, but never resolved it â unless you call screen-sharing to another machine that does continue to run Pharo a "solution" As far as I can see, the problem is that my Pharo VM can't find the primitives that allow it to access the file system. This means that nothing that requires file system access âÂ including getting the sources âÂ will work. Of course, this makes no sense, because Iceberg had just loaded my code from the file system ... but perhaps using a different mechanism? I did try your suggestion to get a more stable Pharo: > $ curl https://get.pharo.org/64 | bash > % Total % Received % Xferd Average Speed Time Time Time > Current > Dload Upload Total Spent Left > Speed > 100 237 100 237 0 0 49 0 0:00:04 0:00:04 --:--:-- > 52 > bash: line 1: syntax error near unexpected token `newline' > bash: line 1: ` > < > !DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN" > > > ' > $ Then I tried > $ curl https://get.pharo.org/64/stable | bash > % Total % Received % Xferd Average Speed Time Time Time > Current > Dload Upload Total Spent Left > Speed > 100 3260 100 3260 0 0 4234 0 --:--:-- --:--:-- --:--:-- > 4239 > Downloading the latest 70 Image: > http://files.pharo.org/get-files/70/pharo64.zip > Pharo.image > $ which created Pharo.changes, Pharo.image, and Pharo7.0-32bit-ccd1f64.sources in the current directory. Presumably, it also put the 64-bit VM somewhere, but I don't know where. If I just do > $ open Pharo.image Pharo runs, and so does Iceberg, but the image that it's running is my broken Pharo launcher image, not the new one that was just downloaded, and the VM running it is a 32-bit VM, because MacOS warns me that it is out of date, and that it won't keep working for much longer. So clearly Zeroconf is not, and I have issues with broken bits of old Pharos on this particular computer, but I'm no closer to figuring out how to actually run Pharo again. -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

Nov. 15, 2019

Re: [Pharo-users] Zinc & IdentityServer4

by Siemen Baader

Hi Tim, If you get to it before me I'd be happy if you would like to share the actual code you use to log in and / or which tutorial you used. Siemen Sent from my iPhone > On 9 Nov 2019, at 17.16, Tim Mackinnon <tim(a)testit.works> wrote: > > > Interestingly I came across a need to investigate oauth and its only because I happened to read this msg that I knew how to find such a useful resource - the examples are brilliant, thanks Sven! > > This said, it highlights that âthe published documentation in this area is not very accessible or indexed - if you search for âpharo oauthâ on google, you find lots of old stuff and pages that reference st-hub , and definitely not the crucial information below. > > Do you think we could update some of the old zinc pages with a header that points people to the newer github locations? Also, as oauth is becoming more and more prevalent, should we have something written that google will find first, to help people get to this stuff? > > tim > >> On Mon, 4 Nov 2019, at 9:49 AM, Sven Van Caekenberghe wrote: >> Hi Siemen, >> >> This seems to be an implementation of OpenID Connect and OAuth 2.0. >> >> There already exists a working implementation of OAuth for Zinc/Pharo, load the 'SSO' group from the baseline to get the code. >> >> Now, this subject requires some learning curve, it is not super complex, but you have to really understand how it works in order to set it up and debug it. You have to start by reading a couple of good tutorials. >> >> I am not using this, but others are, so maybe they can help you further. >> >> Sven >> >> > On 4 Nov 2019, at 10:37, Siemen Baader <siemenbaader(a)gmail.com> wrote: >> > >> > Hi, >> > >> > Iâm trying to log a registered user into a webshop (https://mad.coop.dk) using Zinc, but it uses IdentityServer4 (https://github.com/IdentityServer/IdentityServer4) for authentication (at https://accounts.cl.coop.dk/) So there are more steps involved than just submitting credentials. >> > >> > Usually I just inspect how things work in the Firefox console, then replicate the interactions in Pharo, but this system is a bit too complex, with many unrelated requests happening. >> > >> > Can anyone guide me towards the correct steps to sign in? >> > >> > thanks >> > Siemen >> >> >> >

Nov. 15, 2019

[Ann] TF-Login for Seaside 3.3 for Pharo 7

by Pierce Ng

Hi all, Apologies for the x-posting. As per subject, I've ported TF-Login to Seaside 3.3 for Pharo 7. To load, start with fresh Pharo 7 image: Metacello new baseline: 'Seaside3'; repository: 'github://SeasideSt/Seaside:v3.3.3/repository'; load. Metacello new baseline: 'TFLogin'; repository: 'github://PierceNg/TF-Login:pharo7/src'; load. The baseline doesn't load Seaside, in case you want to load it into an image that already has Seaside. Start Test Runner and run the TF-Login tests. All 62 tests should pass. Pierce

Nov. 15, 2019

transactional saving of images

by Siemen Baader

Hi, I have had a few occasions where I broke an image because I either ran out of disk space or had an endless loop that grew my image endlessly (I think). But why does Pharo not save the image & .changes file in hidden files named eg ~Pharo.image while it saves? Then it can rename them when saving was successful. Many unix programs do this. (I'm using pharo 6.1 so don't know if newer versions do this) -- Siemen

Nov. 15, 2019

recovering non-ascii code in 6.1

by Siemen Baader

Hi, I have a broken 6.1 image and uncommited code with non-ascii characters in it. When I drag the .changes file onto a new 6.1 image it won't import due to the non-ascii code, but I can rename the .changes file so it matches the new image's filename and import individual code changes (also with non-chars) with Wold Menu -> Tools -> Code Changes. Can I somehow file in the whole .changes file at once to end with the same code state as in the original image? -- Siemen

Nov. 15, 2019

Re: [Pharo-users] Zinc & IdentityServer4

by Christopher Fuhrman

On Sat, Nov 9, 2019, 08:17 Tim Mackinnon <tim(a)testit.works> wrote: > should we have something written that google will find first, to help > people get to this stuff? > Google indexes stackoverflow almost instantly. Maybe pose and answer the same question there? I did it already for a few questions like how to do a progress bar, etc. The SO workflow allows for it. Cris > tim > > On Mon, 4 Nov 2019, at 9:49 AM, Sven Van Caekenberghe wrote: > > Hi Siemen, > > This seems to be an implementation of OpenID Connect and OAuth 2.0. > > There already exists a working implementation of OAuth for Zinc/Pharo, > load the 'SSO' group from the baseline to get the code. > > Now, this subject requires some learning curve, it is not super complex, > but you have to really understand how it works in order to set it up and > debug it. You have to start by reading a couple of good tutorials. > > I am not using this, but others are, so maybe they can help you further. > > Sven > > > On 4 Nov 2019, at 10:37, Siemen Baader <siemenbaader(a)gmail.com> wrote: > > > > Hi, > > > > Iâm trying to log a registered user into a webshop (https://mad.coop.dk) > using Zinc, but it uses IdentityServer4 ( > https://github.com/IdentityServer/IdentityServer4) for authentication (at > https://accounts.cl.coop.dk/) So there are more steps involved than just > submitting credentials. > > > > Usually I just inspect how things work in the Firefox console, then > replicate the interactions in Pharo, but this system is a bit too complex, > with many unrelated requests happening. > > > > Can anyone guide me towards the correct steps to sign in? > > > > thanks > > Siemen > > > > >

Nov. 14, 2019

Presenter initialization

by Kasper Ãsterbye

Cheers, I want to make a Spec Presenter which can show rendered pillar. I have the necessary code to transform a pillar string document into Text with fonts and stuff. My problem is how to make the Presenter. To get moving I did not want to make a wysiwyg editor, but a simple two-mode thing. It either shows the rendered text or the pillar source. When I looked at the Spec components it seems a reasonable approach to make it a subclass of SpTextPresenter, to get all the editing of the source for free. Now after having made this subclass, PillarTextPreseanter, I realize it would be nice if I could tell the difference between rendering mode and editing mode. I thought it would be simple to use a slightly different background color for the editor in rendering mode. And here is the problem: - If I override "initialize" to change the color (self color: MyColor), it has no effect - If I override the "initializeWidgets" to change the color, it has no effect Flopping through the implementation of "openWithSpec", I find that I can implement an "announceDisplayed" method, and if I set the color in that method it does indeed keep the color. I have no idea how I should have found this out (except spending a Thursday morning on it), I am not sure it is the best solution. I have no idea why the other two methods do not work. At times I must admit I am truely baffled by the complexity of it all. Best, Kasper

Nov. 14, 2019

can I somehow test the contents of a package

by Roelof Wobben

Hello, IM doing now this book to understand better the OOP side of Pharo : https://books.pharo.org/learning-oop/ im now at the last challenge of the network-simulator and im stuck. I want to test if the send package is really send back uppercase but I cannot find a way to see the contents of the package in my test I have made so far : https://github.com/RoelofWobben/network/blob/master/NetworkSimulator-Tests/… Can anyone give me a hint how I can achieve what I want ? Regards, Roelof

Nov. 13, 2019

Re: [Pharo-users] Was there some force push to Roassal?

by Cyril Ferlicot

On Sun, Nov 10, 2019 at 2:42 AM Alexandre Bergel via Pharo-users <pharo-users(a)lists.pharo.org> wrote: > > Hi Cyril, > > I tried something to remove some large blob from the history. The code source of Roassal2 is about 7Mb large, but the .git folder is about 150 Mb! > But at the end, it was the push was rejected because some pullrequests exist. So, I did not suspect that I had an impact. Sorry about that. > > Help is welcome to shrink Roassal2âs .git folder. > Hi, A force push is a destructive operation. It's really not recommended to use it on a used project in any case. Even if it's to win some space, it's not worth it. For the .git folder, in general when they grow too much it's often only local. The .git folder of my local clone of roassal is 384B and I have it since month and it is up to date. The "easy" solution is to clone again. Most of the time when I have a clone that is too big, the command `git gc` is enough to shrink it. > Cheers, > Alexandre > > > -- Cyril Ferlicot https://ferlicot.fr

Nov. 12, 2019

by Santiago Bragagnolo

Great! El mar., 12 de nov. de 2019 10:09, Marcus Denker <marcus.denker(a)inria.fr> escribiÃ³: > The Pharo Consortium is very happy to announce that the UniversitÃ© de > Maroua has joined the Consortium as an Academic Member. > > About > - UniversitÃ© de Maroua: http://www.univ-maroua.cm/ > - Pharo Consortium: http://consortium.pharo.org > > The goal of the Pharo Consortium is to allow companies and institutions to > support the ongoing development and future of Pharo. > > Individuals can support Pharo via the Pharo Association: > > - http://association.pharo.org >

Nov. 12, 2019

by Marcus Denker

The Pharo Consortium is very happy to announce that the UniversitÃ© de Maroua has joined the Consortium as an Academic Member. About - UniversitÃ© de Maroua: http://www.univ-maroua.cm/ - Pharo Consortium: http://consortium.pharo.org The goal of the Pharo Consortium is to allow companies and institutions to support the ongoing development and future of Pharo. Individuals can support Pharo via the Pharo Association: - http://association.pharo.org

Nov. 12, 2019

Re: [Pharo-users] Was there some force push to Roassal?

by Ben Coman

On Sun, 10 Nov 2019 at 09:32, Alexandre Bergel via Pharo-users < pharo-users(a)lists.pharo.org> wrote: > Hi Cyril, > > I tried something to remove some large blob from the history. The code > source of Roassal2 is about 7Mb large, but the .git folder is about 150 Mb! > But at the end, it was the push was rejected because some pullrequests > exist. So, I did not suspect that I had an impact. Sorry about that. > It seems strange it was rejected because some pull request existed. Were you doing it from the command line? Was it something like one of these error messages? Particularly Step 11? https://github.community/t5/How-to-use-Git-and-GitHub/How-to-deal-with-quot… > Help is welcome to shrink Roassal2âs .git folder. > I just cloned Rossal2 and `du -sh .` gave 88M, so its looks like you had some success reducing it. Google found me a way to list large objects... ``` git rev-list --objects --all \ | git cat-file --batch-check='%(objecttype) %(objectname) %(objectsize) %(rest)' \ | sed -n 's/^blob //p' \ | sort --numeric-sort --key=2 \ | cut -c 1-12,41- \ | $(command -v gnumfmt || echo numfmt) --field=2 --to=iec-i --suffix=B --padding=7 --round=nearest \ > ../list.txt ``` The largest file entry was... e0c5f0885bac 432KiB src/Roassal2/ RTRoassalExample.class.st That file is no longer in the repo, but... $ grep RTRoassalExample.class.st ../list.txt | wc -l ==> 158 and 158 * 432K ==> 68M Found the commit with that blob to examine... $ git log --all --pretty=format:%H -- src/Roassal2/RTRoassalExample.class.st | xargs -n1 -I% sh -c "git ls-tree % -- src/Roassal2/ RTRoassalExample.class.st | grep -q e0c5f0885bac && echo %" ==> a7753aef2a9f14cf5c84da83b8ebff7e4e35f0e9 $ git checkout a7753aef2a9f14cf5c84da83b8ebff7e4e35f0e9 $ vi src/Roassal2/RTRoassalExample.class.st and I see the culprit is icons being encoded directly in the class... { #category : #icons } RTRoassalExample >> exampleAligningGroupsIcon [ ^ 'iVBORw0KGgoAAAANSUhEUgAAAGQAAABkCAYAAABw4pVUAAAICElEQVR4XuWaWWhUVxjHI27Q 1oJttfjUusQHQdE+uIFUJYIVBC1VrDv6oKDUd5fGKK3RRgkRFfelaKvR1rpS7YbGFrUWcaHF msYsNMaJSWa9SWbmf3v+9/YmM5M7zj5J/P4wzGQyc+855/edbzuTo+vy1ZWUI38J5AORL/lA 5AORL/lA5AORL/lA5AORL/lA5AORL/lA5Es+EPlA5Es+EPlA5Es+EPlA5Es+EPlA5Es+EPmS D0Q+EPmSD0Q+EPmSD0Q+EPmSD0Q+EPmSD0S+5AORD0S+5AORD0S+5AORD6QratMmoLkZCH3v ...etc One way to reduce those historical file sizes would be running git-filter with an automated way to extract those icons to separate files and add code to load them. Seems hard. Following another path of investigation led me first to to "Git Compression of Blobs and Packfiles" https://gist.github.com/matthewmccullough/2695758 So trying... $ git gc --aggressive $ du -sh . ==> 18M https://stackoverflow.com/questions/28720151/git-gc-aggressive-vs-git-repack led me to the same job being done by... $ git repack -a -d -f --depth=10 --window=250 $ du -sh . ==> 18M My understanding is that this is safe and doesn't affect the commit history. However its just a local result. A few things I read gives the feeling that pushing from that repacked repo won't change anything on the server since it only sends a diff to the server, which then repacks in its own time. Perhaps the only way is ask GIthub Support if they can repack it. https://help.github.com/en/github/working-with-github-support/submitting-a-… cheers -ben

Nov. 11, 2019

Re: [Pharo-users] Was there some force push to Roassal?

by Alexandre Bergel

Hi Cyril, I tried something to remove some large blob from the history. The code source of Roassal2 is about 7Mb large, but the .git folder is about 150 Mb! But at the end, it was the push was rejected because some pullrequests exist. So, I did not suspect that I had an impact. Sorry about that. Help is welcome to shrink Roassal2âs .git folder. Cheers, Alexandre > On 07-11-2019, at 19:33, Cyril Ferlicot D. <cyril.ferlicot(a)gmail.com> wrote: > > Hi, > > Since there is no release for roassal I have projects referencing a SHA > of a stable Roassal 2 version. > > I see in my projects that the roassal SHA targeted was > c1da8614c951008ea501f126ef3ccf25d73580ac but now I cannot find it in the > history of roassal and my projects are failing. > > So I am wondering if someone forced pushed on Roassal 2? And if yes, > what is the reason? > > Because of this, all the released of the projects depending on this > version of roassal will never work again. > > Please, please, do not use destructive operations on projects that are > intended to be used :( > > -- > Cyril Ferlicot > https://ferlicot.fr >

Nov. 10, 2019

Re: [Pharo-users] Green Light for JRMPC!

by askoh

Congratulations. It will be recorded in history. Aik-Siong Koh -- Sent from: http://forum.world.st/Pharo-Smalltalk-Users-f1310670.html

Nov. 9, 2019

Re: [Pharo-users] Zinc & IdentityServer4

by Tim Mackinnon

Interestingly I came across a need to investigate oauth and its only because I happened to read this msg that I knew how to find such a useful resource - the examples are brilliant, thanks Sven! This said, it highlights that âthe published documentation in this area is not very accessible or indexed - if you search for âpharo oauthâ on google, you find lots of old stuff and pages that reference st-hub , and definitely not the crucial information below. Do you think we could update some of the old zinc pages with a header that points people to the newer github locations? Also, as oauth is becoming more and more prevalent, should we have something written that google will find first, to help people get to this stuff? tim On Mon, 4 Nov 2019, at 9:49 AM, Sven Van Caekenberghe wrote: > Hi Siemen, > > This seems to be an implementation of OpenID Connect and OAuth 2.0. > > There already exists a working implementation of OAuth for Zinc/Pharo, load the 'SSO' group from the baseline to get the code. > > Now, this subject requires some learning curve, it is not super complex, but you have to really understand how it works in order to set it up and debug it. You have to start by reading a couple of good tutorials. > > I am not using this, but others are, so maybe they can help you further. > > Sven > > > On 4 Nov 2019, at 10:37, Siemen Baader <siemenbaader(a)gmail.com> wrote: > > > > Hi, > > > > Iâm trying to log a registered user into a webshop (https://mad.coop.dk) using Zinc, but it uses IdentityServer4 (https://github.com/IdentityServer/IdentityServer4) for authentication (at https://accounts.cl.coop.dk/) So there are more steps involved than just submitting credentials. > > > > Usually I just inspect how things work in the Firefox console, then replicate the interactions in Pharo, but this system is a bit too complex, with many unrelated requests happening. > > > > Can anyone guide me towards the correct steps to sign in? > > > > thanks > > Siemen > > >

Nov. 9, 2019