- Pharo-vm - lists.pharo.org

Status update of Libgit2 and CI issues

by Guillermo Polito

A couple of weeks ago we got reported a big recurrent failure on CI jobs while cloning using iceberg/libgit https://github.com/pharo-project/pharo/issues/11481. TL;DR; So far (Friday ~17h Paris time) we managed to get everything up and running. A new VM is being released by our CI, all pull requests are issued and we should have everything integrated by tonight. =-=-=-=-=-=-=-= More on the situation: Errors happened randomly with ``` error reading from the zlib stream ``` or ``` bad packet length ``` Several people helped in getting a reliable script to reproduce the issue, plus some instructions to produce a reproduction environment using a docker container. With that in our hands, we managed to corner the issue to a new incompatibility between old libgit2 versions, ssh2, OpenSSL, and (at least) Github. After testing some configurations, we decided to upgrade the libgit and related binaries to newer versions: - libgit 1.4.4 - libssh 1.9.0 - OpenSSL 1.1.1k This was of course not as straightforward as we would have liked. Libgit2 1.4.4 was not compatible with its older versions and broke our ffi bindings. We needed to provide new VM binaries for all our major platforms, make a new VM release, upgrade the libgit2 bindings, and make releases of the libgit2 bindings, iceberg, and backport to Pharo 10 and Pharo 9. TL;DR; So far (Friday ~17h Paris time) we managed to get everything up and running. A new VM is being released by our CI, all pull requests are issued and we should have everything integrated by tonight. Libgit+related compilation instructions are updated in the VM wiki https://github.com/pharo-project/pharo-vm/wiki/Building-OSX-ARM64-Third-Par… https://github.com/pharo-project/pharo-vm/wiki/Building-OSX-X86_64-Third-Pa… https://github.com/pharo-project/pharo-vm/wiki/Building-Linux-ARM64-Third-P… https://github.com/pharo-project/pharo-vm/wiki/Building-Linux-ARM32-Third-P… Libgit bindings Upgrade changes: https://github.com/pharo-vcs/libgit2-pharo-bindings/commit/0e0100f7d0f3a11c… release: https://github.com/pharo-vcs/libgit2-pharo-bindings/releases/tag/v2.2.6 Iceberg Upgrade pr: https://github.com/pharo-vcs/iceberg/pull/1605 release: https://github.com/pharo-vcs/iceberg/releases/tag/v2.0.7 Upgrading library dependencies in the VM https://github.com/pharo-project/pharo-vm/pull/447 Release VM 9.0.16 https://github.com/pharo-project/pharo-vm/releases/tag/v9.0.16 Backports to Pharo Pharo10 https://github.com/pharo-project/pharo/pull/11545 Pharo9 https://github.com/pharo-project/pharo/pull/11546 We have left for later to upgrade library dependencies for the Windows VM (x86-64, ARM64). Of course, any help in this direction is welcome. Cheers, G in behalf of the team

Aug. 19, 2022

Fwd: [Pharo-dev] Inovation Technology Award Submission: Polyphemus

by Guillermo Polito

Thanks Pierre, I forward to the Pharo vm list :) > Inicio del mensaje reenviado: > > De: pmissech <pierre.misse-chanabier(a)inria.fr> > Asunto: [Pharo-dev] Inovation Technology Award Submission: Polyphemus > Fecha: 16 de agosto de 2022, 10:36:31 CEST > Para: pharo-users(a)lists.pharo.org, Pharo Development List <pharo-dev(a)lists.pharo.org> > Responder a: Pharo Development List <pharo-dev(a)lists.pharo.org> > > Hello, > > Although i will not be able to attend ESUG'22, a friend agreed to present one of our projects to the innovation award. > **Polyphemus** is a VM related, but public aims at any kind of developers. > Particularly, the video submission talks about how to look at an image and how to **recover** dead images. > Feel free to contact me if you have any questions ! > Enjoy (and vote for Polyphemus!). > > 5 minutes video, Innovation Technology Award submission: https://youtu.be/zf3cCtNW830 > Repository: github.com/hogoww/Polyphemus/ > Additionnal information on image recovery: https://github.com/hogoww/Polyphemus/blob/main/Documentation/ResurrectingDe… > > Cheers !

Aug. 16, 2022

MPLR 2022 -- Call for Participation

by Guillermo Polito

======================================================================== Call for Participation MPLR 2022 - 19th International Conference on Managed Programming Languages & Runtimes September 14-15, 2022 in Brussels, Belgium https://soft.vub.ac.be/mplr22/ Follow us @MPLR_Conf ======================================================================== The 19th International Conference on Managed Programming Languages & Runtimes (MPLR, formerly ManLang) is a premier forum for presenting and discussing novel results in all aspects of managed programming languages and runtime systems, which serve as building blocks for some of the most important computing systems in use, ranging from small-scale (embedded and real-time systems) to large-scale (cloud-computing and big-data platforms) and anything in between (desktop, mobile, IoT, and wearable applications). This year, MPLR will be held at the campus of the Vrije Universiteit Brussel(VUB) in Brussels, Belgium. Keynotes -------- Performance Optimizations in the .NET GC Dr. Maoni Stephens, Microsoft, USA Static Compilation of JavaScript Dr. Manuel Serrano, Inria Sophia-Antipolis, France Accepted Papers --------------- Automatic Array Transformation to Columnar Storage at Run Time Lukas Makor et al. Compressed Forwarding Tables Reconsidered Jonas Norlinder et al. Event-Based Out-of-place Debugging Tom Lauwaerts et al. Machine-Learning-Based Self-Optimizing Compiler Heuristics Raphael Mosaner et al. SecSharp: Towards Efficient Trusted Execution in Managed Languages Gilang Mentari Hamidy et al. A Model Checking Framework for a New Collector Framework Bochen Xu et al. Porting a JIT compiler to RISC-V: Challenges and Opportunities Quentin Ducasse et al. Analyzing and Predicting Energy Consumption of Garbage Collectors in OpenJDK Marina Shimchenko et al. Better Understanding the Costs and Benefits of Automatic Memory Management Kunal Sareen et al. Dynamic Taint Analysis with Label-Defined Semantics Jacob Kreindl et al. Attendance ---------- Thanks to our generous sponsors, we were able to significantly reduce this yearâs registration fees. Early Registration Fees: Students: 175 Euro Regular: 250 Euro In addition to the conference participation, the registration includes: - 2-day transportation ticket in the Brussels area - welcome reception on Wednesday, September 14 - guided tour to the city hall and conference banquet on Thursday, September 15 More details, and link to registration system: https://soft.vub.ac.be/mplr22/registration/ Important Dates --------------- Early Registration: 23 August 2022 Conference Dates: 14-15 September 2022

Aug. 16, 2022

Re: About global caches

by StÃ©phane Ducasse

Ok :) > On 26 Jul 2022, at 11:50, Guille Polito <guillermo.polito(a)inria.fr> wrote: > > Haha no global lookup, these are related to adaptive optimisations and inlining decisions :) > >> El 26 jul 2022, a las 11:31, stephane ducasse <stephane.ducasse(a)inria.fr <mailto:stephane.ducasse@inria.fr>> escribiÃ³: >> >> About global lookup caches >> >> @Nahuel Palumbo I think we should take a good look at these FIVE papers >> - Surgical precision JIT compilers [PLDI'14] >> https://dl.acm.org/doi/10.1145/2666356.2594316 <https://dl.acm.org/doi/10.1145/2666356.2594316> >> >> - Efficient late binding of dynamic function compositions >> https://dl.acm.org/doi/10.1145/3357766.3359543 <https://dl.acm.org/doi/10.1145/3357766.3359543> >> >> - Making collection operations optimal with aggressive JIT compilation >> https://dl.acm.org/doi/10.1145/3136000.3136002 <https://dl.acm.org/doi/10.1145/3136000.3136002> >> >> - Dynamic versus Static Optimization Techniques for Object-Oriented Languages >> https://onlinelibrary.wiley.com/doi/10.1002/j.1096-9942.1995.tb00017.x <https://onlinelibrary.wiley.com/doi/10.1002/j.1096-9942.1995.tb00017.x> >> >> - A Survey of Adaptive Optimization in Virtual Machines >> https://ieeexplore.ieee.org/document/1386662 <https://ieeexplore.ieee.org/document/1386662>_______________________________________________ >> Pharo-vm mailing list -- pharo-vm(a)lists.pharo.org <mailto:pharo-vm@lists.pharo.org> >> To unsubscribe send an email to pharo-vm-leave(a)lists.pharo.org <mailto:pharo-vm-leave@lists.pharo.org> > > _______________________________________________ > Pharo-vm mailing list -- pharo-vm(a)lists.pharo.org > To unsubscribe send an email to pharo-vm-leave(a)lists.pharo.org

July 26, 2022

Re: About global caches

by Guille Polito

Haha no global lookup, these are related to adaptive optimisations and inlining decisions :) > El 26 jul 2022, a las 11:31, stephane ducasse <stephane.ducasse(a)inria.fr> escribiÃ³: > > About global lookup caches > > @Nahuel Palumbo I think we should take a good look at these FIVE papers > - Surgical precision JIT compilers [PLDI'14] > https://dl.acm.org/doi/10.1145/2666356.2594316 <https://dl.acm.org/doi/10.1145/2666356.2594316> > > - Efficient late binding of dynamic function compositions > https://dl.acm.org/doi/10.1145/3357766.3359543 <https://dl.acm.org/doi/10.1145/3357766.3359543> > > - Making collection operations optimal with aggressive JIT compilation > https://dl.acm.org/doi/10.1145/3136000.3136002 <https://dl.acm.org/doi/10.1145/3136000.3136002> > > - Dynamic versus Static Optimization Techniques for Object-Oriented Languages > https://onlinelibrary.wiley.com/doi/10.1002/j.1096-9942.1995.tb00017.x <https://onlinelibrary.wiley.com/doi/10.1002/j.1096-9942.1995.tb00017.x> > > - A Survey of Adaptive Optimization in Virtual Machines > https://ieeexplore.ieee.org/document/1386662 <https://ieeexplore.ieee.org/document/1386662>_______________________________________________ > Pharo-vm mailing list -- pharo-vm(a)lists.pharo.org > To unsubscribe send an email to pharo-vm-leave(a)lists.pharo.org

July 26, 2022

About IR design: a design overview of javascript cores DFG IR

by stephane ducasse

A design overview of JavaScriptCores DFG IR <https://www.youtube.com/watch?v=EFRzBb9NYjM> https://www.youtube.com/watch?v=EFRzBb9NYjM S

July 26, 2022

About MoreVM'22

by stephane ducasse

> Hi! > > Guille and me went to MoreVMs <https://2022.programming-conference.org/home/MoreVMs-2022> event this week. > > We presented > > Interpreter Register Autolocalisation: Improving the performance of efficient interpreters > <autolocalisation.pdf> > > > > > And here there is a summary about the presentations we saw: > > - Less Is More: Merging AST Nodes To Optimize Interpreters > > This presentation shows an optimisation to interpreters merging AST nodes into supernodes, the same idea of superinstructions but at AST level. Itâs implemented on Truffle framework. Now the possible supernodes are selected manually, they have tools to help in this tasks. The results in presented benchmarks show better performance (reducing run time) than without supernodes. > > > - Towards Just-in-time and Language-agnostic Mutation Testing > > This work presents a Mutation Testing framework for languages built using Truffle framework. They offer common language-agnostic mutators and possibility to implement language specific mutators. After that, they perform Mutation Testing using Truffle API to determine the quality of a suite of unit tests. > Iâm not sure why they call âJIT" Mutation Testing. The abstract show the capability to mutate compiled code, take dynamic information at run-time and determine the utility of mutants for skip some of them as techniques with impact in mutant testing efficiency. > > > - Who You Gonna Call? A Case Study about the Call-Site Behaviour in Ruby-on-Rails Applications > > Sophie studied ruby on rails applications to see how many call sites are mono/poly/mega morphic with the objective of observing if they present phased behavior. Phased behavior means that the application behaviour changes at some point during its execution, in which moment it does a change of phase. > > Thing is that call site caches are usually global to the entire lifetime of the application. > However, it may happen that some call-site is monomorphic for some time, then it's monomorphic with another method for some other time. But a normal PIC will make a PIC with two entries instead of resetting the cache and creating monomorphic calls. > > Then she studied how phased behaviour would impact positively some applications. > They then manually marked the start of new phases and observed if the degree of polymorphism got effectively reduced. > > > - Torchy: A Tracing JIT Compiler for PyTorch > > Pytorch is a tool to script machine learning applications in Python that uses the GPU. > The problem of pytorch is that it eagerly performs calls to the GPU for every call in Python, which makes lots of useless roundtrips. > He presented a tracing compiler that creates linear execution traces that are sent all at once to the GPU to avoid such overhead.

July 26, 2022

About global caches

by stephane ducasse

About global lookup caches @Nahuel Palumbo I think we should take a good look at these FIVE papers - Surgical precision JIT compilers [PLDI'14] https://dl.acm.org/doi/10.1145/2666356.2594316 - Efficient late binding of dynamic function compositions https://dl.acm.org/doi/10.1145/3357766.3359543 - Making collection operations optimal with aggressive JIT compilation https://dl.acm.org/doi/10.1145/3136000.3136002 - Dynamic versus Static Optimization Techniques for Object-Oriented Languages https://onlinelibrary.wiley.com/doi/10.1002/j.1096-9942.1995.tb00017.x - A Survey of Adaptive Optimization in Virtual Machines https://ieeexplore.ieee.org/document/1386662

July 26, 2022

About SIMD [from nico]

by stephane ducasse

â¢ A couple of interesting readings I found today: - SIMD Instructions Considered Harmful https://www.sigarch.org/simd-instructions-considered-harmful/ RISC-V designers explain the disadvantages of fixed-size vector instructions - RISC-V Vector Instructions vs ARM and x86 SIMD https://medium.com/swlh/risc-v-vector-instructions-vs-arm-and-x86-simd-8c9b… Mentions some disadvantages of size-independent vector instructions that are not mentioned in the prior article â¢ Both of these talk about design of CPU instructions, but I think they also apply to bytecode design

July 26, 2022

About become: improvements

by stephane ducasse

Hi guys This list is silent because we forgot systematically to post to itâ¦ :) We will try to catch up. Here is a nice email from our internal academix list. A more detailed summary We reviewed NicoRâs blogpost on how to access the VM simulator https://thepharo.dev/2022/06/30/setting-up-your-environment-for-working-on-… <https://thepharo.dev/2022/06/30/setting-up-your-environment-for-working-on-…> We reviewed the `#become:` implementation. We have some notes to publish https://notes.inria.fr/rI0U--tWT1GP1c4O3hve_Q?edit <https://notes.inria.fr/rI0U--tWT1GP1c4O3hve_Q?edit> We profiled it with instruments and saw some performance bottlenecks. We were only able to do 35K become per second, which is not a lot. We did some little improvements to avoid those bottlenecks and improve performance by ~500x. Now we can do 2M become per second. Then Daniel showed us the primitive `#adoptInstance:` and we did a similar analysis. Finally, Nahuel showed his advances in the permanent graph selection, and we did some garbage collection benchmarks. We saw that moving most packages code (classes, methods, literals,...) can cut full GC pauses by ~half. Stef

July 26, 2022