July 2012 - Pharo-dev - lists.pharo.org

[Pharo-project] Going meta (VM development)

by Igor Stasenko

Hello, spent another day building VM, i found that our setup is still far from being simple.. the jenkins jobs right now using a page-long scripts to configure & build vm, and grown with many bells and whistless.. one of my goals when i created a configurations was to avoid that.. and keep these things 1-liners.. one of the reasons for doing that is that you can reproduce the whole build on local machine from command line by typing a simple commands like make , as well as simple doits in VMMaker image. So, here some of my suggestions: - create a single PharoVMBuilder class, which will encompass all the details of platform-specificness, and will pick the right configuration & default plugins based on our preference and target platform. By issuing: PharoVMBuilder generate. - it should generate sources - it should generate cmake files, based on environment variable set (btw, can we access an environment variables in our VMs now?) if not, then based on platform that image runs now , which is not good for cross-platform builds, but since now we don't have cross-builds, it will work fine. The approach , again is the same: lets encapsulate the information we need in edible form, not like this one: #!bash -lex # # build-vm.sh -- Builds Cog Virtual Machine. Have to be used together with Jenkins. # # Copyright (c) 2012 Christophe Demarey # export PHARO_VM=`$WORKSPACE/pharo-shell-scripts/fetchLatestVM.sh` if [ -z "$PHARO_VM" ] ; then echo "PHARO_VM environment variable is not set." exit 1 fi # Set environment ============================================================ PROCESS_PLUGIN="UnixOSProcessPlugin" EXTERNAL_PLUGINS="FT2Plugin" ZIP_FILTER='*' if [ "$OS" == "win" ]; then set -e # Stop the execution if a command fails! CONFIGNAME="CogWindowsConfig" PROCESS_PLUGIN="Win32OSProcessPlugin" ZIP_FILTER=' *.exe *.dll' elif [ "$OS" == "mac" ]; then CONFIGNAME="CogCocoaIOSConfig" export MACOSX_DEPLOYMENT_TARGET=10.5 export CC=/usr/bin/gcc-4.2 export CXX=/usr/bin/g++-4.2 else # [ "$OS" == "linux" ]; then CONFIGNAME="CogUnixConfig" export EXTERNAL_PLUGINS="SqueakSSLPlugin $EXTERNAL_PLUGINS" fi # Unpack sources ============================================================= cd "$WORKSPACE" rm -rf cog tar -xzf cog.tar.gz || echo # echo needed for Windows build (error on symlinks creation) mkdir -p cog/build mkdir -p cog/image cd cog/image unzip -o ../../vmmaker-image.zip # Generate sources =========================================================== echo "$CONFIGNAME new addExternalPlugins: #( $EXTERNAL_PLUGINS ); addInternalPlugins: #( $PROCESS_PLUGIN ); generateSources; generate. Smalltalk snapshot: false andQuit: true." > ./script.st "$PHARO_VM" -headless generator.image script.st -headless cd ../../ tar -czf ${CONFIGNAME}-sources.tar.gz -C cog . # Compile ==================================================================== cd cog/build if [ "$OS" == "win" ]; then cmake -G "MSYS Makefiles" . else cmake . fi make if [ "$OS" == "mac" ]; then make install fi cd .. # Install SSL Plugin ========================================================= SSL_PLUGIN_URL='http://squeakssl.googlecode.com/files/SqueakSSL-bin-0.1.5.zip' SSL_PLUGIN_ZIP='SqueakSSL-bin-0.1.5.zip' SSL_PLUGIN_OUT='SqueakSSL-bin' test -e 'SqueakSSL-bin-0.1.5.zip' || \ ($WORKSPACE/download.sh $SSL_PLUGIN_ZIP $SSL_PLUGIN_URL && unzip -o $SSL_PLUGIN_ZIP) if [ "$OS" == "win" ]; then cp $SSL_PLUGIN_OUT/win/* results/ #elif [ "$OS" == "linux" ]; then # cp $SSL_PLUGIN_OUT/unix/so.SqueakSSL results/libSqueakSSL.so fi rm -rf $SSL_PLUGIN_OUT # Archive ==================================================================== cd results COG_ZIP_FILE="Cog-${OS}.zip" zip -r $COG_ZIP_FILE $ZIP_FILTER mv -f $COG_ZIP_FILE ../../ #if [ "$OS" == "mac" ]; then # zip -r ../build/CogVM.zip CogVM.app # mv -f ../build/CogVM.zip ../../ #else # zip -r Cog.zip $ZIP_FILTER # mv Cog.zip ../../ #fi # success exit 0 Another thing, which i discussed locally , i thinking about creating a dedicated blog for VM developers, where we can share the news and describe details about changes and stuff.. In a way, that it will serve as a source of information about VM , jenkins , configurations, settings , building etc etc.. Because all of the bits of knowledge , which we collected till now is kind of floating in the air, and like any energy it tends to dissipate (things we remember and forget, the more things we should keep in head, the faster it happens). Also, blog is preferable to just simple CHANGELOG file (or similar), because it is two-way communication , and people can comment and discuss things. -- Best regards, Igor Stasenko.

July 30, 2012

Re: [Pharo-project] Delete workspace before build starts

by Sean P. DeNigris

Igor Stasenko wrote > > It was never public (only logged users can navigate workspace contents). > That's right -- View this message in context: http://forum.world.st/Delete-workspace-before-build-starts-tp4642104p464214… Sent from the Pharo Smalltalk mailing list archive at Nabble.com.

July 30, 2012

Re: [Pharo-project] Delete workspace before build starts

by Igor Stasenko

On 29 July 2012 23:32, Pavel Krivanek <pavel.krivanek(a)gmail.com> wrote: > Hi, > > as I see, there is a new job configuration option "Delete workspace > before build starts". From what plugin does it come? I want to notice > that now workspaces on Jenkins are not visible to public. > It was never public (only logged users can navigate workspace contents). .. if i don't mistaken. > -- Pavel > -- Best regards, Igor Stasenko.

July 30, 2012

[Pharo-project] Delete workspace before build starts

by Pavel Krivanek

Hi, as I see, there is a new job configuration option "Delete workspace before build starts". From what plugin does it come? I want to notice that now workspaces on Jenkins are not visible to public. -- Pavel

July 29, 2012

Re: [Pharo-project] System package

by StÃ©phane Ducasse

http://code.google.com/p/pharo/issues/detail?id=6476 :)

July 29, 2012

Re: [Pharo-project] System package

by StÃ©phane Ducasse

ok I will add an issue. On Jul 29, 2012, at 10:05 PM, Pavel Krivanek wrote: >

July 29, 2012

Re: [Pharo-project] System package

by Pavel Krivanek

(MCWorkingCopy forPackage: (MCPackage named: 'System')) unregister On Sun, Jul 29, 2012 at 9:49 PM, Pavel Krivanek <pavel.krivanek(a)gmail.com> wrote: > Hi, > > in the image we have one Monticello package in the image that should > not be there: System (EstebanLorenzano.7). The working copy should be > removed in the next update. > > -- Pavel

July 29, 2012

[Pharo-project] System package

by Pavel Krivanek

Hi, in the image we have one Monticello package in the image that should not be there: System (EstebanLorenzano.7). The working copy should be removed in the next update. -- Pavel

July 29, 2012

Re: [Pharo-project] [update 2.0] #20236

by StÃ©phane Ducasse

Thanks pavel. stef On Jul 29, 2012, at 3:19 PM, Pavel Krivanek wrote: > Sorry, this was not an issue in the Announcements but in a wrong > automatic line break in the shrinking script. Pharo Kernel 2.0 job is > green now. > > -- Pavel > > On Sun, Jul 29, 2012 at 12:45 PM, Guillermo Polito > <guillermopolito(a)gmail.com> wrote: >> >> >> On Sun, Jul 29, 2012 at 12:34 AM, camille teruel <camille.teruel(a)gmail.com> >> wrote: >>> >>> Yes there is still mess in ChangesLog>>logEvent: . I'll clean up this >>> tomorrow. By the way, does somone knows why ChangesLog only logs classes and >>> methods deletion and nothing more? >>> >> >> But the mess is consistent :/. If I evaluate in a workspace: >> >> (RemovedEvent class: SystemChangeNotifier category: 'aCategoryName') >> asAnnouncement event >> >> It yields to the event and not to nil.... So there is another problem in the >> shrinking maybe... >> >>> >>> >>> 2012/7/28 Pavel Krivanek <pavel.krivanek(a)gmail.com> >>>> >>>> On Fri, Jul 27, 2012 at 9:18 PM, Esteban Lorenzano <estebanlm(a)gmail.com> >>>> wrote: >>>>> 20236 >>>>> ----- >>>>> >>>>> Issue 6467: Remove SystemChangeNotifier 2 - All events using >>>>> SystemAnnouncer >>>>> http://code.google.com/p/pharo/issues/detail?id=6467 >>>>> >>>>> the beast is not dead yet... but almost :) >>>>> >>>> >>>> Hi Esteban, >>>> >>>> the shrinking to the Pharo Kernel now fails with this error: >>>> >>>> PharoKernel shrinking report >>>> Error: >>>> MessageNotUnderstood: receiver of "isRemoved" is nil >>>> 441 [:e | >>>> | rep | >>>> rep := FileStream forceNewFileNamed: 'PharoDebug.log'. >>>> rep nextPutAll: 'PharoKernel shrinking report'; >>>> cr. >>>> rep nextPutAll: 'Error:'; >>>> cr. >>>> rep nextPutAll: e asString; >>>> cr. >>>> rep nextPutAll: thisContext stack size asString. >>>> thisContext stack copy >>>> withIndexDo: [:stck :i | [rep nextPutAll: i asString; >>>> space; >>>> nextPutAll: stck asString; >>>> cr] >>>> ifError: []]. >>>> rep close. >>>> Smalltalk exitFailure] in SmalltalkImage>>privShrinkingProcess >>>> 2 BlockClosure>>cull: >>>> 3 BlockClosure>>cull:cull: >>>> 4 [:ex | errorHandlerBlock cull: ex description cull: ex receiver] in >>>> BlockClosure>>ifError: >>>> 5 BlockClosure>>cull: >>>> 6 [(self tempAt: 2) >>>> cull: exception] in >>>> MethodContext(ContextPart)>>handleSignal: >>>> 7 BlockClosure>>ensure: >>>> 8 MethodContext(ContextPart)>>handleSignal: >>>> 9 MethodContext(ContextPart)>>handleSignal: >>>> 10 MessageNotUnderstood(Exception)>>signal >>>> 11 UndefinedObject(Object)>>doesNotUnderstand: #isRemoved >>>> 12 ChangesLog>>logEvent: >>>> 13 ChangesLog>>logAnnouncement: >>>> 14 MessageSend>>value: >>>> 15 MessageSend>>cull: >>>> 16 MessageSend>>cull:cull: >>>> 17 [action cull: anAnnouncement cull: announcer] in >>>> AnnouncementSubscription>>deliver: >>>> 18 BlockClosure>>on:do: >>>> 19 BlockClosure>>on:fork: >>>> 20 AnnouncementSubscription>>deliver: >>>> 21 [subscription deliver: anAnnouncement] in >>>> SubscriptionRegistry>>deliver:to:startingAt: >>>> 22 BlockClosure>>ifCurtailed: >>>> 23 SubscriptionRegistry>>deliver:to:startingAt: >>>> 24 SubscriptionRegistry>>deliver:to: >>>> 25 SubscriptionRegistry>>deliver: >>>> 26 SystemAnnouncer(Announcer)>>announce: >>>> 27 SystemAnnouncer>>basicAnnounce: >>>> 28 SystemAnnouncer>>announce: >>>> 29 SystemAnnouncer>>trigger: >>>> 30 SystemAnnouncer>>classRemoved:fromCategory: >>>> 31 SystemDictionary>>forgetClass:logged: >>>> 32 ClassRenameFixTest class(Class)>>removeFromSystem: >>>> 33 ClassRenameFixTest class(Class)>>removeFromSystem >>>> 34 [SystemChangeNotifier uniqueInstance noMoreNotificationsFor: class. >>>> SystemAnnouncer unsubscribe: class. >>>> class isTrait >>>> ifFalse: [(class class includesSelector: #unload) >>>> ifTrue: [class removeSelector: #unload]]. >>>> class removeFromSystem] in [:className | >>>> | class | >>>> class := Smalltalk globals classOrTraitNamed: className. >>>> class allSubclasses >>>> ifEmpty: [SystemChangeNotifier uniqueInstance >>>> noMoreNotificationsFor: class. >>>> SystemAnnouncer unsubscribe: class. >>>> class isTrait >>>> ifFalse: [(class class includesSelector: >>>> #unload) >>>> ifTrue: [class >>>> removeSelector: #unload]]. >>>> class removeFromSystem]] in >>>> SystemNavigation>>removeAllButPackages: >>>> 35 OrderedCollection(Collection)>>ifEmpty: >>>> 36 [:className | >>>> | class | >>>> class := Smalltalk globals classOrTraitNamed: className. >>>> class allSubclasses >>>> ifEmpty: [SystemChangeNotifier uniqueInstance >>>> noMoreNotificationsFor: class. >>>> SystemAnnouncer unsubscribe: class. >>>> class isTrait >>>> ifFalse: [(class class includesSelector: >>>> #unload) >>>> ifTrue: [class >>>> removeSelector: #unload]]. >>>> class removeFromSystem]] in >>>> SystemNavigation>>removeAllButPackages: >>>> 37 SortedCollection(OrderedCollection)>>do: >>>> 38 SystemNavigation>>removeAllButPackages: >>>> 39 [| packages | >>>> 10 >>>> timesRepeat: [(Delay forMilliseconds: 100) wait. >>>> Processor yield]. >>>> Author fullName: 'Mr.Shrinker'. >>>> self privCleanMonticello. >>>> UIManager default: DummyUIManager new. >>>> UIManager default progressBarEnabled: false. >>>> self privCleanProcesses. >>>> self privCleanGlobals. >>>> 5 >>>> timesRepeat: [Smalltalk garbageCollect]. >>>> MCDataStream initialize. >>>> Beeper instVarNamed: #default put: nil. >>>> Smalltalk cleanOutUndeclared. >>>> 5 >>>> timesRepeat: [Smalltalk garbageCollect]. >>>> Author reset. >>>> KMPragmaKeymapBuilder release. >>>> self privShrinkUnicodeTables. >>>> Display newDepth: 1. >>>> self privCleanStartUpList. >>>> self privCleanShutDownList. >>>> Object >>>> subclass: #Model >>>> instanceVariableNames: 'dependents' >>>> classVariableNames: '' >>>> poolDictionaries: '' >>>> category: 'Kernel-Objects'. >>>> self privCleanTextConstants. >>>> SoundService default: nil. >>>> SoundService unregister: DummySoundSystem. >>>> ThreadSafeTranscript install. >>>> self privCleanUnloadMethods. >>>> SystemNavigation new removeAllButPackages: self >>>> kernelPackageNames. >>>> Smalltalk flushClassNameCache. >>>> 3 >>>> timesRepeat: [Smalltalk garbageCollect. >>>> Symbol compactSymbolTable]. >>>> Undeclared removeUnreferencedKeys. >>>> self privRecompileAll. >>>> self privCleanChangeSets. >>>> SystemEventManager allInstances >>>> do: [:i | i instVarNamed: #actionMap put: >>>> IdentityDictionary new]. >>>> FileServices removeObsolete. >>>> DebuggerMethodMap voidMapCache. >>>> Object flushEvents. >>>> MCDataStream initialize. >>>> Locale classPool at: #LocaleChangeListeners put: nil. >>>> SmalltalkImage classPool at: #Tools put: nil. >>>> Behavior flushObsoleteSubclasses. >>>> Smalltalk flushClassNameCache. >>>> Smalltalk organization removeEmptyCategories. >>>> WeakArray restartFinalizationProcess. >>>> Smalltalk saveImageInNewContext] in >>>> SmalltalkImage>>privShrinkingProcess >>>> 40 BlockClosure>>on:do: >>>> 41 BlockClosure>>ifError: >>>> 42 SmalltalkImage>>privShrinkingProcess >>>> 43 [self privShrinkingProcess] in SmalltalkImage>>shrinkToKernel >>>> 44 [self value. >>>> Processor terminateActive] in BlockClosure>>newProcess >>>> >>> >> >

July 29, 2012

Re: [Pharo-project] dirty package

by Sean P. DeNigris

Sean P. DeNigris wrote > > The magic invocation of URLTrigger configuration was: > * Inspect URL content > * Monitor a change of the content > I forgot to mention to also specify a cron-style frequency. Here (on Nabble) is a screenshot of a valid/working trigger configuration... http://forum.world.st/file/n4642069/Screen_Shot_2012-07-29_at_11.05.04_AM.p… Cheers, Sean -- View this message in context: http://forum.world.st/dirty-package-tp4641144p4642069.html Sent from the Pharo Smalltalk mailing list archive at Nabble.com.

July 29, 2012