November 2014 - Pharo-dev - lists.pharo.org

Re: [Pharo-dev] Should Nautilus use Rubric?

by Alain Plantec

TxModel implements the text model of TxText. http://smalltalkhub.com/mc/sig/TxText/main There is no direct relation with Rubric. TxText is a completely fresh text model whereas Rubric is a kind of fork of PluggableTextMorph. TxText is implemented with Athens and not Rubric. Cheers Alain > On 7 nov. 2014, at 14:29, Juraj Kubelka <juraj.kubelka(a)gmail.com> wrote: > > What is TxModel? Is it something which replaces Rubric? Or is it something we need to be able to integrate Rubric into Nautilus? What is the relation between TxModel and Rubric? > > Thanks! > Juraj > >> On Nov 7, 2014, at 10:24 AM, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: >> >> I would say yes. >> we would like to have rubric everywhere we need a real editor :) >> (while waiting for the new TxModel, this is the âless pain pathâ, IMO) >> >> Esteban >> >>> On 07 Nov 2014, at 14:07, Juraj Kubelka <juraj.kubelka(a)gmail.com> wrote: >>> >>> Hi! >>> >>> Is it worth to integrate Rubric into Nautilus? Or is there any reason not to do it? >>> >>> Thank you a lot! >>> Juraj >> >> > >

Nov. 7, 2014

Re: [Pharo-dev] Should Nautilus use Rubric?

by Norbert Hartl

I think we should submit TxModel to the vaporware awards 2014 :) Norbert > Am 07.11.2014 um 14:24 schrieb Esteban Lorenzano <estebanlm(a)gmail.com>: > > I would say yes. > we would like to have rubric everywhere we need a real editor :) > (while waiting for the new TxModel, this is the âless pain pathâ, IMO) > > Esteban > >> On 07 Nov 2014, at 14:07, Juraj Kubelka <juraj.kubelka(a)gmail.com> wrote: >> >> Hi! >> >> Is it worth to integrate Rubric into Nautilus? Or is there any reason not to do it? >> >> Thank you a lot! >> Juraj > >

Nov. 7, 2014

Re: [Pharo-dev] Should Nautilus use Rubric?

by Juraj Kubelka

What is TxModel? Is it something which replaces Rubric? Or is it something we need to be able to integrate Rubric into Nautilus? What is the relation between TxModel and Rubric? Thanks! Juraj > On Nov 7, 2014, at 10:24 AM, Esteban Lorenzano <estebanlm(a)gmail.com> wrote: > > I would say yes. > we would like to have rubric everywhere we need a real editor :) > (while waiting for the new TxModel, this is the âless pain pathâ, IMO) > > Esteban > >> On 07 Nov 2014, at 14:07, Juraj Kubelka <juraj.kubelka(a)gmail.com> wrote: >> >> Hi! >> >> Is it worth to integrate Rubric into Nautilus? Or is there any reason not to do it? >> >> Thank you a lot! >> Juraj > >

Nov. 7, 2014

Re: [Pharo-dev] Should Nautilus use Rubric?

by Esteban Lorenzano

I would say yes. we would like to have rubric everywhere we need a real editor :) (while waiting for the new TxModel, this is the âless pain pathâ, IMO) Esteban > On 07 Nov 2014, at 14:07, Juraj Kubelka <juraj.kubelka(a)gmail.com> wrote: > > Hi! > > Is it worth to integrate Rubric into Nautilus? Or is there any reason not to do it? > > Thank you a lot! > Juraj

Nov. 7, 2014

Re: [Pharo-dev] Should Nautilus use Rubric?

by Alain Plantec

Hi Juraj, Rubric is in the image because of GT but I guess GT will use TxText when it will be released as the default text editor. As a consequence, Rubric will be removed from the image. For the record, Rubric is the reimplementation of PluggableTextMorph. I consider it as an improvement over PluggableTextMorph but It uses the old text model. TxText is much more sexy :) So, I think it is not worth to integrate Rubric more. Cheers Alain > On 7 nov. 2014, at 14:07, Juraj Kubelka <juraj.kubelka(a)gmail.com> wrote: > > Hi! > > Is it worth to integrate Rubric into Nautilus? Or is there any reason not to do it? > > Thank you a lot! > Juraj

Nov. 7, 2014

Should Nautilus use Rubric?

by Juraj Kubelka

Hi! Is it worth to integrate Rubric into Nautilus? Or is there any reason not to do it? Thank you a lot! Juraj

Nov. 7, 2014

Re: [Pharo-dev] StandardFileStream>>open:forWrite: serious isse...

by Sven Van Caekenberghe

> On 07 Nov 2014, at 13:42, phil(a)highoctane.be wrote: > > I did tests like that and they work ok. > > I am still puzzled on why this happens in my code as only do these readStreamDo: [] and nothing is in parallel. > > I've been putting more caching in my own code but still, there is something hiding. Yes, I think so, happy hunting ;-) You could try to hunt for instances and references when the error occurs. > Phil > > > On Fri, Nov 7, 2014 at 1:27 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > > > On 07 Nov 2014, at 13:16, phil(a)highoctane.be wrote: > > > > I've now set ulimit -n 3000 and things are working. > > > > Sorry for the noise, but this GC thing is still weird. > > That would mean that you keep 1000s of files open concurrently. > > Anyway, I just wrote this as a test: > > '/tmp/pharo-files-test/' asFileReference ensureCreateDirectory in: [ :base | > 0 to: 99 do: [ :each | > base / each asString writeStreamDo: [ :out | > out print: each; crlf; << each asWords; crlf ] ] ]. > > 100000 timesRepeat: [ > | file | > file := 99 atRandom asString. > '/tmp/pharo-files-test/' asFileReference / file readStreamDo: [ :in | > self assert: (in upToEnd beginsWith: file) ] ] > > And it worked fine. > > > Phil > > > > > > On Fri, Nov 7, 2014 at 12:59 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > > Yes, weird code ;-) > > > > The registry seems unlimited, it is just a WeakRegistry. > > I guess the GC is there to trigger weak reference cleanup. > > On the other hand, there is always a limited on the number of open files at the OS level. > > > > The main thing is, if you use tons of (open) files, to always close them as fast as possible, and to not let that happen automatically or lose them in the case of exceptions. > > > > > On 07 Nov 2014, at 12:42, phil(a)highoctane.be wrote: > > > > > > Code (Transcript calls of mine) > > > > > > > > > open: fileName forWrite: writeMode > > > "Open the file with the given name. If writeMode is true, allow writing, otherwise open the file in read-only mode." > > > | f | > > > f := fileName asVmPathName. > > > Transcript log: 'File:', f. > > > > > > fileID := StandardFileStream retryWithGC:[self primOpen: f writable: writeMode] > > > until:[:id| id notNil] > > > forFileNamed: fileName. > > > fileID ifNil: [ > > > ' > Cannot get fileID' logCr. > > > ^ nil]. "allows sender to detect failure" > > > (' > Got fileID: ', fileID printString) logCr. > > > name := fileName. > > > self register. > > > rwmode := writeMode. > > > buffer1 := String new: 1. > > > self enableReadBuffering > > > > > > > > > I have a ton of files to open. And some were slow to return a problem. > > > > > > After digging, I got to the method above. > > > > > > Now at one moment, I get nil fileIDs. > > > > > > What is that retryWithGC: until: thing??? > > > > > > retryWithGC: execBlock until: testBlock forFileNamed: fullName > > > "Re-implemented to only force GC if a file with the given name exists" > > > | blockValue foundIt | > > > blockValue := execBlock value. > > > (testBlock value: blockValue) ifTrue:[^blockValue]. > > > "See if we have a file with the given name" > > > foundIt := self registry keys "hold on strongly for now" > > > anySatisfy:[:file| file name sameAs: fullName]. > > > foundIt ifFalse:[^blockValue]. > > > Smalltalk garbageCollectMost. > > > blockValue := execBlock value. > > > (testBlock value: blockValue) ifTrue:[^blockValue]. > > > Smalltalk garbageCollect. > > > ^execBlock value. > > > > > > > > > > > > Huhhhhh, yeah, some lookup going on in a registry... > > > > > > and GCs? For file opens? > > > > > > I am doing these opens in a webapp, what I want is to know if the file is there or not and fail fast, not have all of this thing (debugging kind of nightmarish...) > > > > > > I have tested with 100 files and of course it all works since I get the IDs back from the registry. > > > > > > But at one point, it all fails. Registry full? > > > > > > What to do here? > > > > > > TIA > > > Phil > > > > > > > > > > > > > > > > > > > > >

Nov. 7, 2014

Re: [Pharo-dev] StandardFileStream>>open:forWrite: serious isse...

by phil＠highoctane.be

I did tests like that and they work ok. I am still puzzled on why this happens in my code as only do these readStreamDo: [] and nothing is in parallel. I've been putting more caching in my own code but still, there is something hiding. Phil On Fri, Nov 7, 2014 at 1:27 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > > > On 07 Nov 2014, at 13:16, phil(a)highoctane.be wrote: > > > > I've now set ulimit -n 3000 and things are working. > > > > Sorry for the noise, but this GC thing is still weird. > > That would mean that you keep 1000s of files open concurrently. > > Anyway, I just wrote this as a test: > > '/tmp/pharo-files-test/' asFileReference ensureCreateDirectory in: [ :base > | > 0 to: 99 do: [ :each | > base / each asString writeStreamDo: [ :out | > out print: each; crlf; << each asWords; crlf ] ] ]. > > 100000 timesRepeat: [ > | file | > file := 99 atRandom asString. > '/tmp/pharo-files-test/' asFileReference / file readStreamDo: [ > :in | > self assert: (in upToEnd beginsWith: file) ] ] > > And it worked fine. > > > Phil > > > > > > On Fri, Nov 7, 2014 at 12:59 PM, Sven Van Caekenberghe <sven(a)stfx.eu> > wrote: > > Yes, weird code ;-) > > > > The registry seems unlimited, it is just a WeakRegistry. > > I guess the GC is there to trigger weak reference cleanup. > > On the other hand, there is always a limited on the number of open files > at the OS level. > > > > The main thing is, if you use tons of (open) files, to always close them > as fast as possible, and to not let that happen automatically or lose them > in the case of exceptions. > > > > > On 07 Nov 2014, at 12:42, phil(a)highoctane.be wrote: > > > > > > Code (Transcript calls of mine) > > > > > > > > > open: fileName forWrite: writeMode > > > "Open the file with the given name. If writeMode is true, allow > writing, otherwise open the file in read-only mode." > > > | f | > > > f := fileName asVmPathName. > > > Transcript log: 'File:', f. > > > > > > fileID := StandardFileStream retryWithGC:[self primOpen: f > writable: writeMode] > > > until:[:id| id notNil] > > > forFileNamed: fileName. > > > fileID ifNil: [ > > > ' > Cannot get fileID' logCr. > > > ^ nil]. "allows sender to detect failure" > > > (' > Got fileID: ', fileID printString) logCr. > > > name := fileName. > > > self register. > > > rwmode := writeMode. > > > buffer1 := String new: 1. > > > self enableReadBuffering > > > > > > > > > I have a ton of files to open. And some were slow to return a problem. > > > > > > After digging, I got to the method above. > > > > > > Now at one moment, I get nil fileIDs. > > > > > > What is that retryWithGC: until: thing??? > > > > > > retryWithGC: execBlock until: testBlock forFileNamed: fullName > > > "Re-implemented to only force GC if a file with the given name > exists" > > > | blockValue foundIt | > > > blockValue := execBlock value. > > > (testBlock value: blockValue) ifTrue:[^blockValue]. > > > "See if we have a file with the given name" > > > foundIt := self registry keys "hold on strongly for now" > > > anySatisfy:[:file| file name sameAs: fullName]. > > > foundIt ifFalse:[^blockValue]. > > > Smalltalk garbageCollectMost. > > > blockValue := execBlock value. > > > (testBlock value: blockValue) ifTrue:[^blockValue]. > > > Smalltalk garbageCollect. > > > ^execBlock value. > > > > > > > > > > > > Huhhhhh, yeah, some lookup going on in a registry... > > > > > > and GCs? For file opens? > > > > > > I am doing these opens in a webapp, what I want is to know if the file > is there or not and fail fast, not have all of this thing (debugging kind > of nightmarish...) > > > > > > I have tested with 100 files and of course it all works since I get > the IDs back from the registry. > > > > > > But at one point, it all fails. Registry full? > > > > > > What to do here? > > > > > > TIA > > > Phil > > > > > > > > > > > > > > > > > > > > >

Nov. 7, 2014

Re: [Pharo-dev] StandardFileStream>>open:forWrite: serious isse...

by Sven Van Caekenberghe

> On 07 Nov 2014, at 13:16, phil(a)highoctane.be wrote: > > I've now set ulimit -n 3000 and things are working. > > Sorry for the noise, but this GC thing is still weird. That would mean that you keep 1000s of files open concurrently. Anyway, I just wrote this as a test: '/tmp/pharo-files-test/' asFileReference ensureCreateDirectory in: [ :base | 0 to: 99 do: [ :each | base / each asString writeStreamDo: [ :out | out print: each; crlf; << each asWords; crlf ] ] ]. 100000 timesRepeat: [ | file | file := 99 atRandom asString. '/tmp/pharo-files-test/' asFileReference / file readStreamDo: [ :in | self assert: (in upToEnd beginsWith: file) ] ] And it worked fine. > Phil > > > On Fri, Nov 7, 2014 at 12:59 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > Yes, weird code ;-) > > The registry seems unlimited, it is just a WeakRegistry. > I guess the GC is there to trigger weak reference cleanup. > On the other hand, there is always a limited on the number of open files at the OS level. > > The main thing is, if you use tons of (open) files, to always close them as fast as possible, and to not let that happen automatically or lose them in the case of exceptions. > > > On 07 Nov 2014, at 12:42, phil(a)highoctane.be wrote: > > > > Code (Transcript calls of mine) > > > > > > open: fileName forWrite: writeMode > > "Open the file with the given name. If writeMode is true, allow writing, otherwise open the file in read-only mode." > > | f | > > f := fileName asVmPathName. > > Transcript log: 'File:', f. > > > > fileID := StandardFileStream retryWithGC:[self primOpen: f writable: writeMode] > > until:[:id| id notNil] > > forFileNamed: fileName. > > fileID ifNil: [ > > ' > Cannot get fileID' logCr. > > ^ nil]. "allows sender to detect failure" > > (' > Got fileID: ', fileID printString) logCr. > > name := fileName. > > self register. > > rwmode := writeMode. > > buffer1 := String new: 1. > > self enableReadBuffering > > > > > > I have a ton of files to open. And some were slow to return a problem. > > > > After digging, I got to the method above. > > > > Now at one moment, I get nil fileIDs. > > > > What is that retryWithGC: until: thing??? > > > > retryWithGC: execBlock until: testBlock forFileNamed: fullName > > "Re-implemented to only force GC if a file with the given name exists" > > | blockValue foundIt | > > blockValue := execBlock value. > > (testBlock value: blockValue) ifTrue:[^blockValue]. > > "See if we have a file with the given name" > > foundIt := self registry keys "hold on strongly for now" > > anySatisfy:[:file| file name sameAs: fullName]. > > foundIt ifFalse:[^blockValue]. > > Smalltalk garbageCollectMost. > > blockValue := execBlock value. > > (testBlock value: blockValue) ifTrue:[^blockValue]. > > Smalltalk garbageCollect. > > ^execBlock value. > > > > > > > > Huhhhhh, yeah, some lookup going on in a registry... > > > > and GCs? For file opens? > > > > I am doing these opens in a webapp, what I want is to know if the file is there or not and fail fast, not have all of this thing (debugging kind of nightmarish...) > > > > I have tested with 100 files and of course it all works since I get the IDs back from the registry. > > > > But at one point, it all fails. Registry full? > > > > What to do here? > > > > TIA > > Phil > > > > > > > > > > >

Nov. 7, 2014

Re: [Pharo-dev] StandardFileStream>>open:forWrite: serious isse...

by phil＠highoctane.be

I've now set ulimit -n 3000 and things are working. Sorry for the noise, but this GC thing is still weird. Phil On Fri, Nov 7, 2014 at 12:59 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > Yes, weird code ;-) > > The registry seems unlimited, it is just a WeakRegistry. > I guess the GC is there to trigger weak reference cleanup. > On the other hand, there is always a limited on the number of open files > at the OS level. > > The main thing is, if you use tons of (open) files, to always close them > as fast as possible, and to not let that happen automatically or lose them > in the case of exceptions. > > > On 07 Nov 2014, at 12:42, phil(a)highoctane.be wrote: > > > > Code (Transcript calls of mine) > > > > > > open: fileName forWrite: writeMode > > "Open the file with the given name. If writeMode is true, allow > writing, otherwise open the file in read-only mode." > > | f | > > f := fileName asVmPathName. > > Transcript log: 'File:', f. > > > > fileID := StandardFileStream retryWithGC:[self primOpen: f > writable: writeMode] > > until:[:id| id notNil] > > forFileNamed: fileName. > > fileID ifNil: [ > > ' > Cannot get fileID' logCr. > > ^ nil]. "allows sender to detect failure" > > (' > Got fileID: ', fileID printString) logCr. > > name := fileName. > > self register. > > rwmode := writeMode. > > buffer1 := String new: 1. > > self enableReadBuffering > > > > > > I have a ton of files to open. And some were slow to return a problem. > > > > After digging, I got to the method above. > > > > Now at one moment, I get nil fileIDs. > > > > What is that retryWithGC: until: thing??? > > > > retryWithGC: execBlock until: testBlock forFileNamed: fullName > > "Re-implemented to only force GC if a file with the given name > exists" > > | blockValue foundIt | > > blockValue := execBlock value. > > (testBlock value: blockValue) ifTrue:[^blockValue]. > > "See if we have a file with the given name" > > foundIt := self registry keys "hold on strongly for now" > > anySatisfy:[:file| file name sameAs: fullName]. > > foundIt ifFalse:[^blockValue]. > > Smalltalk garbageCollectMost. > > blockValue := execBlock value. > > (testBlock value: blockValue) ifTrue:[^blockValue]. > > Smalltalk garbageCollect. > > ^execBlock value. > > > > > > > > Huhhhhh, yeah, some lookup going on in a registry... > > > > and GCs? For file opens? > > > > I am doing these opens in a webapp, what I want is to know if the file > is there or not and fail fast, not have all of this thing (debugging kind > of nightmarish...) > > > > I have tested with 100 files and of course it all works since I get the > IDs back from the registry. > > > > But at one point, it all fails. Registry full? > > > > What to do here? > > > > TIA > > Phil > > > > > > > > > > >

Nov. 7, 2014