[Pharo-project] Monticello enhancement - Repository browser - faster loading of comment for review
This is a second idea for an enhancement to the Monticello Repository browser that at least myself and perhaps others would find useful. In the Monticello Repository browser, when a package has many new versions and I am wanting to review all of the comments for each package (both for curiosity and also trying to select which I want to load), it is time consuming to do this, having to wait for the selected version to download before seeing the comment, then select the next one and wait, then select the next one and wait, etc... It would be nice if all comments for the various versions could be downloaded in one go at the start - for example from a single file. I see two different ways this might be done. 1. Monticello clients downloads such information from the repository, updates it and then uploads it upon a Save or Copy. 2. A smart backend server process culls the information from the uploaded mcz files to build a single file. However when I say 'single file', when the incremental comments build to some maximum size, that incremental file could be archived to a static version which clients would keep hold of, and roll over to a fresh 'incremental' file) I hope that makes sense, cheers -ben btw, I didn't chime in before but congratulations with the 1.4 release. Its a bigger effort than I realized and I'm impressed. I'm looking for to using Pharo even more.
hi ben... what you talk about is almost done: - all files are downloaded and put into the local package-cache however: - MC always queries the server, even if the files exist locally - MC has to decode the complete version history even if you just want to see the commit message... fixes: - I made a local hack to make sure MC always queries the local repo first - when downloading versions don't re-serialize them again when saving to the local package-cache directly write out the loaded bytestream - Using a shared package-cache avoids downloading multiple times the same version - Maybe we should add a separate entry for an mzc which contains an isolated version info - Maybe we should just move to git :) (my premature version browses commits instantaneously) With the first two hacks I got nice performance when browsing history / commit messages. By having a shared package-cache I could improve the load-time roughly by a factor 5... best cami On 2012-04-20, at 15:46, Ben Coman wrote:
This is a second idea for an enhancement to the Monticello Repository browser that at least myself and perhaps others would find useful.
In the Monticello Repository browser, when a package has many new versions and I am wanting to review all of the comments for each package (both for curiosity and also trying to select which I want to load), it is time consuming to do this, having to wait for the selected version to download before seeing the comment, then select the next one and wait, then select the next one and wait, etc...
It would be nice if all comments for the various versions could be downloaded in one go at the start - for example from a single file. I see two different ways this might be done. 1. Monticello clients downloads such information from the repository, updates it and then uploads it upon a Save or Copy. 2. A smart backend server process culls the information from the uploaded mcz files to build a single file.
However when I say 'single file', when the incremental comments build to some maximum size, that incremental file could be archived to a static version which clients would keep hold of, and roll over to a fresh 'incremental' file)
I hope that makes sense, cheers -ben
btw, I didn't chime in before but congratulations with the 1.4 release. Its a bigger effort than I realized and I'm impressed. I'm looking for to using Pharo even more.
On Fri, Apr 20, 2012 at 5:42 PM, Camillo Bruni <camillobruni@gmail.com>wrote:
hi ben...
what you talk about is almost done:
- all files are downloaded and put into the local package-cache
however:
- MC always queries the server, even if the files exist locally - MC has to decode the complete version history even if you just want to see the commit message...
fixes:
- I made a local hack to make sure MC always queries the local repo first - when downloading versions don't re-serialize them again when saving to the local package-cache directly write out the loaded bytestream - Using a shared package-cache avoids downloading multiple times the same version - Maybe we should add a separate entry for an mzc which contains an isolated version info - Maybe we should just move to git :) (my premature version browses commits instantaneously)
With the first two hacks I got nice performance when browsing history / commit messages.
I need to quite frequently see the commit messages. Are your "hacks" available? should they be integrated?
By having a shared package-cache I could improve the load-time roughly by a factor 5...
best cami
On 2012-04-20, at 15:46, Ben Coman wrote:
This is a second idea for an enhancement to the Monticello Repository browser that at least myself and perhaps others would find useful.
In the Monticello Repository browser, when a package has many new versions and I am wanting to review all of the comments for each package (both for curiosity and also trying to select which I want to load), it is time consuming to do this, having to wait for the selected version to download before seeing the comment, then select the next one and wait, then select the next one and wait, etc...
It would be nice if all comments for the various versions could be downloaded in one go at the start - for example from a single file. I see two different ways this might be done. 1. Monticello clients downloads such information from the repository, updates it and then uploads it upon a Save or Copy. 2. A smart backend server process culls the information from the uploaded mcz files to build a single file.
However when I say 'single file', when the incremental comments build to some maximum size, that incremental file could be archived to a static version which clients would keep hold of, and roll over to a fresh 'incremental' file)
I hope that makes sense, cheers -ben
btw, I didn't chime in before but congratulations with the 1.4 release. Its a bigger effort than I realized and I'm impressed. I'm looking for to using Pharo even more.
-- Mariano http://marianopeck.wordpress.com
On 2012-04-20, at 17:45, Mariano Martinez Peck wrote:
On Fri, Apr 20, 2012 at 5:42 PM, Camillo Bruni <camillobruni@gmail.com> wrote: hi ben...
what you talk about is almost done:
- all files are downloaded and put into the local package-cache
however:
- MC always queries the server, even if the files exist locally - MC has to decode the complete version history even if you just want to see the commit message...
fixes:
- I made a local hack to make sure MC always queries the local repo first - when downloading versions don't re-serialize them again when saving to the local package-cache directly write out the loaded bytestream - Using a shared package-cache avoids downloading multiple times the same version - Maybe we should add a separate entry for an mzc which contains an isolated version info - Maybe we should just move to git :) (my premature version browses commits instantaneously)
With the first two hacks I got nice performance when browsing history / commit messages.
I need to quite frequently see the commit messages. Are your "hacks" available? should they be integrated?
ok let's clean them a bit :P, I overdid it a bit and accidentally broke some stuff :P
By having a shared package-cache I could improve the load-time roughly by a factor 5...
best cami
On 2012-04-20, at 15:46, Ben Coman wrote:
This is a second idea for an enhancement to the Monticello Repository browser that at least myself and perhaps others would find useful.
In the Monticello Repository browser, when a package has many new versions and I am wanting to review all of the comments for each package (both for curiosity and also trying to select which I want to load), it is time consuming to do this, having to wait for the selected version to download before seeing the comment, then select the next one and wait, then select the next one and wait, etc...
It would be nice if all comments for the various versions could be downloaded in one go at the start - for example from a single file. I see two different ways this might be done. 1. Monticello clients downloads such information from the repository, updates it and then uploads it upon a Save or Copy. 2. A smart backend server process culls the information from the uploaded mcz files to build a single file.
However when I say 'single file', when the incremental comments build to some maximum size, that incremental file could be archived to a static version which clients would keep hold of, and roll over to a fresh 'incremental' file)
I hope that makes sense, cheers -ben
btw, I didn't chime in before but congratulations with the 1.4 release. Its a bigger effort than I realized and I'm impressed. I'm looking for to using Pharo even more.
-- Mariano http://marianopeck.wordpress.com
On Fri, Apr 20, 2012 at 5:47 PM, Camillo Bruni <camillobruni@gmail.com>wrote:
On 2012-04-20, at 17:45, Mariano Martinez Peck wrote:
On Fri, Apr 20, 2012 at 5:42 PM, Camillo Bruni <camillobruni@gmail.com>
wrote:
hi ben...
what you talk about is almost done:
- all files are downloaded and put into the local package-cache
however:
- MC always queries the server, even if the files exist locally - MC has to decode the complete version history even if you just want to see the commit message...
fixes:
- I made a local hack to make sure MC always queries the local repo first - when downloading versions don't re-serialize them again when saving to the local package-cache directly write out the loaded bytestream - Using a shared package-cache avoids downloading multiple times the same version - Maybe we should add a separate entry for an mzc which contains an isolated version info - Maybe we should just move to git :) (my premature version browses commits instantaneously)
With the first two hacks I got nice performance when browsing history / commit messages.
I need to quite frequently see the commit messages. Are your "hacks" available? should they be integrated?
ok let's clean them a bit :P, I overdid it a bit and accidentally broke some stuff :P
please :) I have a 5gb shared package-cache and Monticello gets unusable :(
By having a shared package-cache I could improve the load-time roughly
by a factor 5...
best cami
On 2012-04-20, at 15:46, Ben Coman wrote:
This is a second idea for an enhancement to the Monticello Repository
browser that at least myself and perhaps others would find useful.
In the Monticello Repository browser, when a package has many new
versions and I am wanting to review all of the comments for each package (both for curiosity and also trying to select which I want to load), it is time consuming to do this, having to wait for the selected version to download before seeing the comment, then select the next one and wait, then select the next one and wait, etc...
It would be nice if all comments for the various versions could be
downloaded in one go at the start - for example from a single file. I see two different ways this might be done.
1. Monticello clients downloads such information from the repository, updates it and then uploads it upon a Save or Copy. 2. A smart backend server process culls the information from the uploaded mcz files to build a single file.
However when I say 'single file', when the incremental comments build to some maximum size, that incremental file could be archived to a static version which clients would keep hold of, and roll over to a fresh 'incremental' file)
I hope that makes sense, cheers -ben
btw, I didn't chime in before but congratulations with the 1.4 release. Its a bigger effort than I realized and I'm impressed. I'm looking for to using Pharo even more.
-- Mariano http://marianopeck.wordpress.com
-- Mariano http://marianopeck.wordpress.com
I just saw that it still works in the latest pharo :) Gofer new url: 'http://ss3.gemstone.com/ss/PharoInbox'; package: 'Monticello'; version: 'Monticello-CamilloBruni.585'; merge might have some bugs around :) On 2012-04-20, at 17:51, Mariano Martinez Peck wrote:
On Fri, Apr 20, 2012 at 5:47 PM, Camillo Bruni <camillobruni@gmail.com> wrote:
On 2012-04-20, at 17:45, Mariano Martinez Peck wrote:
On Fri, Apr 20, 2012 at 5:42 PM, Camillo Bruni <camillobruni@gmail.com> wrote: hi ben...
what you talk about is almost done:
- all files are downloaded and put into the local package-cache
however:
- MC always queries the server, even if the files exist locally - MC has to decode the complete version history even if you just want to see the commit message...
fixes:
- I made a local hack to make sure MC always queries the local repo first - when downloading versions don't re-serialize them again when saving to the local package-cache directly write out the loaded bytestream - Using a shared package-cache avoids downloading multiple times the same version - Maybe we should add a separate entry for an mzc which contains an isolated version info - Maybe we should just move to git :) (my premature version browses commits instantaneously)
With the first two hacks I got nice performance when browsing history / commit messages.
I need to quite frequently see the commit messages. Are your "hacks" available? should they be integrated?
ok let's clean them a bit :P, I overdid it a bit and accidentally broke some stuff :P
please :) I have a 5gb shared package-cache and Monticello gets unusable :(
By having a shared package-cache I could improve the load-time roughly by a factor 5...
best cami
On 2012-04-20, at 15:46, Ben Coman wrote:
This is a second idea for an enhancement to the Monticello Repository browser that at least myself and perhaps others would find useful.
In the Monticello Repository browser, when a package has many new versions and I am wanting to review all of the comments for each package (both for curiosity and also trying to select which I want to load), it is time consuming to do this, having to wait for the selected version to download before seeing the comment, then select the next one and wait, then select the next one and wait, etc...
It would be nice if all comments for the various versions could be downloaded in one go at the start - for example from a single file. I see two different ways this might be done. 1. Monticello clients downloads such information from the repository, updates it and then uploads it upon a Save or Copy. 2. A smart backend server process culls the information from the uploaded mcz files to build a single file.
However when I say 'single file', when the incremental comments build to some maximum size, that incremental file could be archived to a static version which clients would keep hold of, and roll over to a fresh 'incremental' file)
I hope that makes sense, cheers -ben
btw, I didn't chime in before but congratulations with the 1.4 release. Its a bigger effort than I realized and I'm impressed. I'm looking for to using Pharo even more.
-- Mariano http://marianopeck.wordpress.com
-- Mariano http://marianopeck.wordpress.com
participants (3)
-
Ben Coman -
Camillo Bruni -
Mariano Martinez Peck