Re: [Pharo-dev] mc.stfx.eu/ZincHTTPComponents missing files
Sven wrote:
I am working on it, the repo is currently broken...
Ok, I'll check tomorrow then. Stephan
The problem is fixed, the Zn CI build were suffering from the same problem and they are back up: https://ci.inria.fr/pharo-contribution/job/ZincHTTPComponents/ The issue was that mc.stfx.eu hit the 1000 items per query result of AWS S3 for the ZincHTTPComponents repository - I now have to do this by paging, joining multiple batches; luckily this can be done quite elegantly in Pharo. getVersionsFromRepository: repository | client versions query subResult | client := STfxMonticelloUtils s3Client. self crLog: 'Getting versions from S3: ', repository. query := Dictionary with: 'prefix' -> repository with: 'max-keys' -> '512'. subResult := #(). versions := Array streamContents: [ :out | [ subResult isEmpty ifFalse: [ query at: 'marker' put: subResult last key ]. subResult := client keysIn: STfxMonticelloUtils s3Bucket query: query. out nextPutAll: subResult. subResult isEmpty ] whileFalse ]. client close. versions := (versions collect: [ :each | (each key findTokens: '/') last ]) select: [ :each | STfxMonticelloUtils isValidMczName: each ]. ^ STfxMonticelloUtils sortVersions: versions On 25 Jun 2014, at 23:55, Stephan Eggermont <stephan@stack.nl> wrote:
Sven wrote:
I am working on it, the repo is currently broken...
Ok, I'll check tomorrow then.
Stephan
participants (2)
-
Stephan Eggermont -
Sven Van Caekenberghe