August 2015 - Pharo-users - lists.pharo.org

Re: [Pharo-users] MongoDB: console commands? query embedded indexed fields?

by Norbert Hartl

Sabine, > Am 06.08.2015 um 14:49 schrieb Sabine Manaa <manaa.sabine(a)gmail.com>: > > Norbert, > > I have to come back to your answer. > > With the .explain option, I can see, how performance is with and without index on the _mongo console_. > As an example, I see: with index only 2 objects scanned, without: 200. Performance is perfect with index. > > But _from smalltalk_, it seems to iterate over all objects, also with the index set. Slow. > > You wrote: "The index will be selected automatically." It seems that it does not. > Usually it does. > My question: > MongoQuery has an attribute named "where" which is filled with the mentioned "receipts.receiptDescription". > Because of the name of this attribute "where" and the slow performance, I assume that the mongo classes use the $where command: > > http://docs.mongodb.org/manual/reference/operator/query/where/ <http://docs.mongodb.org/manual/reference/operator/query/where/> > > Is this right? > > In this case with the statement > Trip selectMany: { 'receipts.receiptDescription' -> 'Tankquittung' } asDictionary > the index would not be set automatically. > > "The $where provides greater flexibility, but requires that the database processes the JavaScript expression or function for each document in the collection. " > > Then my question is if the mongo classes support database queries with index and if yes, how. > > I am very interested in your opinion and I think other users should have the same requirements (querying indexed variables) - how did they solve this? > The handling of indexes needs to be automatic. The rule of thumb is that if you use where clause like b = , c = , a= than you need an compound index in the same order being index(b,c,a). This is handled by the database when it analyzes the query it tries to find an appropriate index. Or seeing it from the other side: If you issue a query with index and the index does not fit the query it is a problem anyway. Are you sure you have only this one thing in the where query? I use e.g. COInstalledApp selectOne: { 'device.id' -> aString. 'application.__id' -> anApplication voyageId } asDictionary on a collection that has approx. 1 Mio. entires and it is fast. I didn't check with explain but I'll do if I find time :) If I were you I would step in the debugger down to the Voyage part after serialization. Then you have the exact Dictionary that is used to send to mongo. You can then use this query to do an "explain" on it and that should show you something. Another thing you can try (although I don't think makes any difference) is to use the non-javascript query variant. That would be Trip selectMany: { 'receipts' -> { 'receiptDescription' -> 'Tankquittung' } asDictionary } asDictionary Norbert > Regards > Sabine > > 2015-08-04 14:47 GMT+02:00 Sabine Manaa <manaa.sabine(a)gmail.com <mailto:manaa.sabine@gmail.com>>: > > > > Hi Norbert, > > > > I didn't want to use "use database" for queries but for defining the index from within smalltalk. But if creating indexes is not supported, I will set the indexes within the mongo console. > > > > The explain option is very helpful I did not know this. > > > > Your answer was very helpful for me, thanks a lot! > > Sabine > > > > > > > > 2015-08-04 10:42 GMT+02:00 NorbertHartl [via Smalltalk] <[hidden email]>: > >> > >> Sabine, > >> > >> Am 04.08.2015 um 07:08 schrieb Sabine Manaa <[hidden email]>: > >> > >> Hi, > >> > >> I have 2 questions concerning use of mongoDB classes: > >> 1) how can I send mongo console commands directly from smalltalk > >> 2) how to query on an embedded collection with an index > >> > >> Model: > >> I have trips and each trip has an embedded collection of N receipts like > >> this: > >> { "tripName" : "trip 1", > >> {"receipts" : [ > >> {"receiptDescription" : "receipt 1" } > >> {"receiptDescription" : "receipt 2" } > >> {"receiptDescription" : "receipt 3" } ], > >> } > >> > >> Index: > >> For quick search, I created an index on the embeded[1] receipts with this > >> command at the mongoDB console in a terminal (NOT in smalltalk) > >> (mongo console starts with mongo in the MongoDB/bin dir): > >> > >> db.Trips.createIndex({"receipts.receiptDescription":1}) > >> > >> with a command like this in the mongoDB console > >> > >> db.Trips.find({"receipts.receiptDescription":"receipt 1"}) > >> > >> I get the resulting receipt. > >> > >> Before, I have to set the database with "use {databasename}" in thr mongodb > >> console > >> > >> My questions: > >> 1) how can I send mongo console commands directly from smalltalk, e.g. use > >> database, set index etc. > >> > >> > >> I don't know why you want to use "use database". For queries you don't need this because you choose the database and collection by using the smalltalk classes. You can look there if something you need exists. > >> Creating indexes is not yet supported. I want to do that myself. As always there seems to be to less people implementing stuff like that. > >> > >> Is this possible? > >> I did not succeed with the mongo command: method, it always returns "no such > >> cmd". > >> > >> 2) how can I search for a receipt which is indexed as described from > >> smalltalk? > >> > >> > >> A simple > >> > >> Trip selectMany: { 'receipts.receiptDescription' -> 'Tankquittung' } asDictionary > >> > >> should do. You can use just the nested properties form. The index will be selected automatically. If you are not sure about queries read about explain [1] to optimize that stuff. > >> > >> [1] http://docs.mongodb.org/manual/reference/method/cursor.explain/#cursor.expl… <http://docs.mongodb.org/manual/reference/method/cursor.explain/#cursor.expl…> > >> > >> Norbert > >> > >> > >> I did not succeed with the description [2] I am not sure if it is covered by > >> it. > >> > >> Regards > >> Sabine > >> > >> > >> [1] > >> http://docs.mongodb.org/manual/core/index-multikey/#index-arrays-with-embed… <http://docs.mongodb.org/manual/core/index-multikey/#index-arrays-with-embed…> > >> [2] http://smallworks.eu/web/blog/2013-07-18-Voyage-advanced-queries <http://smallworks.eu/web/blog/2013-07-18-Voyage-advanced-queries> > >> > >> > >> > >> -- > >> View this message in context: http://forum.world.st/MongoDB-console-commands-query-embedded-indexed-field… <http://forum.world.st/MongoDB-console-commands-query-embedded-indexed-field…> > >> Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. > >> > >> > >> > >> > >> ________________________________ > >> If you reply to this email, your message will be added to the discussion below: > >> http://forum.world.st/MongoDB-console-commands-query-embedded-indexed-field… <http://forum.world.st/MongoDB-console-commands-query-embedded-indexed-field…> > >> To start a new topic under Pharo Smalltalk Users, email [hidden email] > >> To unsubscribe from MongoDB: console commands? query embedded indexed fields?, click here. > >> NAML > > > > > > > > ________________________________ > > View this message in context: Re: MongoDB: console commands? query embedded indexed fields? > > > > Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.

Aug. 6, 2015

Re: [Pharo-users] MongoDB: console commands? query embedded indexed fields?

by phil＠highoctane.be

Hi Sabine, Not related to these indexes per se but I had performance problems associated with the fact that MongoTalk asked for all collections again and again. I cached them (in my own MongoTalk version) and added debugging to the MongoOperations so that I could see what was going on. This alone sped up the thing by a huge factor. My collections have more than 20-30K entries and I am querying them extensively. No perf problem even without the indexes. How many entries are you scanning? Phil On Thu, Aug 6, 2015 at 2:49 PM, Sabine Manaa <manaa.sabine(a)gmail.com> wrote: > Norbert, > > I have to come back to your answer. > > With the .explain option, I can see, how performance is with and without > index on the _mongo console_. > As an example, I see: with index only 2 objects scanned, without: 200. > Performance is perfect with index. > > But _from smalltalk_, it seems to iterate over all objects, also with the > index set. Slow. > > You wrote: "The index will be selected automatically." It seems that it > does not. > > My question: > MongoQuery has an attribute named "where" which is filled with the > mentioned "receipts.receiptDescription". > Because of the name of this attribute "where" and the slow performance, I > assume that the mongo classes use the $where command: > > http://docs.mongodb.org/manual/reference/operator/query/where/ > > Is this right? > > In this case with the statement > Trip selectMany: { 'receipts.receiptDescription' -> 'Tankquittung' } > asDictionary > the index would not be set automatically. > > "The $where provides greater flexibility, but requires that the database > processes the JavaScript expression or function for each document in the > collection. " > > Then my question is if the mongo classes support database queries with > index and if yes, how. > > I am very interested in your opinion and I think other users should have > the same requirements (querying indexed variables) - how did they solve > this? > > Regards > Sabine > > 2015-08-04 14:47 GMT+02:00 Sabine Manaa <manaa.sabine(a)gmail.com>: > > > > Hi Norbert, > > > > I didn't want to use "use database" for queries but for defining the > index from within smalltalk. But if creating indexes is not supported, I > will set the indexes within the mongo console. > > > > The explain option is very helpful I did not know this. > > > > Your answer was very helpful for me, thanks a lot! > > Sabine > > > > > > > > 2015-08-04 10:42 GMT+02:00 NorbertHartl [via Smalltalk] <[hidden email]>: > >> > >> Sabine, > >> > >> Am 04.08.2015 um 07:08 schrieb Sabine Manaa <[hidden email]>: > >> > >> Hi, > >> > >> I have 2 questions concerning use of mongoDB classes: > >> 1) how can I send mongo console commands directly from smalltalk > >> 2) how to query on an embedded collection with an index > >> > >> Model: > >> I have trips and each trip has an embedded collection of N receipts like > >> this: > >> { "tripName" : "trip 1", > >> {"receipts" : [ > >> {"receiptDescription" : "receipt 1" } > >> {"receiptDescription" : "receipt 2" } > >> {"receiptDescription" : "receipt 3" } ], > >> } > >> > >> Index: > >> For quick search, I created an index on the embeded[1] receipts with > this > >> command at the mongoDB console in a terminal (NOT in smalltalk) > >> (mongo console starts with mongo in the MongoDB/bin dir): > >> > >> db.Trips.createIndex({"receipts.receiptDescription":1}) > >> > >> with a command like this in the mongoDB console > >> > >> db.Trips.find({"receipts.receiptDescription":"receipt 1"}) > >> > >> I get the resulting receipt. > >> > >> Before, I have to set the database with "use {databasename}" in thr > mongodb > >> console > >> > >> My questions: > >> 1) how can I send mongo console commands directly from smalltalk, e.g. > use > >> database, set index etc. > >> > >> > >> I don't know why you want to use "use database". For queries you don't > need this because you choose the database and collection by using the > smalltalk classes. You can look there if something you need exists. > >> Creating indexes is not yet supported. I want to do that myself. As > always there seems to be to less people implementing stuff like that. > >> > >> Is this possible? > >> I did not succeed with the mongo command: method, it always returns "no > such > >> cmd". > >> > >> 2) how can I search for a receipt which is indexed as described from > >> smalltalk? > >> > >> > >> A simple > >> > >> Trip selectMany: { 'receipts.receiptDescription' -> 'Tankquittung' } > asDictionary > >> > >> should do. You can use just the nested properties form. The index will > be selected automatically. If you are not sure about queries read about > explain [1] to optimize that stuff. > >> > >> [1] > http://docs.mongodb.org/manual/reference/method/cursor.explain/#cursor.expl… > >> > >> Norbert > >> > >> > >> I did not succeed with the description [2] I am not sure if it is > covered by > >> it. > >> > >> Regards > >> Sabine > >> > >> > >> [1] > >> > http://docs.mongodb.org/manual/core/index-multikey/#index-arrays-with-embed… > >> [2] http://smallworks.eu/web/blog/2013-07-18-Voyage-advanced-queries > >> > >> > >> > >> -- > >> View this message in context: > http://forum.world.st/MongoDB-console-commands-query-embedded-indexed-field… > >> Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. > >> > >> > >> > >> > >> ________________________________ > >> If you reply to this email, your message will be added to the > discussion below: > >> > http://forum.world.st/MongoDB-console-commands-query-embedded-indexed-field… > >> To start a new topic under Pharo Smalltalk Users, email [hidden email] > >> To unsubscribe from MongoDB: console commands? query embedded indexed > fields?, click here. > >> NAML > > > > > > > > ________________________________ > > View this message in context: Re: MongoDB: console commands? query > embedded indexed fields? > > > > Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. >

Aug. 6, 2015

Re: [Pharo-users] MongoDB: console commands? query embedded indexed fields?

by Sabine Manaa

Norbert, I have to come back to your answer. With the .explain option, I can see, how performance is with and without index on the _mongo console_. As an example, I see: with index only 2 objects scanned, without: 200. Performance is perfect with index. But _from smalltalk_, it seems to iterate over all objects, also with the index set. Slow. You wrote: "The index will be selected automatically." It seems that it does not. My question: MongoQuery has an attribute named "where" which is filled with the mentioned "receipts.receiptDescription". Because of the name of this attribute "where" and the slow performance, I assume that the mongo classes use the $where command: http://docs.mongodb.org/manual/reference/operator/query/where/ Is this right? In this case with the statement Trip selectMany: { 'receipts.receiptDescription' -> 'Tankquittung' } asDictionary the index would not be set automatically. "The $where provides greater flexibility, but requires that the database processes the JavaScript expression or function for each document in the collection. " Then my question is if the mongo classes support database queries with index and if yes, how. I am very interested in your opinion and I think other users should have the same requirements (querying indexed variables) - how did they solve this? Regards Sabine 2015-08-04 14:47 GMT+02:00 Sabine Manaa <manaa.sabine(a)gmail.com>: > > Hi Norbert, > > I didn't want to use "use database" for queries but for defining the index from within smalltalk. But if creating indexes is not supported, I will set the indexes within the mongo console. > > The explain option is very helpful I did not know this. > > Your answer was very helpful for me, thanks a lot! > Sabine > > > > 2015-08-04 10:42 GMT+02:00 NorbertHartl [via Smalltalk] <[hidden email]>: >> >> Sabine, >> >> Am 04.08.2015 um 07:08 schrieb Sabine Manaa <[hidden email]>: >> >> Hi, >> >> I have 2 questions concerning use of mongoDB classes: >> 1) how can I send mongo console commands directly from smalltalk >> 2) how to query on an embedded collection with an index >> >> Model: >> I have trips and each trip has an embedded collection of N receipts like >> this: >> { "tripName" : "trip 1", >> {"receipts" : [ >> {"receiptDescription" : "receipt 1" } >> {"receiptDescription" : "receipt 2" } >> {"receiptDescription" : "receipt 3" } ], >> } >> >> Index: >> For quick search, I created an index on the embeded[1] receipts with this >> command at the mongoDB console in a terminal (NOT in smalltalk) >> (mongo console starts with mongo in the MongoDB/bin dir): >> >> db.Trips.createIndex({"receipts.receiptDescription":1}) >> >> with a command like this in the mongoDB console >> >> db.Trips.find({"receipts.receiptDescription":"receipt 1"}) >> >> I get the resulting receipt. >> >> Before, I have to set the database with "use {databasename}" in thr mongodb >> console >> >> My questions: >> 1) how can I send mongo console commands directly from smalltalk, e.g. use >> database, set index etc. >> >> >> I don't know why you want to use "use database". For queries you don't need this because you choose the database and collection by using the smalltalk classes. You can look there if something you need exists. >> Creating indexes is not yet supported. I want to do that myself. As always there seems to be to less people implementing stuff like that. >> >> Is this possible? >> I did not succeed with the mongo command: method, it always returns "no such >> cmd". >> >> 2) how can I search for a receipt which is indexed as described from >> smalltalk? >> >> >> A simple >> >> Trip selectMany: { 'receipts.receiptDescription' -> 'Tankquittung' } asDictionary >> >> should do. You can use just the nested properties form. The index will be selected automatically. If you are not sure about queries read about explain [1] to optimize that stuff. >> >> [1] http://docs.mongodb.org/manual/reference/method/cursor.explain/#cursor.expl… >> >> Norbert >> >> >> I did not succeed with the description [2] I am not sure if it is covered by >> it. >> >> Regards >> Sabine >> >> >> [1] >> http://docs.mongodb.org/manual/core/index-multikey/#index-arrays-with-embed… >> [2] http://smallworks.eu/web/blog/2013-07-18-Voyage-advanced-queries >> >> >> >> -- >> View this message in context: http://forum.world.st/MongoDB-console-commands-query-embedded-indexed-field… >> Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. >> >> >> >> >> ________________________________ >> If you reply to this email, your message will be added to the discussion below: >> http://forum.world.st/MongoDB-console-commands-query-embedded-indexed-field… >> To start a new topic under Pharo Smalltalk Users, email [hidden email] >> To unsubscribe from MongoDB: console commands? query embedded indexed fields?, click here. >> NAML > > > > ________________________________ > View this message in context: Re: MongoDB: console commands? query embedded indexed fields? > > Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.

Aug. 6, 2015

Re: [Pharo-users] OSProcess crashes when launching a command

by Thierry Goubier

Hi Damien, Le 05/08/2015 22:13, Damien Cassou a Ã©crit : > > Hi Thierry, > > Thierry Goubier <thierry.goubier(a)gmail.com> writes: > >> do you have other OSProcess commands crashing in the same way? > > I tried with hellowWorld, helloStderr, chDir and getCwd, all of them > work fine. > Ok, I tried on my system (ubuntu 15.04 64bits) and it doesn't crash in 40617, with vmLatest (jenkins build #14975). Can you try with a 4.0+vmLatest image and vm? Thierry

Aug. 5, 2015

Re: [Pharo-users] Git Topic Branches and CI

by Sean P. DeNigris

Thierry Goubier wrote > I don't know how to do the same with Jenkins. This sounds promising: https://wiki.jenkins-ci.org/display/JENKINS/Multi-Branch+Project+Plugin ----- Cheers, Sean -- View this message in context: http://forum.world.st/Git-Topic-Branches-and-CI-tp4841141p4841159.html Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.

Aug. 5, 2015

Re: [Pharo-users] OSProcess crashes when launching a command

by Damien Cassou

Hi Thierry, Thierry Goubier <thierry.goubier(a)gmail.com> writes: > do you have other OSProcess commands crashing in the same way? I tried with hellowWorld, helloStderr, chDir and getCwd, all of them work fine. -- Damien Cassou http://damiencassou.seasidehosting.st "Success is the ability to go from one failure to another without losing enthusiasm." --Winston Churchill

Aug. 5, 2015

Re: [Pharo-users] Help for #fullscreen window

by Jigyasa Grover

Thank You Sir :) It does almost what I desire . Regards Jigyasa -- View this message in context: http://forum.world.st/Help-for-fullscreen-window-tp4841116p4841156.html Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.

Aug. 5, 2015

Re: [Pharo-users] Help for #fullscreen window

by Thierry Goubier

Hi jigyasa, You have an openFullScreen method somewhere, which really opens full screen (and makes it hard to close;) ). Thierry Le 5 aoÃ»t 2015 5:30 PM, "Jigyasa Grover" <grover.jigyasa1(a)gmail.com> a Ã©crit : > Hi ! > I am using *WidgetExamples exampleBuilder* to make an accordion widget. I > open a model *newPluggableWindow* in it, and would like it to be a > fullscreen entity. > I have tried all the methods, *#fullscreen *and *#extent* but in vain. It > would be great if anyone could help. > > The code snippet is as : > > *printSearchResults* > > *self open. * > *SearchQuick searchQuick: self myString. * > *builder := WidgetExamples exampleBuilder.* > *dialog := (builder newPluggableDialogWindow: 'SEARCH RESULTS FOR " ', > myString , ' " ').* > *searchResultsAccordion := dialog contentMorph:* > *(* > * dialog newColumn: { * > * dialog newColumn: * > * (* > * SearchQuick myResult collect: [ :r |* > * dialog newRow: {* > * (* > * (* > * dialog newExpander: r title asString* > * forAll: { * > * ( dialog newTextEditorFor: ( ValueHolder new contents: r content > asString )* > * getText: #contents setText: #contents: )minHeight: 150.* > * }* > * )minWidth:750; minHeight: 10* > * )* > * cellInset: 0;* > * borderStyle: (BorderStyle inset baseColor: dialog paneColor; width: 1)* > * } * > * ]* > * ) .* > * backBtn := dialog newButtonFor: self action: #backButtonClicked label: > 'Back' help: 'Back'.* > * backBtn extent: 750(a)30.* > * }* > * ); minWidth: World extent x; minHeight: World extent y;* > > * model: nil.* > * searchResultsAccordion position: 0(a)0.* > * searchResultsAccordion extent: World extent.* > * searchResultsAccordion width: World extent x.* > * searchResultsAccordion height: World extent y.* > * builder newScrollPaneFor: searchResultsAccordion.* > * dialog position: 0(a)0.* > * dialog extent: World extent.* > * builder openModal: dialog.* > * dialog newScrollPaneFor: searchResultsAccordion .* > > > Regards > Jigyasa >

Aug. 5, 2015

Re: [Pharo-users] Git Topic Branches and CI

by Thierry Goubier

Le 5 aoÃ»t 2015 7:55 PM, "Sean P. DeNigris" <sean(a)clipperadams.com> a Ã©crit : > > When using a branch-per-issue, it's not so easy to define #development a la > Metacello. How are you handling this? Are you somehow dynamically doing a > CI-build-per-branch? If you use Travis as CI as in filetree on github, you get one CI build per branch. I don't know how to do the same with Jenkins. Thierry > > > ----- > Cheers, > Sean > -- > View this message in context: http://forum.world.st/Git-Topic-Branches-and-CI-tp4841141.html > Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. >

Aug. 5, 2015

Re: [Pharo-users] Modern Events Touch and Gestures in Pharo.

by Alexandre Bergel

Impressive!!! Dreaming about that to use in Roassal Alexandre -- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. > On Aug 5, 2015, at 2:20 PM, Dimitris Chloupis <kilon.alios(a)gmail.com> wrote: > > this awesome , great work :) > > On Tue, Jun 30, 2015 at 8:18 PM stepharo <stepharo(a)free.fr <mailto:stepharo@free.fr>> wrote: > Thanks Thales for the sponsoring. > > https://youtu.be/eNrbH8A5nyY <https://youtu.be/eNrbH8A5nyY> > > Stef and the rmod team >

Aug. 5, 2015