February 2016 - Pharo-dev - lists.pharo.org

Re: [Pharo-dev] [ANN] The Pharo Unicode Project

by stepharo

I ***LOVE*** the documentation :) Le 17/2/16 10:16, Sven Van Caekenberghe a Ã©crit : > Hi, > > In Pharo we can deal with and represent any Unicode character and string, but there are still some important pieces of functionality missing. > > The goal of the Pharo Unicode project is to gradually improve and expand Unicode support in Pharo. We started in December last year to lay the foundation and are now ready to go public with what we built. > > The first delivery is an implementation of Unicode Normalization, together with an implementation of the Unicode Character Database. > > Please read the following article for more information (the appendix explains how to get the code). > > An Implementation of Unicode Normalisation > > Streaming NFC, NFD, NFKC & NFKD, normalization QC and normalization preserving concatenation. > > https://medium.com/concerning-pharo/an-implementation-of-unicode-normalizat… > > The development branch also contains a work in progress implementation of Unicode Collation. > > Much work remains to be done and contributions are more than welcome. > > Sven & Henrik >

Feb. 18, 2016

Re: [Pharo-dev] [ANN] The Pharo Unicode Project

by stepharo

Super cool! Stef Le 17/2/16 10:16, Sven Van Caekenberghe a Ã©crit : > Hi, > > In Pharo we can deal with and represent any Unicode character and string, but there are still some important pieces of functionality missing. > > The goal of the Pharo Unicode project is to gradually improve and expand Unicode support in Pharo. We started in December last year to lay the foundation and are now ready to go public with what we built. > > The first delivery is an implementation of Unicode Normalization, together with an implementation of the Unicode Character Database. > > Please read the following article for more information (the appendix explains how to get the code). > > An Implementation of Unicode Normalisation > > Streaming NFC, NFD, NFKC & NFKD, normalization QC and normalization preserving concatenation. > > https://medium.com/concerning-pharo/an-implementation-of-unicode-normalizat… > > The development branch also contains a work in progress implementation of Unicode Collation. > > Much work remains to be done and contributions are more than welcome. > > Sven & Henrik >

Feb. 18, 2016

Re: [Pharo-dev] [ANN] The Pharo Unicode Project

by Sven Van Caekenberghe

Here is a quick & dirty version without error checking: | codePoint ucd name hex url | codePoint := 180. codePoint := 8491. ucd := codePoint unicodeCharacterData. name := $_ join: (Character space split: ucd name asLowercase). hex := String streamContents: [ :out | codePoint printOn: out base: 16 nDigits: 4 ]. url := 'http://www.fileformat.info/info/unicode/char/{1}/{2}.png' format: { hex. name }. ZnEasy getPng: url. They seem to be adding a watermark if you do it like this, but not all the time. > On 18 Feb 2016, at 20:24, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > >> >> On 18 Feb 2016, at 18:13, Ben Coman <btc(a)openinworld.com> wrote: >> >> On Thu, Feb 18, 2016 at 10:52 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: >>> Ben, >>> >>>> On 18 Feb 2016, at 02:05, Ben Coman <btc(a)openInWorld.com> wrote: >>>> >>>> On Wed, Feb 17, 2016 at 5:16 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: >>>>> Hi, >>>>> >>>>> In Pharo we can deal with and represent any Unicode character and string, but there are still some important pieces of functionality missing. >>>>> >>>>> The goal of the Pharo Unicode project is to gradually improve and expand Unicode support in Pharo. We started in December last year to lay the foundation and are now ready to go public with what we built. >>>>> >>>>> The first delivery is an implementation of Unicode Normalization, together with an implementation of the Unicode Character Database. >>>>> >>>>> Please read the following article for more information (the appendix explains how to get the code). >>>>> >>>>> An Implementation of Unicode Normalisation >>>>> >>>>> Streaming NFC, NFD, NFKC & NFKD, normalization QC and normalization preserving concatenation. >>>>> >>>>> https://medium.com/concerning-pharo/an-implementation-of-unicode-normalizat… >>>>> >>>>> The development branch also contains a work in progress implementation of Unicode Collation. >>>>> >>>>> Much work remains to be done and contributions are more than welcome. >>>>> >>>>> Sven & Henrik >>>> >>>> This is really great. Thanks Sven & Henrik. >>> >>> You're welcome. >>> >>>>> The right pane shows a large glyph view of the character involved. >>>> >>>> This is very cool !! >>>> Does it rely on font support, or is it bitmap or SVG based? >>> >>> Currently, we just use what Pharo can do (it thus depends on your font and even then the layout is often wrong in special cases, something we need to fix as well). >>> >>>> Maybe it could dynamically download SVG data as needed from somewhere >>>> like here... >>>> http://www.fileformat.info/info/unicode/char/00f6/index.htm >>> >>> Wow, I was looking for something like that, but I didn't know it existed. >>> >>> Can we somehow directly use SVG in Pharo ? >>> >>> On this page [http://www.fileformat.info/info/unicode/index.htm] they say that they got all their info from unicode.org but I can't seem to find the SVG data there. You seem to be good in finding stuff ;-) >> >> aH-Har! A challenge! but I did not succeed. > > I thought you would write a complete solution in Pharo, oh well ;-) > >> The Unicode Code Charts >> [1] seem available only in PDF form (e.g. [2]) . Indeed it says "The >> fonts and font data used in production of the Unicode Standard may not >> be extracted, or used in any way in any product or publication, >> without permission or license granted by the typeface owner(s)." >> >> [1] http://unicode.org/charts/About.html >> [2] http://unicode.org/charts/PDF/U0100.pdf >> >> Though I discovered a few other interesting resources... >> >> Fallback font >> https://en.wikipedia.org/wiki/Fallback_font >> >> Last Resort Font >> http://www.unicode.org/policies/lastresortfont_eula.html >> >> Scriptsource - Unicode Character Browsing >> http://scriptsource.org/cms/scripts/page.php?item_id=entry_detail&uid=tubkv… >> >> Javascript Unibook 4.0 Character Browser >> http://www.soldin.de/about/2003-js_unibook/ >> >> decodeunicode >> http://www.decodeunicode.org/ > > Yeah, good links. > > This site seems to be able to generate .png's for each glyph > > http://r12a.github.io/uniview/ > > Though the URLs are not straightforward and probably not meant to be used as web service. > > Maybe this is usable: > > https://en.wikipedia.org/wiki/GNU_Unifont > >> HTH, cheers -ben >> >>> >>> In any case, it would be very cool to have something like that as a fall back. >>> >>>>> We also added an extension to our environmentâs search system to allow you to look up characters by name: >>>> >>>> Is there a #unicode filter for Spotter? >>> >>> That comes for free. >>> >>>> check repeated phrase... >>>>> and replace it with and replace it with >>> >>> Fixed, thanks. >>> >>>> I bumped into an interesting "Good, Bad, Ugly" comparison of Unicode >>>> support in other programming languages (though circa 2011) >>>> https://www.azabani.com/pages/gbu/ >>> >>> Reading it. >>> >>>> and this sparked a thought to wonder if the consortium would consider >>>> it worthwhile paying someone external (like that author) with broad >>>> cross platform Unicode experience to consult on getting Pharo to a >>>> pragmatic point where we look attractive in such comparisons, which >>>> may also provide a side-channel advertisement for Pharo when such >>>> comparisons are presented at conferences (??) >>> >>> Maybe, I don't know if we should spent (marketing) money like that, but who knows. >>> >>>> cheers -ben >>> >>> Sven

Feb. 18, 2016

Re: [Pharo-dev] [ANN] The Pharo Unicode Project

by Sven Van Caekenberghe

> On 18 Feb 2016, at 18:13, Ben Coman <btc(a)openinworld.com> wrote: > > On Thu, Feb 18, 2016 at 10:52 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: >> Ben, >> >>> On 18 Feb 2016, at 02:05, Ben Coman <btc(a)openInWorld.com> wrote: >>> >>> On Wed, Feb 17, 2016 at 5:16 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: >>>> Hi, >>>> >>>> In Pharo we can deal with and represent any Unicode character and string, but there are still some important pieces of functionality missing. >>>> >>>> The goal of the Pharo Unicode project is to gradually improve and expand Unicode support in Pharo. We started in December last year to lay the foundation and are now ready to go public with what we built. >>>> >>>> The first delivery is an implementation of Unicode Normalization, together with an implementation of the Unicode Character Database. >>>> >>>> Please read the following article for more information (the appendix explains how to get the code). >>>> >>>> An Implementation of Unicode Normalisation >>>> >>>> Streaming NFC, NFD, NFKC & NFKD, normalization QC and normalization preserving concatenation. >>>> >>>> https://medium.com/concerning-pharo/an-implementation-of-unicode-normalizat… >>>> >>>> The development branch also contains a work in progress implementation of Unicode Collation. >>>> >>>> Much work remains to be done and contributions are more than welcome. >>>> >>>> Sven & Henrik >>> >>> This is really great. Thanks Sven & Henrik. >> >> You're welcome. >> >>>> The right pane shows a large glyph view of the character involved. >>> >>> This is very cool !! >>> Does it rely on font support, or is it bitmap or SVG based? >> >> Currently, we just use what Pharo can do (it thus depends on your font and even then the layout is often wrong in special cases, something we need to fix as well). >> >>> Maybe it could dynamically download SVG data as needed from somewhere >>> like here... >>> http://www.fileformat.info/info/unicode/char/00f6/index.htm >> >> Wow, I was looking for something like that, but I didn't know it existed. >> >> Can we somehow directly use SVG in Pharo ? >> >> On this page [http://www.fileformat.info/info/unicode/index.htm] they say that they got all their info from unicode.org but I can't seem to find the SVG data there. You seem to be good in finding stuff ;-) > > aH-Har! A challenge! but I did not succeed. I thought you would write a complete solution in Pharo, oh well ;-) > The Unicode Code Charts > [1] seem available only in PDF form (e.g. [2]) . Indeed it says "The > fonts and font data used in production of the Unicode Standard may not > be extracted, or used in any way in any product or publication, > without permission or license granted by the typeface owner(s)." > > [1] http://unicode.org/charts/About.html > [2] http://unicode.org/charts/PDF/U0100.pdf > > Though I discovered a few other interesting resources... > > Fallback font > https://en.wikipedia.org/wiki/Fallback_font > > Last Resort Font > http://www.unicode.org/policies/lastresortfont_eula.html > > Scriptsource - Unicode Character Browsing > http://scriptsource.org/cms/scripts/page.php?item_id=entry_detail&uid=tubkv… > > Javascript Unibook 4.0 Character Browser > http://www.soldin.de/about/2003-js_unibook/ > > decodeunicode > http://www.decodeunicode.org/ Yeah, good links. This site seems to be able to generate .png's for each glyph http://r12a.github.io/uniview/ Though the URLs are not straightforward and probably not meant to be used as web service. Maybe this is usable: https://en.wikipedia.org/wiki/GNU_Unifont > HTH, cheers -ben > >> >> In any case, it would be very cool to have something like that as a fall back. >> >>>> We also added an extension to our environmentâs search system to allow you to look up characters by name: >>> >>> Is there a #unicode filter for Spotter? >> >> That comes for free. >> >>> check repeated phrase... >>>> and replace it with and replace it with >> >> Fixed, thanks. >> >>> I bumped into an interesting "Good, Bad, Ugly" comparison of Unicode >>> support in other programming languages (though circa 2011) >>> https://www.azabani.com/pages/gbu/ >> >> Reading it. >> >>> and this sparked a thought to wonder if the consortium would consider >>> it worthwhile paying someone external (like that author) with broad >>> cross platform Unicode experience to consult on getting Pharo to a >>> pragmatic point where we look attractive in such comparisons, which >>> may also provide a side-channel advertisement for Pharo when such >>> comparisons are presented at conferences (??) >> >> Maybe, I don't know if we should spent (marketing) money like that, but who knows. >> >>> cheers -ben >> >> Sven

Feb. 18, 2016

Re: [Pharo-dev] Spotter suggestion

by Tudor Girba

Hi, I found that the statement "the shortcuts are hidden if you do not know them by heartâ less adequate. So, it was not the suggestion, but the expectation that I referred to when I called for being reasonable :). Cheers, Doru > On Feb 18, 2016, at 1:57 PM, Guille Polito <guillermopolito(a)gmail.com> wrote: > > On 02/18/2016 01:40 PM, Tudor Girba wrote: >> Hi, >> >> Please, letâs be reasonable. > Wait, I do not see why I or my suggestion wouldn't be reasonable. > > I understand spotter as a tool to look for objects, that looks strongly designed to be used with the keyboard. However, to discover how to use it i have to use the mouse. > Am I correct? > > So I did a suggestion of how I think the situation could be improved. Adding an explicit action in the list of found results, and shortcuts at the right, like in menu items. >> We are talking about 5 actions. > talking? taking? >> Here is what we have now: >> - You now have a help describing them using the central help system (btw, that is not used by other tools except for the Settings Browser). > Which is great btw :) >> - All actions are visibly clickable through some button. I stress all because this was a design goal. > Well, to discern what is a button from what is not you should click... because there is no hover, border, background change... > Item icons look like buttons but they are not, still the visual metaphore is the same, which is strange... >> - The shortcuts are shown in the popup for each button. > Yeah, now I see them. But I did not want to use the mouse at all... >> - The popups appear faster and are larger than for the regular morphic tools so that you actually have a chance of using them and learning from them. > But, I have to use the mouse, in a tool that is supposed to be used quick with just keyboard. Or am I wrong? >> - If you press Shift you see all clickable buttons. > This does not work in linux... >> >> I am not saying that we cannot do better. > I know, perfection is of course the worse of evils. Ok, only after Cthulu. >> I am simply saying that we should be reasonable. > But I do not see why I wouldn't be reasonable. Was it an unreasonable suggestion? >> >> Cheers, >> Doru >> >> >>> On Feb 18, 2016, at 1:31 PM, Guille Polito <guillermopolito(a)gmail.com> wrote: >>> >>> Yeap, but it kind of kills the workflow... Why showing the shortcut in the tool is not an option? >>> >>> On 02/18/2016 01:18 PM, Tudor Girba wrote: >>>> Hi, >>>> >>>> Spotter from the latest Pharo has a help button with shortcuts explained. >>>> >>>> Cheers, >>>> Doru >>>> >>>> >>>>> On Feb 18, 2016, at 12:14 PM, Guille Polito <guillermopolito(a)gmail.com> wrote: >>>>> >>>>> Hi Doru et al! >>>>> >>>>> I was here having difficulties to see how to use spotter, and how to dive into, and show more results, because the shortcuts are hidden if you don't know them by heart. >>>>> >>>>> So I thought, why the spotter ui does not >>>>> - propose the shortcuts to dive at the right of the list? >>>>> - propose some extra items for e.g., show all items? >>>>> >>>>> Something like the attached picture... >>>>> >>>>> What do you think? >>>>> >>>>> Guille >>>>> <spotter.png> >>>> -- >>>> www.tudorgirba.com >>>> www.feenk.com >>>> >>>> "Not knowing how to do something is not an argument for how it cannot be done." >>>> >>>> >> -- >> www.tudorgirba.com >> www.feenk.com >> >> "In a world where everything is moving ever faster, >> one might have better chances to win by moving slower." >> >> >> >> > -- www.tudorgirba.com www.feenk.com "Problem solving should be focused on describing the problem in a way that makes the solution obvious."

Feb. 18, 2016

Re: [Pharo-dev] do-it-all-and-go in latest Pharo

by Peter UhnÃ¡k

Ah, ok. Thank you. On Thu, Feb 18, 2016 at 6:15 PM, Marcus Denker <marcus.denker(a)inria.fr> wrote: > Hi, > > most shortcuts with shift are broken. > > (eg. references-to). > > > https://pharo.fogbugz.com/f/cases/17593/matching-meta-with-ctrl-or-command-… > > > On 18 Feb 2016, at 18:11, Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: > > > > Hi, > > > > is do-it-all-and-go (ctrl+shift+g) broken in latest Pharo? (I saw some > threads about shortcuts, but none mentioning this). > > > > This is under linux. When used (whether ctrl+shift+g or alt+shift+g) it > just adds 'G' to the playground. > > Interestingly do-it-and-go (ctrl+g) works correctly. > > > > Thanks, > > Peter > > >

Feb. 18, 2016

Re: [Pharo-dev] FFI BoxedFloat64 bug?

by Esteban Lorenzano

Floats and doubles in C have different size, regardless the size of floats in pharo who are always 64bits. But a call to a function(float a) expects a 32bits float and not a 64bit so a cast needs to be done (automatically in FFI), now if you are calling a function(float *a) and you have a float=42.0 you have to pass an address with place to store 32bits, not 64bitsâ¦ so (ByteArray new: 4) floatAt: 1 put: 42.0 â¦ will do the job. But if you have a function(double *a), you need to do: (ByteArray new: 8) doubleAt: 1 put: 42.0 Nowâ¦ old nativeboost was prepared to do that conversion for you (if this was a good idea or not, is another story and needs to be told in another moment, and thread). So, to allow operations style: UNIXTime localTime: (UNIXTime getTime: nil) where: UNIXTime>>localTime: time ^ self ffiCall: #(tm* localtime(time_t* time) ) module: LibC and: getTime: t ^self ffiCall: #(time_t time(time_t* t) ) module: LibC options: #(+ optCoerceNilToNull) (from OS-Unix package) To work fine, I need to reproduce that behaviourâ¦ which is what the #rollToArity: method does. So yes, is usefulâ¦ very useful. > On 18 Feb 2016, at 17:51, Henrik Sperre Johansen <henrik.s.johansen(a)veloxit.no> wrote: > > I must admit, I don't get it either... > When you have a signature with a pointer to a primitive type, it's usually because > a) The method replaces the value > b) The method expects a pointer to an array with items of the primitive type. > > In neither case is automatic marshalling from Smalltalk type very useful. > > On Thu, Feb 18, 2016 at 4:33 PM, ClÃ©ment Bera <bera.clement(a)gmail.com <mailto:bera.clement@gmail.com>> wrote: > OK nevermind I got it now. I talked with Esteban. I had misunderstood. > > 2016-02-18 14:57 GMT+01:00 ClÃ©ment Bera <bera.clement(a)gmail.com <mailto:bera.clement@gmail.com>>: > I don't understand. > > In 32 bits in C, there are 32 bits float called "float" or "single precision float" but its usage is very uncommon. People always use "double" as every 32 bits processors supports 64 bits float nowadays. When I look at the Cairo reference manual, only double are used, so I don't understand why you need to cast BoxedFloat64 to single precision float for FFI. The ThreadedIA32FFIPlugin has both #ffiPushDoubleFloat:in: and ffiPushSingleFloat:in: so all the support seems to be available. > > Can you explain why by default you reduce the precision of float to 32 bits ? Is it because the library used expects a single precision float to be passed ? > > > > 2016-02-18 11:57 GMT+01:00 Esteban Lorenzano <estebanlm(a)gmail.com <mailto:estebanlm@gmail.com>>: > but in C (32bits) floats are 4 bytes, so when you do: > > ByteArray new > floatAt: 1 put: somePharoFloat; > > it will cast it to 4 bytes (if it fits which is most of the cases). > > but as I saidâ¦ it is an error I need to fix :) > > Esteban > > >> On 12 Feb 2016, at 20:50, ClÃ©ment Bera <bera.clement(a)gmail.com <mailto:bera.clement@gmail.com>> wrote: >> >> I don't understand. All BoxedFloat have 8 bytes, that's why they are called BoxedFloat64. There are no 4-bytes floats in Pharo. Even in 32 bits. >> >> 2016-02-12 18:06 GMT+01:00 Esteban Lorenzano <estebanlm(a)gmail.com <mailto:estebanlm@gmail.com>>: >> >>> On 12 Feb 2016, at 17:50, Aliaksei Syrel <alex.syrel(a)gmail.com <mailto:alex.syrel@gmail.com>> wrote: >>> >>> On Fri, Feb 12, 2016 at 5:45 PM, Esteban Lorenzano <estebanlm(a)gmail.com <mailto:estebanlm@gmail.com>> wrote: >>> Float>>#pointer >>> ^ (ByteArray new: FFIExternalType pointerSize) >>> floatAt: 1 put: self; >>> yourself >>> >>> Yes it does the trick :) Thanks! >> >> yes and no (I made a mistake): that works because incidentally pointers and floats have same size (4 bytes)â¦ but can happen that it is not (doubles have 8 bytes)â¦ but is ok for now :) >> I will fix it correctly next week. >> >> Esteban >> > > > >

Feb. 18, 2016

Re: [Pharo-dev] CI Slaves ?

by Marcus Denker

Hi, I think the main problem is that the image quits very often when running the CI job (due to a strange bug related to Rubric). see https://ci.inria.fr/pharo/view/5.0-Analysis/job/Pharo-5.0-Issue-Validator/ <https://ci.inria.fr/pharo/view/5.0-Analysis/job/Pharo-5.0-Issue-Validator/> with GTSUnitDebuggerSmokeTest>>#testAssertionEqualsDetectedSubscriptOutOfBounds: 1 OrderedCollection(Object)>>errorSubscriptBounds: OrderedCollection>>at: RubParagraph>>characterBlockForIndex: Message>>sendTo: [ aMessage sendTo: next ] in RubOpeningClosingDelimiterDecorator(RubParagraphDecorator)>>doesNotUnderstand: #characterBlockForIndex: in Block: [ aMessage sendTo: next ] BlockClosure>>on:do: RubOpeningClosingDelimiterDecorator(RubParagraphDecorator)>>doesNotUnderstand: #characterBlockForIndex: Message>>sendTo: [ aMessage sendTo: next ] in RubExtraSelectionDecorator(RubParagraphDecorator)>>doesNotUnderstand: #characterBlockForIndex: in Block: [ aMessage sendTo: next ] BlockClosure>>on:do: RubExtraSelectionDecorator(RubParagraphDecorator)>>doesNotUnderstand: #characterBlockForIndex: Message>>sendTo: [ aMessage sendTo: next ] in RubCurrentLineBarDecorator(RubParagraphDecorator)>>doesNotUnderstand: #characterBlockForIndex: in Block: [ aMessage sendTo: next ] BlockClosure>>on:do: RubCurrentLineBarDecorator(RubParagraphDecorator)>>doesNotUnderstand: #characterBlockForIndex: Message>>sendTo: [ aMessage sendTo: next ] in RubShoutStylerDecorator(RubParagraphDecorator)>>doesNotUnderstand: #characterBlockForIndex: in Block: [ aMessage sendTo: next ] BlockClosure>>on:do: RubShoutStylerDecorator(RubParagraphDecorator)>>doesNotUnderstand: #characterBlockForIndex: RubEditingState>>markIndex:pointIndex: [ self editingState markIndex: markIndex pointIndex: pointIndex ] in RubEditingArea(RubAbstractTextArea)>>markIndex:pointIndex: in Block: [ self editingState markIndex: markIndex pointInde...etc... RubEditingArea(RubAbstractTextArea)>>handleSelectionChange: RubEditingArea(RubAbstractTextArea)>>markIndex:pointIndex: RubEditingArea(RubAbstractTextArea)>>recomputeSelection RubShoutStylerDecorator>>stylerStyled: RubShoutStylerDecorator>>stylerStyledInBackground: [ self privateStyle: text. view ifNotNil: [ view stylerStyledInBackground: text ] ] in [ backgroundProcess := [ self privateStyle: text. view ifNotNil: [ view stylerStyledInBackground: text ] ] forkAt: Processor userBackgroundPriority ] in RubSHTextStylerST80(SHTextStyler)>>styleInBackgroundProcess: in Block: [ self privateStyle: text.... [ self value. Processor terminateActive ] in BlockClosure>>newProcess in Block: [ self value.... > On 18 Feb 2016, at 15:12, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > > The CI build slaves seem to be in a bad state, nothing much is happening, many are down ...

Feb. 18, 2016

Re: [Pharo-dev] do-it-all-and-go in latest Pharo

by Marcus Denker

Hi, most shortcuts with shift are broken. (eg. references-to). https://pharo.fogbugz.com/f/cases/17593/matching-meta-with-ctrl-or-command-… > On 18 Feb 2016, at 18:11, Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: > > Hi, > > is do-it-all-and-go (ctrl+shift+g) broken in latest Pharo? (I saw some threads about shortcuts, but none mentioning this). > > This is under linux. When used (whether ctrl+shift+g or alt+shift+g) it just adds 'G' to the playground. > Interestingly do-it-and-go (ctrl+g) works correctly. > > Thanks, > Peter

Feb. 18, 2016

Re: [Pharo-dev] [ANN] The Pharo Unicode Project

by Ben Coman

On Thu, Feb 18, 2016 at 10:52 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: > Ben, > >> On 18 Feb 2016, at 02:05, Ben Coman <btc(a)openInWorld.com> wrote: >> >> On Wed, Feb 17, 2016 at 5:16 PM, Sven Van Caekenberghe <sven(a)stfx.eu> wrote: >>> Hi, >>> >>> In Pharo we can deal with and represent any Unicode character and string, but there are still some important pieces of functionality missing. >>> >>> The goal of the Pharo Unicode project is to gradually improve and expand Unicode support in Pharo. We started in December last year to lay the foundation and are now ready to go public with what we built. >>> >>> The first delivery is an implementation of Unicode Normalization, together with an implementation of the Unicode Character Database. >>> >>> Please read the following article for more information (the appendix explains how to get the code). >>> >>> An Implementation of Unicode Normalisation >>> >>> Streaming NFC, NFD, NFKC & NFKD, normalization QC and normalization preserving concatenation. >>> >>> https://medium.com/concerning-pharo/an-implementation-of-unicode-normalizat… >>> >>> The development branch also contains a work in progress implementation of Unicode Collation. >>> >>> Much work remains to be done and contributions are more than welcome. >>> >>> Sven & Henrik >> >> This is really great. Thanks Sven & Henrik. > > You're welcome. > >>> The right pane shows a large glyph view of the character involved. >> >> This is very cool !! >> Does it rely on font support, or is it bitmap or SVG based? > > Currently, we just use what Pharo can do (it thus depends on your font and even then the layout is often wrong in special cases, something we need to fix as well). > >> Maybe it could dynamically download SVG data as needed from somewhere >> like here... >> http://www.fileformat.info/info/unicode/char/00f6/index.htm > > Wow, I was looking for something like that, but I didn't know it existed. > > Can we somehow directly use SVG in Pharo ? > > On this page [http://www.fileformat.info/info/unicode/index.htm] they say that they got all their info from unicode.org but I can't seem to find the SVG data there. You seem to be good in finding stuff ;-) aH-Har! A challenge! but I did not succeed. The Unicode Code Charts [1] seem available only in PDF form (e.g. [2]) . Indeed it says "The fonts and font data used in production of the Unicode Standard may not be extracted, or used in any way in any product or publication, without permission or license granted by the typeface owner(s)." [1] http://unicode.org/charts/About.html [2] http://unicode.org/charts/PDF/U0100.pdf Though I discovered a few other interesting resources... Fallback font https://en.wikipedia.org/wiki/Fallback_font Last Resort Font http://www.unicode.org/policies/lastresortfont_eula.html Scriptsource - Unicode Character Browsing http://scriptsource.org/cms/scripts/page.php?item_id=entry_detail&uid=tubkv… Javascript Unibook 4.0 Character Browser http://www.soldin.de/about/2003-js_unibook/ decodeunicode http://www.decodeunicode.org/ HTH, cheers -ben > > In any case, it would be very cool to have something like that as a fall back. > >>> We also added an extension to our environmentâs search system to allow you to look up characters by name: >> >> Is there a #unicode filter for Spotter? > > That comes for free. > >> check repeated phrase... >>> and replace it with and replace it with > > Fixed, thanks. > >> I bumped into an interesting "Good, Bad, Ugly" comparison of Unicode >> support in other programming languages (though circa 2011) >> https://www.azabani.com/pages/gbu/ > > Reading it. > >> and this sparked a thought to wonder if the consortium would consider >> it worthwhile paying someone external (like that author) with broad >> cross platform Unicode experience to consult on getting Pharo to a >> pragmatic point where we look attractive in such comparisons, which >> may also provide a side-channel advertisement for Pharo when such >> comparisons are presented at conferences (??) > > Maybe, I don't know if we should spent (marketing) money like that, but who knows. > >> cheers -ben > > Sven > >

Feb. 18, 2016