Ben,
On 18 Feb 2016, at 02:05, Ben Coman <btc@openInWorld.com> wrote:
On Wed, Feb 17, 2016 at 5:16 PM, Sven Van Caekenberghe <sven@stfx.eu> wrote:
Hi,
In Pharo we can deal with and represent any Unicode character and string, but there are still some important pieces of functionality missing.
The goal of the Pharo Unicode project is to gradually improve and expand Unicode support in Pharo. We started in December last year to lay the foundation and are now ready to go public with what we built.
The first delivery is an implementation of Unicode Normalization, together with an implementation of the Unicode Character Database.
Please read the following article for more information (the appendix explains how to get the code).
An Implementation of Unicode Normalisation
Streaming NFC, NFD, NFKC & NFKD, normalization QC and normalization preserving concatenation.
https://medium.com/concerning-pharo/an-implementation-of-unicode-normalizati...
The development branch also contains a work in progress implementation of Unicode Collation.
Much work remains to be done and contributions are more than welcome.
Sven & Henrik
This is really great. Thanks Sven & Henrik.
You're welcome.
The right pane shows a large glyph view of the character involved.
This is very cool !! Does it rely on font support, or is it bitmap or SVG based?
Currently, we just use what Pharo can do (it thus depends on your font and even then the layout is often wrong in special cases, something we need to fix as well).
Maybe it could dynamically download SVG data as needed from somewhere like here... http://www.fileformat.info/info/unicode/char/00f6/index.htm
Wow, I was looking for something like that, but I didn't know it existed. Can we somehow directly use SVG in Pharo ? On this page [http://www.fileformat.info/info/unicode/index.htm] they say that they got all their info from unicode.org but I can't seem to find the SVG data there. You seem to be good in finding stuff ;-) In any case, it would be very cool to have something like that as a fall back.
We also added an extension to our environmentâs search system to allow you to look up characters by name:
Is there a #unicode filter for Spotter?
That comes for free.
check repeated phrase...
and replace it with and replace it with
Fixed, thanks.
I bumped into an interesting "Good, Bad, Ugly" comparison of Unicode support in other programming languages (though circa 2011) https://www.azabani.com/pages/gbu/
Reading it.
and this sparked a thought to wonder if the consortium would consider it worthwhile paying someone external (like that author) with broad cross platform Unicode experience to consult on getting Pharo to a pragmatic point where we look attractive in such comparisons, which may also provide a side-channel advertisement for Pharo when such comparisons are presented at conferences (??)
Maybe, I don't know if we should spent (marketing) money like that, but who knows.
cheers -ben
Sven