Text encoding

[pogo]

I encountered this a short time ago:

http://www.yakyak.org/viewtopic.php?f=11&t=84395

A shame as Emoji are a great modern update to Smilies: a wide choice, better quality and quicker/less server impact as they're just text.

[gumboot]

I encountered this a short time ago:

http://www.yakyak.org/viewtopic.php?f=11&t=84395

A shame as Emoji are a great modern update to Smilies: a wide choice, better quality and quicker/less server impact as they're just text.

Basically I think any unicode character >= 0x10000 isn't going to be accepted by the board. On the one hand that's crappy because it's not the full set of characters; on the other it's sensibly conservative because I have not once encountered a Windows-based application that handles them entirely correctly.

Yes you can normally get them on screen, but then you find you can usually do stupid things like cursor into the middle of the surrogate pair and insert garbage between them.

I would suggest filing a bug against the original software; because fuck Windows and fuck anyone else who things UTF-16 isn't a stupid idea.

[rowan]

Yeah Oracle are fuckers for the same thing. Characterset "UTF8" only supports BMP and you need to use "AL32UTF8" for 4 byte chars.

[gumboot]

Apparently the full Chinese set is about 80000 characters. It's obvious racism!