Unicode (UTF-8)

[Luigi Donatello Asero]

_Jonathan N. Little_ skrev | wrote | crivit (27-05-2006 02:04):


In XP you need to replace /all/ instances of notepad.exe (backed up original
versions), and at some point, answer 'yes' if XP asks you whether you really
want to keep the 'counterfeit' (AFAIR).
But that's not really 'hacking', is it?

Luigi:

You mean by law?

Licence agreement.

 

[Luigi Donatello Asero]

I think Luigi Asero has refused to understand the principles of character
encoding. That might explain part of the phenomenon.

Freedom of speech is very important

Undoubtedly. Pretty much anything that can be expressed as written text in
computer-readable form can be encoded in UTF-8. More exactly, all Unicode
text can be encoded in UTF-8.

http://www.unicode.org/faq/font_keyboard.html#7
Unicode has several

A few myriads. The exact number depends on your ontology of symbols. (Does a
symbol exist if it is known from one single written document only? What
about two?)


No, because not all Chinese symbols have (yet) been included into Unicode.

Fine.
Which solution do you choose when you write in Chinese?

 

[Jonathan N. Little]

_Jonathan N. Little_ skrev | wrote | écrivit (27-05-2006 02:04):


In XP you need to replace /all/ instances of notepad.exe (backed up original
versions), and at some point, answer 'yes' if XP asks you whether you really
want to keep the 'counterfeit' (AFAIR).
But that's not really 'hacking', is it?

You have to disable the SFC first, replace all the hidden compressed
backup versions, if you do not do it exactly or promptly the old Notepad
will be restored...yeah I'd call it a hack.

 

[Frank Olieu]

_Luigi Donatello Asero_ skrev | wrote | écrivit (27-05-2006 16:26):

Licence agreement.

I don't think the licence agreement disallows installing third party
applications... yet!

 

[Frank Olieu]

_Jonathan N. Little_ skrev | wrote | écrivit (27-05-2006 17:55):

You have to disable the SFC first

You're right. I forgot this one.

...yeah I'd call it a hack.

I call it housekeeping

 

[Toby Inkster]

I just tried saving the BBC News Chinese front page in the two
encodings:
81672 May 27 13:34 bbc-chinese-utf16.html
43759 May 27 13:33 bbc-chinese-utf8.html

In case that might be an unfair choice, I tried a Bank of China site:
141476 May 27 13:43 boc-tw-utf16.html
73144 May 27 13:44 boc-tw-utf8.html

Though both of these are probably a bit more markup-heavy/content-light
than I would care to write. On pages with a higher signal-to-noice ratio,
you'll probably find UTF-16 fares better.

 

[Alan J. Flavell]

Though both of these are probably a bit more
markup-heavy/content-light than I would care to write.

Very well - you're free to offer your own examples - I can't read
Chinese anyway. But that still doesn't address the other points I
made, about browser and search engine support, etc.

Anyway, here's a couple of W3C formal documents in "Simplified
Chinese" translation, picked more or less at random, again after
character encoding conversion using Mozilla Composer:

204638 May 28 11:58 rdfconcepts-utf16.html
119672 May 28 11:59 rdfconcepts-utf8.html

93112 May 28 12:02 XHTML10-gb2312.html (original)
168120 May 28 12:03 XHTML10-utf16.html
102106 May 28 12:03 XHTML10-utf8.html

Keep in mind that in going from utf8 to utf16, you are typically
saving one in three bytes per character of Chinese payload, but you
are doubling the number of bytes for markup, URLs etc. It's a
delicate tradeoff! I haven't yet seen a real web page where utf16
wins (I don't *think* there's anything fundamentally wrong with the
way I'm doing this), but you're free to produce examples.

 

[Luigi Donatello Asero]

Though both of these are probably a bit more markup-heavy/content-light
than I would care to write. On pages with a higher signal-to-noice ratio,
you'll probably find UTF-16 fares better.

I have noticed that
www.baidu.com uses
charset=gb2312
(see
http://www.baidu.com/s?lm=0&si=&rn=10&ie=gb2312&ct=0&wd=Stonetech+Shanghai&pn=10&cl=3 )
and there are both Chinese and English character on that page.
I have saved several pages as php and php does not support Unicode, so far..
Besides, Windows XP let me write Chinese in Word Pad, so one solution might
be to buy a new ftp program which works on XP.
Which one would you recommend which is possible to pay by invoice in Sweden?
Or does PC-Linq work even as FTP program?
And by the way should I call the files in Chinese by any name with Chinese
characters or Latin characters??
www.baidu.com seems to be with Latin Characters.. and my domain names are
not with Chinese signs but are there any domains with Chinese characters?

 

[Toby Inkster]

I have saved several pages as php and php does not support Unicode, so far.

Yes it does.

Since PHP 3.0.6, convert between UTF-8 and ISO-8859-1:
http://uk2.php.net/manual/en/function.utf8-encode.php
http://uk2.php.net/manual/en/function.utf8-decode.php

Since PHP 4.0.6, do lots of other stuff with UTF-7, UTF-8, UTF-16 or
UTF-32 (big- and little-endian flavours):
http://uk2.php.net/manual/en/ref.mbstring.php

 

[Toby Inkster]

buy a new ftp program which works on XP.
Which one would you recommend which is possible to pay by invoice in Sweden?

WS_FTP LE or Filezilla.

Both have a cost of 0 Swedish krona, which you can pay by invoice if you
like.

 

[Toby Inkster]

are there any domains with Chinese characters?

Yes, but non-ASCII domain names are still fairly poorly supported so far.

To check if your browser supports them, try:

http://www.bücher.ch/

(It should redirect to http://www.buecher.de/)

 

[dorayme]

Both have a cost of 0 Swedish krona, which you can pay by invoice if you
like.

I don't think Luigi would agree to the sense of an empty list or
class and so he won't believe you can pay no krona. And since you
can't pay more, he will conclude you cannot obtain it... er...

 

[Jonathan N. Little]

Yes, but non-ASCII domain names are still fairly poorly supported so far.

To check if your browser supports them, try:

http://www.bücher.ch/

(It should redirect to http://www.buecher.de/)

We know which one gets the "The page cannot be displayed"! Ol' IE6x

 

[Luigi Donatello Asero]

far.

Yes it does.

Since PHP 3.0.6, convert between UTF-8 and ISO-8859-1:
http://uk2.php.net/manual/en/function.utf8-encode.php
http://uk2.php.net/manual/en/function.utf8-decode.php

Since PHP 4.0.6, do lots of other stuff with UTF-7, UTF-8, UTF-16 or
UTF-32 (big- and little-endian flavours):
http://uk2.php.net/manual/en/ref.mbstring.php

So, what about that?
http://groups.google.se/group/europa.union/msg/b29b96a4afd37221?dmode=source&hl=sv

 

[Luigi Donatello Asero]

Sweden?

WS_FTP LE or Filezilla.

Both have a cost of 0 Swedish krona, which you can pay by invoice if you
like.

This is only free for 30 days......
http://www.ipswitch.com/_download/wsftppro.asp

 

[Luigi Donatello Asero]

Yes, but non-ASCII domain names are still fairly poorly supported so far.

To check if your browser supports them, try:

http://www.bücher.ch/

(It should redirect to http://www.buecher.de/)

As far as I understand,
I do not own any browser.....
I may only use one browser or the other to navigate on the Internet under
the terms of the respective
licence agreement.

 

[Jonathan N. Little]

As far as I understand,
I do not own any browser.....
I may only use one browser or the other to navigate on the Internet under
the terms of the respective
licence agreement.

Who's EULA?!

 

[Jonathan N. Little]

This is only free for 30 days......
http://www.ipswitch.com/_download/wsftppro.asp

No, not the WS_Ftp *Pro* Trial WS_Ftp *LE* 'Freeware', You will not find
it on Ipswitch's site anymore you have to find it in some
shareware/freeware repository

 

[PeterMcC]

Jonathan N. Little wrote in
<[email protected]>

WS_Ftp *LE* 'Freeware', You will not
find it on Ipswitch's site anymore you have to find it in some
shareware/freeware repository

http://tucows.mundofree.com/winnt/adnload/1475_29570.html

 

[Toby Inkster]

Toby Inkster skrev:


This is only free for 30 days......
http://www.ipswitch.com/_download/wsftppro.asp

You're right, *that* is only free for 30 days. However the two pieces of
software I recommended are free forever.