Text encodings

[xTRiM]

Hello,

is there any way, to detect text encoding?
For example, is it in utf8, or in win1251, or something else.

Thank you.

 

[Paul Battley]

is there any way, to detect text encoding?
For example, is it in utf8, or in win1251, or something else.

You can't detect one-byte-per-character encodings easily (i.e. without
statistical analysis) but you can easily tell if something's UTF-8 or
not:

class String
def is_utf8?
unpack('U*')
return true
rescue
return false
end
end

"foo".is_utf8? #=> true
"foo\303".is_utf8? #=> false

Not the most efficient way, necessarily, but probably the easiest.

Paul.

 

[Takashi Sano]

Hi,

Hello,

is there any way, to detect text encoding?
For example, is it in utf8, or in win1251, or something else.

You can use the standard lib NKF's guess or guess2 (ruby 1.8.2 or
later) method for that. Look up the NKF section in
http://www.ruby-doc.org/stdlib/.

Takashi Sano