Telling perl to expect input data to be in UTF8

Graham Wood · Sep 5, 2003

Hi all,

I've got this friend who's using perl 5.6.1 and DBI to import data that is in UTF8 and he is unable to display the data successfully after it imports from the database.  I read in perldoc perlunicode shipped with 5.6.1 that you can't tell perl to expect UTF8 data from an external file or source but that it would shortly be addressed in a future version.  Can anyone tell me if this has happened yet, and if so, in which version of perl it is available?

Thanks

Graham

David K. Wall · Sep 5, 2003

Graham Wood said:
<!doctype html public "-//w3c//dtd html 4.0 transitional//en">
<html>
Hi all,
<p>I've got this friend who's using perl 5.6.1 and DBI to import
data that
is in UTF8 and he is unable to display the data successfully after
it imports from the database.  I read in perldoc perlunicode
shipped with 5.6.1 that you can't tell perl to expect UTF8 data
from an external file or source but that it would shortly be
addressed in a future version.  Can anyone tell me if this
has happened yet, and if so, in which version of perl it is
available?
<p>Thanks
<p>Graham</html>

[snip vcard crap]

I don't know the answer to your question, but I do know that by
posting in HTML you made your post invisible to at least some of the
people most likely to be able to answer your question. (They have
their newsreaders configured to basically ignore posts that aren't
plain text.) The ones that did notice it probably took one look at
the HTML and went to the next article.

Hint, hint.

Graham Wood · Sep 5, 2003

Hi all,

I've got this friend who's using perl 5.6.1 and DBI to import data that
is in UTF8 and he is unable to display the data successfully
after it imports from the database. I read in perldoc perlunicode
shipped with 5.6.1 that you can't tell perl to expect UTF8 data
from an external file or source but that it would shortly be addressed
in a future version. Can anyone tell me if this has happened
yet, and if so, in which version of perl it is available?

Thanks

Graham

Graham Wood · Sep 5, 2003

Graham said:
Hi all,

I've got this friend who's using perl 5.6.1 and DBI to import data that
is in UTF8 and he is unable to display the data successfully
after it imports from the database. I read in perldoc perlunicode
shipped with 5.6.1 that you can't tell perl to expect UTF8 data
from an external file or source but that it would shortly be addressed
in a future version. Can anyone tell me if this has happened
yet, and if so, in which version of perl it is available?

Thanks

Graham

Humble apologies to all who have killfiled me for HTML crimes in the
plain text newsgroup. I foolishly thought when I asked Netscape to send
in plain text only that's what it would do. I have now scraped all
traces of html from my messages.

Graham

Alan J. Flavell · Sep 5, 2003

Graham Wood <[email protected]> wrote in a format that's

automatically suppressed by my news filters:

That's true enough. 5.6.1 has some of the machinery for utf8 support,
but you need 5.8.0 (or later) to get the features integrated into
I/O calls such as open() and binmode()

perldoc perlunicode has the gory detail; perldoc perluniintro is a
useful introduction. Both can be found at
http://www.perldoc.com/perl5.8.0/pod.html if you don't have your own
5.8.0 installation yet. Well, sure, they can still be found there
even if you do - but you would also have them nearer at hand.

Works well, as far as I could make out, except for dealing with
Windows-flavoured newlines, which basically had me at a loss (see
earlier discussion of utf-16 formats on Windoze).

good luck

Displaying utf8 text in perl -d	1	Sep 14, 2007
HTML in utf8 and perl	4	Feb 28, 2004
Is there a perl package, or data in a form easily used by a perlscript, that can be used to determin	23	Nov 6, 2008
How to decode JavaScript's encodeURIComponent in Perl.	4	Jan 23, 2007
mysql -- cannot connect (can in Perl)	6	Mar 7, 2011
compiling perl 5.8.7 on Solaris 8	3	Nov 17, 2005
REQ: Perl 5.8.3 on OpenBSD	3	Mar 6, 2004
Intermittent Character Encoding Issues	2	Nov 4, 2003

Telling perl to expect input data to be in UTF8

Graham Wood

David K. Wall

Graham Wood

Graham Wood

Alan J. Flavell

Ask a Question

Similar Threads

Members online

Forum statistics

Latest Threads