utf-8 read/write file

[Bruno]

Hi!

I have big .txt file which i want to read, process and write to another .txt file.
I have done script for that, but im having problem with croatian characters
(Å ,Ä,Ž,ÄŒ,Ć).
How can I read/write from/to file in utf-8 encoding?
I read file with fileinput.input.

thanks

 

[Benjamin]

Hi!

I have big .txt file which i want to read, process and write to another .txt file.
I have done script for that, but im having problem with croatian characters
(©,Ð,®,È,Æ).

Can you show us what you have so far?

How can I read/write from/to file in utf-8 encoding?

import codecs
data = codecs.open("my-utf8-file.txt").read()

 

[gigs]

Can you show us what you have so far?


import codecs
data = codecs.open("my-utf8-file.txt").read()

I have tried with codecs, but when i use encoding="utf-8" i get this error on
word : ¾ivot

Traceback (most recent call last):
File "C:\Users\Administrator\Desktop\getcontent.py", line 43, in <module>
encoding="utf-8").readlines()
File "C:\Python25\Lib\codecs.py", line 626, in readlines
return self.reader.readlines(sizehint)
File "C:\Python25\Lib\codecs.py", line 535, in readlines
data = self.read()
File "C:\Python25\Lib\codecs.py", line 424, in read
newchars, decodedbytes = self.decode(data, self.errors)
UnicodeDecodeError: 'utf8' codec can't decode byte 0x9e in position 0:
unexpected code byte


i just need to read from file1.txt, process (its simple text processing) some
words and write them to file2.txt without loss of croatian characters. (¹ð¾èæ)

 

[Kent Johnson]

UnicodeDecodeError: 'utf8' codec can't decode byte 0x9e in position 0:
unexpected code byte

Are you sure you have UTF-8 data? I guess your file is encoded in
CP1250 or CP1252; in both of these charsets 0x9e represents LATIN
SMALL LETTER Z WITH CARON.

Kent

 

[gigs]

Are you sure you have UTF-8 data? I guess your file is encoded in
CP1250 or CP1252; in both of these charsets 0x9e represents LATIN
SMALL LETTER Z WITH CARON.

Kent

This data wasnt in utf-8 probably, today i get another one utf-8 and its working

thanks