Python unicode utf-8 characters and MySQL unicode utf-8 characters

  • Thread starter Grzegorz ¦liwiñski
  • Start date
G

Grzegorz ¦liwiñski

Hello,
Recently I tried to insert some unicode object in utf-8 encoding into
MySQL using MySQLdb, and got MySQL warnings on characters like:
ðŽ²ðŽ ðŽ¥ðŽ  i found somewhere in my data. I can't even read them. MySQL
seems to cut the whole string after that characters off, so I get
incomplete data.
After a little bit of digging I found out, that MySQL usually supports
utf-8 data but encoded into maximum three bytes. That's why I think it
would help I f I was able to replace all larger unicode characters
with replacement characters.

Is there any way, I could adjust python unicode utf-8 encoded strings
to be accepted by mysql utf-8 columns?
 
K

Kushal Kumaran

2011/1/18 Grzegorz Śliwiński said:
Hello,
Recently I tried to insert some unicode object in utf-8 encoding into
MySQL using MySQLdb, and got MySQL warnings on characters like:
ðŽ²ðŽ ðŽ¥ðŽ  i found somewhere in my data. I can't even read them. MySQL
seems to cut the whole string after that characters off, so I get
incomplete data.
After a little bit of digging I found out, that MySQL usually supports
utf-8 data but encoded into maximum three bytes. That's why I think it
would help I f I was able to replace all larger unicode characters
with replacement characters.

Is there any way, I could adjust python unicode utf-8 encoded strings
to be accepted by mysql utf-8 columns?

Did you pass the charset argument when creating your MySQLdb connection?
 
G

Grzegorz ¦liwiñski

Did you pass the charset argument when creating your MySQLdb connection?

Hello, yes, although I usually just use SET NAMES utf8; after
encountering the problem first, I tried the charset option as well,
but there's no difference.
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

Forum statistics

Threads
473,733
Messages
2,569,439
Members
44,829
Latest member
PIXThurman

Latest Threads

Top