Convert unicode string to "basic characters"

[Mike Mimic]

Hi!

How can I convert characters in unicode string to their
"basic characters"? All those "a with ..." and "o with ...".

I tryed with Unicode::Normalize:

$string = NFD($string);
$string =~ s/\pM//og;

But the problem is for example with U+00D8 (O with stroke), D+0110 (D
with stroke), U+0141 (L with stroke)...


Mike

 

[Jürgen Exner]

How can I convert characters in unicode string to their
"basic characters"? All those "a with ..." and "o with ...".

And what would you use as the "basic character" for those Farsi, Korean,
Chinese, Arabic, Hebrew, Vietnamese and dozens and dozens of other
characters?
Unicode encompasses almost all of the commonly spoken languages on earth.

jue

 

[Mike Mimic]

Hi!

Mike Mimic wrote:
And what would you use as the "basic character" for those Farsi, Korean,
Chinese, Arabic, Hebrew, Vietnamese and dozens and dozens of other
characters?

I would leave them as they are. I would like to convert only thoose
which are "combined".


Mike

 

[Jürgen Exner]

Mike Mimic wrote:
[Converting non-ASCII to ASCII characters]

I would leave them as they are. I would like to convert only thoose
which are "combined".

What do you mean by "combined"? I can't tell how much you know about other
languages.
But if you are talking about "accented characters", are you aware that often
those are different characters, not just pronounciation marks (as e.g. in
Arabic)? Like are you sure, that you want to convert e.g. Österreich (=
Austria) into Osterreich (= Easter empire)?

jue