Not accepting foreign chars?

[Rui]

Does anyone else seem to have this problem? Look at the "House of Rohan", for example. It had a large
-
to separate the dates, but I edited it a while ago and it changed to some weird symbol. This has happened before when I tried to add those [ list ] bullets, it would replace every bullet symbol with "
Since this only began happening after the server move, I assume that's the problem?

 

[Magtheridon96]

That's a character of Ascii Index 13, and it looks like this:

But I have no idea why it would be changing it to that o-o

I know that the site sometimes displays the actual HTML data if a post has been up for a while (meaning ; gets changed to &quot;, < gets changed to &lt; and > gets changed to &gt, but I've never experienced it changing the actual data before ;p

edit
Oh shit!
I just found it replacing common characters too D:
It replaced an entire name with a string of strange symbols in some post D:

 

[MGCǂSpectre]

'b> bl a:070;, c <5=o 2a5 @01>b05b, cyrillic doesn't work

 

[Rui]

The letters in my name now turn to 1n when quoting ;P

 

[Vengeancekael]

The letters in my name now turn to 1n when quoting ;P

test

lololol
Nope not for me.
edit: oh wait what now yes

 

[Magtheridon96]

Testing:

1n

edit
Yep, foreign chars are not accepted o-o
At least we know this isn't some random change. (lol)

Strangely, this doesn't happen everywhere
I saw some guy make a post in which some of his text got converted into symbols like (tm), (3/4) and other shit

edit
Testing more:

,H'/ DH*J

edit
Well, arabic doesn't work as well.

I'm going to assume this problem only occurs with characters of foreign languages

 

[Ralle]

Testing
Iñtërnâtiônàlizætiøn

Edit: testing

Test Rui's name: 1n

 

[Ralle]

Wow that is weird.
And you are sure it is when we did the server move?

 

[Rui]

Well, at least it wasn't happening before. xP

EDIT: &mdash; the following refuses to display: &#8212 ; (with the comma not separated) (but if you edit my post, it'll be replaced by a large dash

 

[Rui]

Another hassle is that this has apparently messed with the Page Manager in the APPS. Any page containing a strange character displays fine, but if you try to edit it, the whole file/page/edit-area is blank.

 

[GhostWolf]

Try to serve pages as UTF-8 instead of ISO-8859-1 (though it looks like a server-side thing to me).

 

[Magtheridon96]

<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1" />

I just noticed this in the page source. It should be:

<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />

I know because when I save a file in UTF-8 format (notepad), I can display any characters I want

edit
Well, I've been on this page too long without refreshing O-o
GhostWolf beat me to it.
And why are HTML tags THIS annoying? >_<
/removes them

 

[GhostWolf]

And why are HTML tags THIS annoying? >_<
/removes them

Because you are supposed to send your data properly and have HTTP decide the encoding, but HTML decided long ago to add this overriding crap.

 

[Dr Super Good]

Another hassle is that this has apparently messed with the Page Manager in the APPS. Any page containing a strange character displays fine, but if you try to edit it, the whole file/page/edit-area is blank.

Its the quick edit box and probably the quick reply box. It curropts your name Rui when updating (although it appears fine just before you save the changes). Your name works fine when I post a quote using advanced post or edit using advanced edit but if I edit the quote using quick edit it gets curropted. Seems it does not like unicode (probably due to the variable character length)

Another hassle is that this has apparently messed with the Page Manager in the APPS. Any page containing a strange character displays fine, but if you try to edit it, the whole file/page/edit-area is blank.

See, here you are quoted fine.

 

[Deolrin]

Test in quick reply:
© a þ ¬ Ô ê

Test in quick edit:

© a þ ¬ Ô ê

Seems to be working fine. I guess it depends on the symbols.

 

[Vengeancekael]

The letters in my name now turn to 1n when quoting ;P

Test
OH hey it says Rui C:
edit: Oh now it says 1n after editing it.
Still not fixed I guess /o/

 

[Ralle]

It's not simply editing the HTML. We also have to change the database and some of the code to make it Unicode. I just don't know what we changed since the server move.

 

[Dr Super Good]

The problem is when applying a quick edit to a post. It appears fine in the edit window but when the change is applied it is corrupted. Applying the change through the advanced edit does not cause is.

Probably related to the button also updating the current page (like quick post) instead of advanced post or edit which instead tell the browser to load a new page.

 

[Huurka]

Q test

Hangul not working.

 

[Vunjo]

Test

EDIT: The cross didn't work, TM didn't work either.

 

[GhostWolf]

SET character_set_client = utf8

mysql --default-character-set=utf8 -uyour_username -p -h your_databasehost.your_domain.com your_database

If you get into trouble from a PHP-based web application, check the characterset configurations of these components:

1) the MySQL database
2) php.ini
3) httpd.conf
4) your server

if you get data via php from your mysql-db (everything utf-8)
but still get '?' for some special characters in your browser
(<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />),
try this:

after mysql_connect() , and mysql_select_db() add this lines:
mysql_query("SET NAMES utf8");

As of mySQL 5.x you can use the init_connect commands to force UTF-8 compliance from any client connection.



 

[Ghan_04]

This should be fixed now. Test it out:

Ѧ♄, ☂н@☂❝﹩ @ẘℯṧ◎ღε

 

[MGCǂSpectre]

Работает. (Test)

 

[Magtheridon96]

الله أكبر

Testing.
edit
Oh yay, it works. <:

 

[Ralle]

Woot awesome Ghan Thanks!

 

[Arcisal]

My sig!
Used to be dots in between each link.

TEST:
∵(Because sign, three dots)
∴(Therefore sign, three dots)
◊ (Lozenge, diamond)
※(Reference mark)
·(Interpunct)

 

[Rui]

Cool symbols. Where do you find all of those?

 

[Archian]

I'm still seeing a heap of these around the forums: ���

 

[Rui]

Indeed. It appears that, when the symbol bug was fixed, every one of the existing symbols got switched for that. We'll just have to correct them ourselves.

 

[Arcisal]

Cool symbols. Where do you find all of those?

Wikipedia!

This page, to be specific.
All in the white column on the right side of the page.

 

[fladdermasken]

☞ THIS POST IS SHIT
No rly don't read it

 

[Vladadamm]

Guys, there are also problems with the é, à, è, etc... with triggers (gui ones).

Maybe i should post some examples.

 

[thomasmarteen]

I saw some guy make a post in which some of his text got converted into symbols like (tm), (3/4) and other shit.