[bndfc-web-tech] on-screen gobbledygook

[Bruno Postle]

On Tue 14-Dec-2004 at 15:05 +0000, Jamie Marriott wrote:
> 
> Today I now have some strange on screen 'junk', stuff like this:

> It's quite consitent throughout. Basically apostrophes, commas and
> stuff. What's puzzling is that originally the content worked, and
> now it doesn't!

We have seen this before with two of our customers, it is apparently
caused by auto-filetype detection.

Basically, MKDoc works entirely in a Unicode environment.  It
delivers all content encoded as UTF-8 and expects new uploaded
content to be the same.

Windows is perfectly capable of working like this too (Windows 2000
and XP are natively UTF-8 anyway), but sometimes a server sends a
form, declares it as UTF-8 and the browser decides that it is
actually CP1252 (the old default win95 character-set).

The problem is that it is very machine specific, some users never
have this problem, others see it quite often - I have never managed
to reproduce it myself despite trying.

In the latest editor templates we have a workaround that is designed
to force interpretation as UTF-8, I've just applied this workaround
to your site - This won't fix the existing messed-up documents, but
it should prevent it happening again.

Please let us know if it continues to be messed-up, or even better,
if you can reproduce the problem consistently.

-- 
Bruno