Feedback on the proposal to change U+FFFD generation when decoding ill-formed UTF-8

Richard Wordingham via Unicode unicode at
Thu May 18 00:01:49 CDT 2017

On Thu, 18 May 2017 02:04:55 +0200
Philippe Verdy via Unicode <unicode at> wrote:

> I find intriguating that the update intends to enforce the decoding
> of the **shortest** sequences, but now wants to treat **maximal
> sequences** as a single unit with arbitrary length. UTF-8 was
> designed to work only with some state machines that would NEVER need
> to parse more than 4 bytes.

If you look at the sample code in, you'll see that
it's working with 6-byte sequences.  It's the Unicode, as opposed to
ISO 10646, version that has always been restricted to 4 bytes.


More information about the Unicode mailing list