Feedback on the proposal to change U+FFFD generation when decoding ill-formed UTF-8

Alastair Houghton via Unicode unicode at unicode.org
Tue May 23 13:09:33 CDT 2017


> On 23 May 2017, at 18:45, Markus Scherer via Unicode <unicode at unicode.org> wrote:
> 
> On Tue, May 23, 2017 at 7:05 AM, Asmus Freytag via Unicode <unicode at unicode.org> wrote:
>> So, if the proposal for Unicode really was more of a "feels right" and not a "deviate at your peril" situation (or necessary escape hatch), then we are better off not making a RECOMMEDATION that goes against collective practice.
> 
> I think the standard is quite clear about this:
> 
> Although a UTF-8 conversion process is required to never consume well-formed subsequences as part of its error handling for ill-formed subsequences, such a process is not otherwise constrained in how it deals with any ill-formed subsequence itself. An ill-formed subsequence consisting of more than one code unit could be treated as a single error or as multiple errors.

Agreed.  That paragraph is entirely clear.

Kind regards,

Alastair.

--
http://alastairs-place.net




More information about the Unicode mailing list