Library: UTF-8 text processing (UTF8PAT legacy) Include: utf8pat.xin

Declaration

multi-byte-utf8-char

You can use multi-byte-utf8-char as a pattern to match only multi-byte UTF-8 encoded characters (those with numeric values greater than 128) in your input data.

You can use this pattern in a find rule when you want to process only the multi-byte UTF-8 characters, and let the single-byte UTF-8 characters fall through as unmatched characters do in OmniMark find rules.

Example:

  include "utf8pat.xin"
    process
    repeat scan "flamb%195#%169#"
         match single-byte-utf8-char+ => c
              output c
         match multi-byte-utf8-char => c
              local integer n initial {utf8-char-number c}
              do when n > 255
                   output "&#x" || "16rud" % n || ";"
              else
                   output "b" % n
              done
      again

For other related constants and keywords, see the UTF-8 text processing legacy library.

Other Library Functions multi-byte-utf8-char single-byte-utf8-char utf8-char utf8-char-number utf8-encoded

[ INDEX ] [ CONCEPTS ] [ TASKS ] [ SYNTAX ] [ LIBRARIES ] [ LEGACY LIBRARIES ] [ ERRORS ]