 |
 |
|
|
       |
|||
|
|||||||||
|
|
|||||||||
| Related Syntax | Related Concepts | ||||||||
| pattern | single-byte-utf8-char | ||||||||
Syntax
single-byte-utf8-char
You can use single-byte-utf8-char as a pattern to match only ASCII UTF-8 encoded characters (those with numeric values 0 to 127) in your input data.
In most cases, you may be able to use just the companion to this syntax item, multi-byte-utf8-char to process multi-byte utf8 characters separately. However, there may be cases where you want to use single-byte-utf8-char+ to match single-byte UTF-8 characters and throw them away, for example.
Example:
include "utf8pat.xin"
process
repeat scan "flamb%195#%169#"
match single-byte-utf8-char+ => c
output c
match multi-byte-utf8-char => c
local integer n initial {utf8-char-number c}
do when n > 255
output "&#x" || "16rud" % n || ";"
else
output "b" % n
done
again
For other related constants and keywords, see the UTF-8 text processing library.
|
Related Syntax utf8-char |
Related Concepts Character set encoding Pattern matching |
| ---- |
