Result values for normalization quick check functions.

For details see https://www.unicode.org/reports/tr15/#Detecting_Normalization_Forms

Stable:

ICU 2.0

C typedef for struct UNormalizer2.

Stable:

ICU 4.4

Definition at line 1 of file unorm2.h.

Constants for normalization modes.

For details about standard Unicode normalization forms and about the algorithms which are also used with custom mapping tables see https://www.unicode.org/unicode/reports/tr15/

Stable:

ICU 4.4

Definition at line 48 of file unorm2.h.

Result values for normalization quick check functions.

For details see https://www.unicode.org/reports/tr15/#Detecting_Normalization_Forms

Stable:

ICU 2.0

Definition at line 97 of file unorm2.h.

Appends the second string to the first string (merging them at the boundary) and returns the length of the first string.

The result is normalized if both the strings were normalized. The first and second strings must be different buffers.

Parameters

norm2	UNormalizer2 instance
first	string, should be normalized
firstLength	length of the first string, or -1 if NUL-terminated
firstCapacity	number of UChars that can be written to first
second	string, should be normalized
secondLength	length of the source string, or -1 if NUL-terminated
pErrorCode	Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

first

Stable:

ICU 4.4

Closes a UNormalizer2 instance from unorm2_openFiltered().

Do not close instances from unorm2_getInstance()!

Parameters

norm2

UNormalizer2 instance to be closed

Stable:

ICU 4.4

Performs pairwise composition of a & b and returns the composite if there is one.

Returns a composite code point c only if c has a two-way mapping to a+b. In standard Unicode normalization, this means that c has a canonical decomposition to a+b and c does not have the Full_Composition_Exclusion property.

This function is independent of the mode of the UNormalizer2.

Parameters

norm2	UNormalizer2 instance
a	A (normalization starter) code point.
b	Another code point.

Returns

The non-negative composite code point if there is one; otherwise a negative value.

Stable:

ICU 49

Gets the combining class of c.

The default implementation returns 0 but all standard implementations return the Unicode Canonical_Combining_Class value.

Parameters

norm2	UNormalizer2 instance
c	code point

Returns

c's combining class

Stable:

ICU 49

Gets the decomposition mapping of c.

Roughly equivalent to normalizing the String form of c on a UNORM2_DECOMPOSE UNormalizer2 instance, but much faster, and except that this function returns a negative value and does not write a string if c does not have a decomposition mapping in this instance's data. This function is independent of the mode of the UNormalizer2.

Parameters

norm2	UNormalizer2 instance
c	code point
decomposition	String buffer which will be set to c's decomposition mapping, if there is one.
capacity	number of UChars that can be written to decomposition
pErrorCode	Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

the non-negative length of c's decomposition, if there is one; otherwise a negative value

Stable:

ICU 4.6

Returns a UNormalizer2 instance which uses the specified data file (packageName/name similar to ucnv_openPackage() and ures_open()/ResourceBundle) and which composes or decomposes text according to the specified mode.

Returns an unmodifiable singleton instance. Do not delete it.

Use packageName=NULL for data files that are part of ICU's own data. Use name="nfc" and UNORM2_COMPOSE/UNORM2_DECOMPOSE for Unicode standard NFC/NFD. Use name="nfkc" and UNORM2_COMPOSE/UNORM2_DECOMPOSE for Unicode standard NFKC/NFKD. Use name="nfkc_cf" and UNORM2_COMPOSE for Unicode standard NFKC_CF=NFKC_Casefold.

Parameters

packageName	NULL for ICU built-in data, otherwise application data package name
name	"nfc" or "nfkc" or "nfkc_cf" or "nfkc_scf" or name of custom data file
mode	normalization mode (compose or decompose etc.)
pErrorCode	Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

the requested UNormalizer2, if successful

Stable:

ICU 4.4

Returns a UNormalizer2 instance for Unicode NFC normalization.

Same as unorm2_getInstance(NULL, "nfc", UNORM2_COMPOSE, pErrorCode). Returns an unmodifiable singleton instance. Do not delete it.

Parameters

pErrorCode

Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

the requested Normalizer2, if successful

Stable:

ICU 49

Returns a UNormalizer2 instance for Unicode NFD normalization.

Same as unorm2_getInstance(NULL, "nfc", UNORM2_DECOMPOSE, pErrorCode). Returns an unmodifiable singleton instance. Do not delete it.

Parameters

pErrorCode

Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

the requested Normalizer2, if successful

Stable:

ICU 49

Returns a UNormalizer2 instance for Unicode toNFKC_Casefold() normalization which is equivalent to applying the NFKC_Casefold mappings and then NFC.

See https://www.unicode.org/reports/tr44/#NFKC_Casefold

Same as unorm2_getInstance(NULL, "nfkc_cf", UNORM2_COMPOSE, pErrorCode). Returns an unmodifiable singleton instance. Do not delete it.

Parameters

pErrorCode

Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

the requested Normalizer2, if successful

Stable:

ICU 49

Returns a UNormalizer2 instance for Unicode NFKC normalization.

Same as unorm2_getInstance(NULL, "nfkc", UNORM2_COMPOSE, pErrorCode). Returns an unmodifiable singleton instance. Do not delete it.

Parameters

pErrorCode

Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

the requested Normalizer2, if successful

Stable:

ICU 49

Returns a UNormalizer2 instance for a variant of Unicode toNFKC_Casefold() normalization which is equivalent to applying the NFKC_Simple_Casefold mappings and then NFC.

See https://www.unicode.org/reports/tr44/#NFKC_Simple_Casefold

Same as unorm2_getInstance(NULL, "nfkc_scf", UNORM2_COMPOSE, pErrorCode). Returns an unmodifiable singleton instance. Do not delete it.

Parameters

pErrorCode

Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

the requested Normalizer2, if successful

Stable:

ICU 74

Returns a UNormalizer2 instance for Unicode NFKD normalization.

Same as unorm2_getInstance(NULL, "nfkc", UNORM2_DECOMPOSE, pErrorCode). Returns an unmodifiable singleton instance. Do not delete it.

Parameters

pErrorCode

Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

the requested Normalizer2, if successful

Stable:

ICU 49

Gets the raw decomposition mapping of c.

This is similar to the unorm2_getDecomposition() function but returns the raw decomposition mapping as specified in UnicodeData.txt or (for custom data) in the mapping files processed by the gennorm2 tool. By contrast, unorm2_getDecomposition() returns the processed, recursively-decomposed version of this mapping.

When used on a standard NFKC Normalizer2 instance, unorm2_getRawDecomposition() returns the Unicode Decomposition_Mapping (dm) property.

When used on a standard NFC Normalizer2 instance, it returns the Decomposition_Mapping only if the Decomposition_Type (dt) is Canonical (Can); in this case, the result contains either one or two code points (=1..4 UChars).

This function is independent of the mode of the UNormalizer2.

Parameters

norm2	UNormalizer2 instance
c	code point
decomposition	String buffer which will be set to c's raw decomposition mapping, if there is one.
capacity	number of UChars that can be written to decomposition
pErrorCode	Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

the non-negative length of c's raw decomposition, if there is one; otherwise a negative value

Stable:

ICU 49

Tests if the character always has a normalization boundary after it, regardless of context.

For details see the Normalizer2 base class documentation.

Parameters

norm2	UNormalizer2 instance
c	character to test

Returns

true if c has a normalization boundary after it

Stable:

ICU 4.4

Tests if the character always has a normalization boundary before it, regardless of context.

For details see the Normalizer2 base class documentation.

Parameters

norm2	UNormalizer2 instance
c	character to test

Returns

true if c has a normalization boundary before it

Stable:

ICU 4.4

Tests if the character is normalization-inert.

For details see the Normalizer2 base class documentation.

Parameters

norm2	UNormalizer2 instance
c	character to test

Returns

true if c is normalization-inert

Stable:

ICU 4.4

Tests if the string is normalized.

Internally, in cases where the quickCheck() method would return "maybe" (which is only possible for the two COMPOSE modes) this method resolves to "yes" or "no" to provide a definitive result, at the cost of doing more work in those cases.

Parameters

norm2	UNormalizer2 instance
s	input string
length	length of the string, or -1 if NUL-terminated
pErrorCode	Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

true if s is normalized

Stable:

ICU 4.4

Writes the normalized form of the source string to the destination string (replacing its contents) and returns the length of the destination string.

The source and destination strings must be different buffers.

Parameters

norm2	UNormalizer2 instance
src	source string
length	length of the source string, or -1 if NUL-terminated
dest	destination string; its contents is replaced with normalized src
capacity	number of UChars that can be written to dest
pErrorCode	Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

dest

Stable:

ICU 4.4

Appends the normalized form of the second string to the first string (merging them at the boundary) and returns the length of the first string.

The result is normalized if the first string was normalized. The first and second strings must be different buffers.

Parameters

norm2	UNormalizer2 instance
first	string, should be normalized
firstLength	length of the first string, or -1 if NUL-terminated
firstCapacity	number of UChars that can be written to first
second	string, will be normalized
secondLength	length of the source string, or -1 if NUL-terminated
pErrorCode	Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

first

Stable:

ICU 4.4

Constructs a filtered normalizer wrapping any UNormalizer2 instance and a filter set.

Both are aliased and must not be modified or deleted while this object is used. The filter set should be frozen; otherwise the performance will suffer greatly.

Parameters

norm2	wrapped UNormalizer2 instance
filterSet	USet which determines the characters to be normalized
pErrorCode	Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

the requested UNormalizer2, if successful

Stable:

ICU 4.4

Tests if the string is normalized.

For the two COMPOSE modes, the result could be "maybe" in cases that would take a little more work to resolve definitively. Use spanQuickCheckYes() and normalizeSecondAndAppend() for a faster combination of quick check + normalization, to avoid re-checking the "yes" prefix.

Parameters

norm2	UNormalizer2 instance
s	input string
length	length of the string, or -1 if NUL-terminated
pErrorCode	Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

UNormalizationCheckResult

Stable:

ICU 4.4

Returns the end of the normalized substring of the input string.

In other words, with end=spanQuickCheckYes(s, ec); the substring UnicodeString(s, 0, end) will pass the quick check with a "yes" result.

The returned end index is usually one or more characters before the "no" or "maybe" character: The end index is at a normalization boundary. (See the class documentation for more about normalization boundaries.)

When the goal is a normalized string and most input strings are expected to be normalized already, then call this method, and if it returns a prefix shorter than the input string, copy that prefix and use normalizeSecondAndAppend() for the remainder.

Parameters

norm2	UNormalizer2 instance
s	input string
length	length of the string, or -1 if NUL-terminated
pErrorCode	Standard ICU error code. Its input value must pass the U_SUCCESS() test, or else the function returns immediately. Check for U_FAILURE() on output or use with function chaining. (See User Guide for details.)

Returns

"yes" span end index

Stable:

ICU 4.4

Compares two strings for canonical equivalence.

Further options include case-insensitive comparison and code point order (as opposed to code unit order).

Canonical equivalence between two strings is defined as their normalized forms (NFD or NFC) being identical. This function compares strings incrementally instead of normalizing (and optionally case-folding) both strings entirely, improving performance significantly.

Bulk normalization is only necessary if the strings do not fulfill the FCD conditions. Only in this case, and only if the strings are relatively long, is memory allocated temporarily. For FCD strings and short non-FCD strings there is no memory allocation.

Semantically, this is equivalent to strcmp[CodePointOrder](NFD(foldCase(NFD(s1))), NFD(foldCase(NFD(s2)))) where code point order and foldCase are all optional.

UAX 21 2.5 Caseless Matching specifies that for a canonical caseless match the case folding must be performed first, then the normalization.

Parameters

s1	First source string.
length1	Length of first source string, or -1 if NUL-terminated.
s2	Second source string.
length2	Length of second source string, or -1 if NUL-terminated.
options	A bit set of options: U_FOLD_CASE_DEFAULT or 0 is used for default options: Case-sensitive comparison in code unit order, and the input strings are quick-checked for FCD. UNORM_INPUT_IS_FCD Set if the caller knows that both s1 and s2 fulfill the FCD conditions. If not set, the function will quickCheck for FCD and normalize if necessary. U_COMPARE_CODE_POINT_ORDER Set to choose code point order instead of code unit order (see u_strCompare for details). U_COMPARE_IGNORE_CASE Set to compare strings case-insensitively using case folding, instead of case-sensitively. If set, then the following case folding options are used. Options as used with case-insensitive comparisons, currently: U_FOLD_CASE_EXCLUDE_SPECIAL_I (see u_strCaseCompare for details) regular normalization options shifted left by UNORM_COMPARE_NORM_OPTIONS_SHIFT
pErrorCode	ICU error code in/out parameter. Must fulfill U_SUCCESS before the function call.

Returns

<0 or 0 or >0 as usual for string comparisons

See also

unorm_normalize

UNORM_FCD

u_strCompare

u_strCaseCompare

Stable:

ICU 2.2

Referenced by icu::Normalizer::compare().