upstream/postgresql
1
0
Fork 0
mirror of https://github.com/postgres/postgres.git synced 2026-02-20 08:20:55 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
postgresql/src/common/unicode
History
Bruce Momjian ca3b37487b Update copyright for 2021 
Backpatch-through: 9.5
2021-01-02 13:06:25 -05:00
..
.gitignore Add SQL functions for Unicode normalization 2020-04-02 08:56:27 +02:00
generate-norm_test_table.pl Update copyright for 2021 2021-01-02 13:06:25 -05:00
generate-unicode_combining_table.pl Update copyright for 2021 2021-01-02 13:06:25 -05:00
generate-unicode_norm_table.pl Update copyright for 2021 2021-01-02 13:06:25 -05:00
generate-unicode_normprops_table.pl Update copyright for 2021 2021-01-02 13:06:25 -05:00
Makefile Improve performance of Unicode {de,re}composition in the backend 2020-10-23 11:05:46 +09:00
norm_test.c Update copyright for 2021 2021-01-02 13:06:25 -05:00
README Add support for automatically updating Unicode derived files 2020-01-09 10:08:14 +01:00

README 

This directory contains tools to generate the tables in
src/include/common/unicode_norm.h, used for Unicode normalization. The
generated .h file is included in the source tree, so these are normally not
needed to build PostgreSQL, only if you need to re-generate the .h file
from the Unicode data files for some reason, e.g. to update to a new version
of Unicode.

Generating unicode_norm_table.h
-------------------------------

Run

    make update-unicode

from the top level of the source tree and commit the result.

Tests
-----

The Unicode consortium publishes a comprehensive test suite for the
normalization algorithm, in a file called NormalizationTest.txt. This
directory also contains a perl script and some C code, to run our
normalization code with all the test strings in NormalizationTest.txt.
To download NormalizationTest.txt and run the tests:

    make normalization-check

This is also run as part of the update-unicode target.