Commit graph

13 commits

Author SHA1 Message Date
Stephen Dennis
14541d5335 Backport Unicode fixes: pairs DFA, collation NFC tiebreaker, tool updates
Port three fixes from libutf/master:

1. Fix pairs DFA generator: always resolve undefined transitions
   before optimization. The old code only called SetUndefinedStates
   when -d was passed, causing NFC over-composition and DUCET
   contraction false-matches.

2. Regenerate NFC compose tables (129→1010 states) and DUCET
   contraction tables (27→294 states) with the corrected generator.

3. NFC tiebreaker in collation: normalize to NFC before binary
   comparison so canonically equivalent strings compare equal per UCA.

Also updates all four table generator tools (classify, integers,
strings, pairs) to support -o/-i flags for output file control,
and adds LIBMUX_API compat define to Makefile.in preamble.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-24 18:44:40 -06:00
Stephen Dennis
dbd7cb4267 Use nullptr instead of NULL. 2025-03-30 09:10:10 -06:00
Stephen Dennis
8b1c5cdd9e Remove SVN version stamp. 2020-08-08 17:39:08 -06:00
brazilofmux
6aa4d2e0fd Fix Ubuntu compiler warnings. 2010-11-28 18:19:54 -08:00
brazilofmux
25ea4afafc Use run-length encoded Unicode tables. 2009-02-01 13:40:38 -08:00
brazilofmux
11f4912245 Remove ReportStatus(). 2009-01-31 16:41:12 -08:00
brazilofmux
f52657b803 Generate separate copy/paste for stringutil.cpp and stringutil.h to make it less manual. 2008-04-12 22:20:42 -07:00
brazilofmux
8ede1865a0 Fix compiler warnings. 2007-12-21 15:00:45 -08:00
brazilofmux
34932af89f -- Build tr_tolower.txt and tr_toupper.txt from UnicodeMaster.
-- Support wider range of upper and lower case code points.

git-svn-id: https://tinymux.googlecode.com/svn/branches/dev_brazil@1652 d1b986fa-651c-0410-a323-35a8662cf44d
2007-05-09 15:17:54 -07:00
brazilofmux
49bf8fa540 -- Document current behavior of integers.cpp.
git-svn-id: https://tinymux.googlecode.com/svn/branches/dev_brazil@1649 d1b986fa-651c-0410-a323-35a8662cf44d
2007-05-09 15:17:12 -07:00
brazilofmux
9fa550a98a -- Change -c option to -d.
git-svn-id: https://tinymux.googlecode.com/svn/branches/dev_brazil@1634 d1b986fa-651c-0410-a323-35a8662cf44d
2007-05-09 15:11:08 -07:00
brazilofmux
3e58cd243c -- Change input format of integers.cpp so that value is second column.
git-svn-id: https://tinymux.googlecode.com/svn/branches/dev_brazil@1619 d1b986fa-651c-0410-a323-35a8662cf44d
2007-05-09 15:07:20 -07:00
brazilofmux
f24d38a0ea -- Split transform.cpp into integers.cpp and strings.cpp because they are going to handle very different things.
git-svn-id: https://tinymux.googlecode.com/svn/branches/dev_brazil@1616 d1b986fa-651c-0410-a323-35a8662cf44d
2007-05-09 15:05:23 -07:00