src/gen-ucd-table.py

Branch


Log

Author Commit Date CI Message
Behdad Esfahbod 0a257b01 2025-08-15T00:54:52 [gen-ucd-table] Rust clippy
Behdad Esfahbod 03d516f8 2025-08-15T00:52:44 [ucd] Change compression level from 5 to 3 (#5466) 3kb bigger binary size. 1% faster in Roboto.
Behdad Esfahbod f9e6c84d 2025-08-13T18:18:57 [gen-ucd-table] Add another clippy warning
Behdad Esfahbod fc623172 2025-06-10T16:44:24 [gen-ucd] Make clippy happy
Behdad Esfahbod 2da18507 2025-05-13T00:04:52 [gen-ucd-table] Adjust comment with --rust
Behdad Esfahbod 02bc78c7 2025-05-12T19:56:19 [gen-ucd-table] Make --rust functions pub
Behdad Esfahbod 2d1d1b36 2025-05-12T17:08:08 [gen-ucd-rust] Fix --rust output
Behdad Esfahbod 4f1ee743 2025-05-12T15:43:15 [gen-ucd-table] Fix --rust output
Behdad Esfahbod 37e7120a 2025-05-12T15:30:42 [ucd] Don't use unsigned literals More compat with --rust.
Behdad Esfahbod 083ca198 2025-05-12T15:25:14 [gen-ucd-table.py] black
Behdad Esfahbod d5c4b1ee 2025-05-12T15:24:38 [gen-ucd-table.py] Towards generating --rust output
Behdad Esfahbod eb40c1f4 2025-05-12T13:35:15 [gen-ucd-table] Update for hb-script-list.h
Behdad Esfahbod 76ce390b 2022-11-20T13:54:56 [ucd] Document algorithms
Behdad Esfahbod ba08de62 2022-11-19T13:14:18 [ucd] Change OPTIMIZE_SIZE to compression level 9 Also changes default compression level from 3 to 5, but that shows no change in the generated table size.
Behdad Esfahbod 90a3355e 2022-07-30T00:01:50 [ucd-table] Use more compact compression numbers Doesn't show any slowdown in benchmarks.
Ebrahim Byagowi 82c6ddb9 2020-07-03T15:09:10 [py] remove not needed imports
Ebrahim Byagowi 368ca306 2020-05-29T00:42:32 minor on python scripts * remove not needed imports * remove semicolons
Ebrahim Byagowi 7554f618 2020-05-28T22:51:29 minor, use sys.exit print shorthand
Ebrahim Byagowi 08f1d95a 2020-05-28T15:01:15 minor, move scripts manuals to __doc__
David Corbett fd748fac 2020-03-15T15:59:31 Update to Unicode 13.0.0
Ebrahim Byagowi 8d199077 2020-02-19T14:56:55 Remove python2 support from tests/utils scripts
Ebrahim Byagowi 6a390df8 2020-02-10T17:19:23 [tools] Print unicode links on gen-* tools output As Behdad's review
Evgeniy Reizner 4dc87365 2020-02-09T18:39:33 Add links to files used by python scripts. Closes #2150
Behdad Esfahbod f1d20d9b 2019-07-02T14:18:38 Add ucd-table make target
Behdad Esfahbod 3bfa878c 2019-06-25T19:07:07 [gen-ucd] Protect against accidents like previous commit https://github.com/harfbuzz/harfbuzz/pull/1796
David Corbett f4ea1a9a 2019-06-25T21:08:14 [ucd] Include scripts added in Unicode 10 or later
David Corbett fb0df17b 2019-06-24T21:54:26 Correct "nonunihan" to "nounihan"
Behdad Esfahbod ec8e635e 2019-06-24T12:37:23 [ucd] Use custom encoding to shrink composition data Saves another 2.5kb. Part of https://github.com/harfbuzz/harfbuzz/issues/1652
Behdad Esfahbod 9c933aca 2019-06-23T17:14:27 [ucd] Save a few more bytes Part of https://github.com/harfbuzz/harfbuzz/issues/1652
Behdad Esfahbod ad97ec95 2019-06-21T00:44:29 [config/ucd] Add HB_NO_UNICODE_UNASSIGNED and activate in HB_TINY Saves another 12kb: $ python ./gen-ucd-table.py ucd.nounihan.grouped.zip > hb-ucd-table.hh && make -j5 CPPFLAGS='-Os -DHB_TINY' -C ~/hb/build/src/ && size ~/hb/build/src/.libs/libharfbuzz_la-hb-ucd.o INFO: Loading UCDXML... INFO: Preparing data tables... INFO: Generating output... INFO: Compression=1: INFO: Dataset=gc FullCost=18612 INFO: Dataset=ccc FullCost=3550 INFO: Dataset=bmg FullCost=1548 INFO: Dataset=sc FullCost=17765 INFO: Dataset=dm FullCost=13325 INFO: Compression=3: INFO: Dataset=gc FullCost=10726 INFO: Dataset=ccc FullCost=2389 INFO: Dataset=bmg FullCost=1052 INFO: Dataset=sc FullCost=13669 INFO: Dataset=dm FullCost=7780 INFO: Compression=5: INFO: Dataset=gc FullCost=8274 INFO: Dataset=ccc FullCost=2055 INFO: Dataset=bmg FullCost=908 INFO: Dataset=sc FullCost=4073 INFO: Dataset=dm FullCost=7780 INFO: Done. Part of https://github.com/harfbuzz/harfbuzz/issues/1652
Behdad Esfahbod b1a2384a 2019-06-19T17:34:12 [ucd] Print out table sizes
Behdad Esfahbod 5074d665 2019-06-07T14:20:45 [ucd] Save another 1.5kb https://github.com/harfbuzz/harfbuzz/issues/1652
Behdad Esfahbod 771712b3 2019-05-25T15:58:45 [ucd] Update for recent packTab No need for separate youseedy package.
Behdad Esfahbod ad17a8bd 2019-05-25T16:33:21 [ucd] Update for latest packTab
Behdad Esfahbod 226ab06e 2019-05-23T20:39:04 [ucd] Add URL to dependencies
Behdad Esfahbod 65392b73 2019-05-22T16:21:21 [ucdn] Replace UCDN with a new UCD implementation UCDN was ~120kb of data. New implementatoin is 69kb in default builds, and 49kb if built with HB_OPTIMIZE_SIZE or __OPTIMIZE_SIZE__. The latter automatically enabled if built with -Os or -Oz. There's room to shave off another 10kb or 20kb. That will follow later. Fixes https://github.com/harfbuzz/harfbuzz/issues/1652
Behdad Esfahbod 36dee922 2019-05-22T15:51:53 [gen-ucd] Rename