|
ef2f457f
|
2024-12-15T10:37:13
|
|
Support multiple suffixes in iconv_open, like glibc does.
* lib/iconv_open1.h: Use a loop when looking for the common suffixes.
* tests/test-discard.c: New file.
* tests/Makefile.in (check): Run test-discard.
(test-discard, test-discard.@OBJEXT@): New targets.
(clean): Remove test-discard.
(SOURCE_FILES): Add test-discard.c.
* NEWS: Mention the change.
|
|
|
a4c1470b
|
2024-12-13T23:55:13
|
|
Distinguish byte-order state and shift-state.
Reported by Tomas Kalibera <tomas.kalibera@gmail.com> in
<https://lists.gnu.org/archive/html/bug-gnu-libiconv/2024-12/msg00000.html>.
* lib/converters.h (struct conv_struct): Add field 'ibyteorder'.
* lib/iconv_open2.h: Initialize the ibyteorder field.
* lib/ucs2.h (ucs2_mbtowc): Use the ibyteorder field instead of the
istate field.
* lib/ucs4.h (ucs4_mbtowc): Likewise.
* lib/utf16.h (utf16_mbtowc): Likewise.
* lib/utf32.h (utf32_mbtowc): Likewise.
* tests/test-bom-state.c: New file.
* tests/Makefile.in (check): Run test-bom-state.
(test-bom-state, test-bom-state.@OBJEXT@): New targets.
(clean): Remove test-bom-state.
(SOURCE_FILES): Add test-bom-state.c.
* NEWS: Mention the change.
|
|
|
6549d20c
|
2023-05-21T00:29:37
|
|
Implement GB18030 version 2022.
* lib/encodings.def (GB18030): Add alias GB18030:2005.
(GB18030:2022): New encoding.
* lib/gb18030ext.h (gb18030_2005_ext_2uni_pagefe): Renamed from
gb18030ext_2uni_pagefe.
(gb18030_2022_ext_2uni_pagefe): New array.
(gb18030_2005_ext_mbtowc): Renamed from gb18030ext_mbtowc.
(gb18030_2022_ext_mbtowc): New function.
(gb18030_2005_ext_wctomb): Renamed from gb18030ext_wctomb.
(gb18030_2022_ext_wctomb): New function.
* lib/gb18030uni.h (gb18030_2022_charset2uni_pua1,
gb18030_2022_charset2uni_pua2): New arrays.
(gb18030_2005_uni_mbtowc): Renamed from gb18030uni_mbtowc.
(gb18030_2022_uni_mbtowc): New function.
(gb18030_2022_uni2charset_pua1, gb18030_2022_uni2charset_pua2): New
arrays.
(gb18030_2005_uni_wctomb): Renamed from gb18030uni_wctomb.
(gb18030_2022_uni_wctomb): New function.
* lib/gb18030_2005.h: Renamed from lib/gb18030.h. Update comments.
(gb18030_2005_mbtowc): Renamed from gb18030_mbtowc.
(gb18030_2005_pua2charset): Renamed from gb18030_pua2charset.
(gb18030_2005_wctomb): Renamed from gb18030_wctomb.
* lib/gb18030_2022.h: New file, based on lib/gb18030_2005.h.
* lib/converters.h: Don't include gb18030.h. Include gb18030_2005.h,
gb18030_2022.h.
* lib/Makefile.in (SOURCE_FILES): Remove gb18030.h. Add gb18030_2005.h,
gb18030_2022.h.
* tests/GB18030-2005-BMP.TXT: Renamed from tests/GB18030-BMP.TXT.
* tests/GB18030-2005.IRREVERSIBLE.TXT: Renamed from
tests/GB18030.IRREVERSIBLE.TXT.
* tests/GB18030-2022-BMP.TXT: New file.
* tests/Makefile.in (check): Test GB18030:2005 instead of GB18030. Also
test GB18030:2022.
(clean): Don't remove GB18030.TXT. Instead, remove GB18030-2005.TXT and
GB18030-2022.TXT.
(SOURCE_FILES): Update. Add GB18030-2022-BMP.TXT.
* README: Mention the new encoding.
* man/iconv_open.3: Likewise.
* NEWS: Likewise.
|
|
|
af375a34
|
2023-05-12T22:50:18
|
|
Integrate the last change.
* src/Makefile.in (SOURCE_FILES): Add zos-tag.h.
* tests/Makefile.in (SOURCE_FILES): Add check-tag.
* NEWS: Mention the new functionality.
|
|
153d4079
|
2023-05-12T22:41:08
|
|
On z/OS, set a charset tag on iconv's output file.
For the concept of charset tags as external metadata on z/OS files, see
<https://lists.gnu.org/archive/html/bug-gnu-libiconv/2023-04/msg00021.html>.
* src/zos-tag.h: New file.
* src/iconv.c: Include zos-tag.h.
(convert): Add a 'tocode' parameter. On z/OS, turn off auto-conversion
and tag the output file.
(main): Update callers.
* tests/check-ebcdic: On z/OS, make all test files initially untagged.
* tests/check-tag: New file.
* tests/Makefile.in (check): Pass the host_os to check-ebcdic. Invoke
check-tag.
|
|
|
19b6af5e
|
2023-04-03T04:12:01
|
|
Allow overriding the newline conversion for EBCDIC encodings.
Reported by Mike Fulton <mikefultonpersonal@gmail.com> in
<https://lists.gnu.org/archive/html/bug-gnu-libiconv/2023-04/msg00009.html>.
* include/iconv.h.in (ICONV_SURFACE_NONE,
ICONV_SURFACE_EBCDIC_ZOS_UNIX): New macros.
(ICONV_GET_FROM_SURFACE, ICONV_SET_FROM_SURFACE, ICONV_GET_TO_SURFACE,
ICONV_SET_TO_SURFACE): New macros.
* lib/converters.h (struct conv_struct): Add the fields isurface,
osurface.
(swap_x15_x25): New macro.
* lib/iconv.c (iconv_open, iconv_open_into): Add local variables
from_surface, to_surface.
(ALL_SURFACES): New macro.
(iconvctl): Adjust ICONV_TRIVIALP implementation. Implement the
ICONV_{GET,SET}_{FROM,TO}_SURFACE requests.
* lib/iconv_open1.h: Parse a /ZOS_UNIX surface specifier. Set
from_surface, to_surface.
* lib/iconv_open2.h: Copy the values of from_surface, to_surface into
the conversion descriptor.
* lib/ebcdic*.h (*_mbtowc): Test the isurface. If requested, call
swap_x15_x25 right after fetching an input byte.
(*_wctomb): Test the osurface. If requested, call swap_x15_x25 right
before storing an output byte.
* man/iconvctl.3 (REQUEST VALUES): Document the
ICONV_{GET,SET}_{FROM,TO}_SURFACE requests.
* src/iconv.c (main): If ICONV_EBCDIC_ZOS_UNIX is set, set the from/to
surfaces accordingly.
* man/iconv.1 (ENVIRONMENT): New section.
* tests/check-ebcdic: New file.
* tests/Makefile.in (check): Invoke it.
(SOURCE_FILES): Add it.
* NEWS: Mention the new functionality.
|
|
|
429e0425
|
2022-02-12T13:49:13
|
|
Update source file list (regression 2022-01-23).
* lib/Makefile.in (SOURCE_FILES): Add encodings_zos.def, ebcdic*.h.
(GENERATED_FILES): Add aliases_zos.h, canonical_zos.h.
* tests/Makefile.in (SOURCE_FILES): Add IBM-*.TXT.
|
|
|
68ac8a9f
|
2022-01-23T23:37:30
|
|
New EBCDIC encodings.
Reported by Ulrich Schwab and Calvin Buckley via Jack Woehr.
* NOTES: Mention how to enable EBCDIC encodings.
* tests/IBM-*.TXT: New files.
* tools/8bit_tab_to_h.c (main): Emit copyright header with year 2022.
* tools/Makefile: Add rules for generating ebcdic*.h.
* lib/ebcdic*.h: New files, automatically generated by tools/Makefile.
* lib/ebcdic838.h: Tweak reverse mapping manually.
* lib/ebcdic1160.h: Likewise.
* lib/converters.h: Include all ebcdic*.h.
* lib/encodings_zos.def: New file.
* lib/genaliases2.c: Include encodings_zos.def.
* lib/genflags.c: Likewise.
* Makefile.devel (lib/aliases_zos.h lib/canonical_zos.h): New rule.
(lib/flags.h, totally-clean): Update.
* lib/aliases2.h: Include aliases_zos.h.
* lib/iconv.c (USE_ZOS): New macro.
Include encodings_zos.def, canonical_zos.h.
* README, man/iconv_open.3: Document the IBM-* encodings.
* tests/Makefile.in (check-extra-yes): Also test the EBCDIC encodings.
|
|
|
05b20c93
|
2021-09-19T23:13:57
|
|
tests: Avoid check-subst failures in QEMU user-mode environments.
* Makefile.devel (GNULIB_MODULES): Add stdbool.
(gnulib-imported-files): Copy also tests/qemu.h.
* tests/is-native.c: New file.
* tests/Makefile.in (is-native, is-native.@OBJEXT@): New targets.
(clean): Remove the 'is-native' program.
(SOURCE_FILES): Add is-native.c.
(IMPORTED_FILES): Add qemu.h.
* tests/check-subst: Invoke 'locale charmap' only in native
environments.
|
|
|
1badfd5d
|
2019-01-27T22:57:45
|
|
Accommodate a shell that is not in /bin/sh.
|
|
|
67802283
|
2016-12-03T18:52:49
|
|
Create tarballs through an Automake-like "make dist" command.
|
|
|
da2aa29c
|
2016-10-01T16:37:58
|
|
Update to current gnulib.
|
|
|
3a33986e
|
2011-10-24T02:39:35
|
|
New encoding ISO-2022-CP-MS.
|
|
|
e258a174
|
2011-09-02T21:34:29
|
|
Fix "make check" failure when $(srcdir) != $(builddir).
|
|
|
fd7d5707
|
2010-11-24T03:33:29
|
|
Implement newer release of BIG5-HKSCS.
|
|
|
2cf3ee65
|
2009-07-08T00:22:57
|
|
Fix an endless loop in the conversion to wchar_t.
|
|
|
459ce580
|
2009-01-24T23:16:06
|
|
New converter for CP1131.
|
|
|
ef2cb470
|
2008-09-26T13:17:21
|
|
Link with libicrt.a.
|
|
|
bb8f7987
|
2008-09-07T23:28:41
|
|
More consistent behaviour when invalid input is preceded by a shift sequence.
|
|
|
323c84a1
|
2008-04-14T11:19:33
|
|
More cleanup needed on MacOS X 10.5.
|
|
|
614f279f
|
2007-05-25T23:41:00
|
|
Add support for the Kazakh RK1048 encoding.
|
|
|
c8dc4a2e
|
2006-07-24T12:43:07
|
|
Use the CFLAGS also when linking.
|
|
|
5e08f217
|
2006-07-14T13:24:59
|
|
Treat *.stackdump files like core files.
|
|
|
0707a728
|
2006-07-14T13:18:10
|
|
Fix cleanup on cygwin and mingw.
|
|
|
16ebfb3f
|
2006-05-20T14:45:03
|
|
Test also the stateful parts of BIG5-HKSCS:1999, BIG5-HKSCS:2001,
BIG5-HKSCS:2004.
|
|
|
7edefe50
|
2006-05-18T12:48:00
|
|
Implement newer releases of BIG5-HKSCS.
|
|
|
8663fe9b
|
2006-05-16T19:15:03
|
|
Use EXEEXT, for Cygwin.
|
|
|
422b3b1d
|
2006-01-23T13:25:49
|
|
New feature: character-dependent substitutions.
|
|
|
cfef64ad
|
2005-12-28T14:19:38
|
|
Check the whole range of GB18030.
|
|
|
05a280da
|
2005-12-15T12:43:45
|
|
CP936 is now different from GBK.
|
|
|
38981e01
|
2005-05-23T10:06:44
|
|
Implement BIG5-2003 encoding.
|
|
|
9341db94
|
2005-05-06T11:04:28
|
|
Support for PT154 encoding.
|
|
|
bb98761e
|
2005-03-29T13:55:27
|
|
Implement and document ATARIST converter.
|
|
|
7736228d
|
2004-07-22T12:49:09
|
|
New encoding ISO-8859-11.
|
|
|
9c620c01
|
2004-01-23T12:17:54
|
|
Use binary mode for the testsuite. Needed for mingw build.
|
|
|
5c844a41
|
2003-02-17T10:32:22
|
|
Enable recursive transliteration, with results depending on the target codeset.
|
|
|
e9eef361
|
2002-05-22T12:41:45
|
|
New encodings CP853, TDS565, RISCOS-LATIN1.
|
|
|
485041c8
|
2002-05-29T14:09:04
|
|
Tricky "make install", due to dependencies iconv -> libintl -> libiconv.
|
|
|
b4332637
|
2002-05-18T01:27:16
|
|
Write Shift_JIS instead of Shift-JIS.
|
|
|
377fe8ed
|
2002-05-17T12:07:27
|
|
New JISX0213 based encodings.
|
|
|
ca7aa552
|
2002-05-16T12:01:34
|
|
New configure option --enable-extra-encodings.
Add the extra encodings and the platform dependent encodings to the testsuite.
|
|
|
33057762
|
2002-05-13T10:03:19
|
|
Add KOI8-T encoding.
|
|
|
cf2ecee5
|
2002-01-07T10:39:01
|
|
Fix a bug in transliteration.
|
|
|
2d4f4c89
|
2001-08-08T12:55:08
|
|
Make it possible to build with CC=gcc CFLAGS="-x c++".
|
|
|
c7f1dc92
|
2001-06-25T22:14:38
|
|
Mention $(INCLUDES) before $(CPPFLAGS) and $(CFLAGS), in case one of these
contains -I directives.
|
|
|
19bb4fef
|
2001-05-26T00:31:46
|
|
The multibyte to Unicode conversion may now be stateful.
Add Unicode normalization to multibyte to Unicode direction for
CP1255, CP1258, TCVN.
|
|
|
7397d65d
|
2001-06-06T18:37:24
|
|
Rename BIG5HKSCS to BIG5-HKSCS.
|
|
|
3c597b51
|
2001-05-07T17:26:44
|
|
Use CPPFLAGS and LDFLAGS.
|
|
|
e91c0ce3
|
2001-04-12T12:55:41
|
|
Add UTF-32 encodings.
|
|
|
cdae1a8f
|
2001-02-26T13:40:58
|
|
Avoid warnings about iconv()'s second argument.
|
|
|
06aa1274
|
2001-01-05T13:52:21
|
|
Add support for CP862.
|
|
|
a615528b
|
2000-11-23T19:54:07
|
|
Move src/ to lib/, and install the iconv program.
|
|
|
d51d26bc
|
2000-11-20T18:33:47
|
|
Add support for locale dependent "char" and "wchar_t" encodings.
|
|
|
8333237d
|
2000-10-23T14:20:07
|
|
Add support for GB18030 and BIG5HKSCS.
|
|
|
da1ff855
|
2000-03-15T20:22:04
|
|
Upgrade to libiconv-1.2.
|
|
|
6d93d60b
|
2000-04-17T17:18:14
|
|
Upgrade to libiconv-1.3.
|
|
|
c37afd43
|
2000-01-24T13:06:57
|
|
Upgrade to libiconv-1.1.
|
|
|
00e960fc
|
2000-01-04T21:56:56
|
|
Upgrade to libiconv-1.0.
|