kc3-lang/brotli

Branch :

Log

Commit	Date	Message
a81f2ef4	2015-04-22 14:25:08	Decoder support for new empty meta-block format. This change enforces the new 16MB limit on the size of the meta-blocks and adds support for empty meta-blocks with optional ignored metadata.
f393bff2	2015-04-22 13:18:52	Merge pull request #76 from szabadka/master Support empty meta-blocks with optional ignored metadata.
2d8b2ec1	2015-04-22 12:41:57	Support empty meta-blocks with optional ignored metadata. This is a partially backward incompatible format change, that makes previously valid brotli streams that contain larger than 16MB meta-blocks invalid. The impact of this should be minimal, since the 'bro' command-line tool does not create larger than 2MB meta-blocks, so the only streams this change could break are those created by a custom brotli encoder. This commit contains only the specification update, implementation in the decoder and encoder will follow in later commits.
d941130e	2015-04-22 12:27:08	Merge pull request #75 from szabadka/master Change the specification to be less strict in some cases.
5b80ef0f	2015-04-22 12:08:16	Change the specification to be less strict in some cases. In the following three cases we allow more choices for the compressor, which can potentially lead to less compressed bits. (1) Allow brotli streams where the block counts do not count down to exactly zero at the end of the meta-block. This makes it possible for compressors to sometimes choose a block count which can be represented with less bits than the exact block count. (2) Remove the restriction that prefix code descriptions with exactly one non-zero length symbol in the code length alphabet must have 1 bit depth. This is because bit depth 1 requires the most bits to encode. (3) Allow any copy length value in the last command where the copy part is ignored. This makes it possible for a compressor to choose a copy length which can be represented with the least amount of bits. In addition to the changes above, this commit also has a wording clarification in the overview section where the use of the 'context ID' expression is changed to be consistent with the rest of the specification, i.e. that it is a function of the last two literals or the copy length.
8fe88e4b	2015-04-22 11:57:26	Merge pull request #74 from szabadka/master Use consistent sentence spacing in the specification.
206d067c	2015-04-22 11:55:29	Use consistent sentence spacing in the specification. All sentence spacing was changed to one space, except in the boilerplate which must be preserved verbatim.
0c1a2221	2015-04-22 11:44:38	Merge pull request #73 from szabadka/master Add Mark Adler's edits to the specification.
e9fd1a4f	2015-04-22 11:33:38	Add Mark Adler's edits to the specification. The specification source is changed in this commit to exactly mirror the specification edited by Mark Adler: https://github.com/madler/brotli/blob/master/brotli-02-edit.nroff (version 70e53d7)
7310f1b9	2015-04-16 14:35:55	Merge pull request #71 from anthrotype/pypy_unbuffered [python] fix unbuffered binary mode for I/O streams in Windows pypy
b316cb74	2015-04-16 12:41:40	[python] fix unbuffered binary mode for I/O streams in Windows pypy
9e53d522	2015-04-08 16:16:22	Merge pull request #69 from szabadka/master Spec clarifications for Section 7.
f80ccecd	2015-04-08 16:15:09	Spec clarifications for Section 7. Based on Mark Adler's review comments.
653d9f94	2015-04-08 11:11:15	Merge pull request #68 from szabadka/master Spec clarifications for Section 8.
dcdc68e6	2015-04-08 11:07:00	Spec clarifications for Section 8. Based on Mark Adler's review comments.
8618383b	2015-04-07 17:27:54	Merge pull request #67 from szabadka/master Some wording changes to Section 2 of the spec.
92b55173	2015-04-07 17:23:37	Some wording changes to Section 2 of the spec.
f9bb85eb	2015-04-07 17:01:20	Merge pull request #66 from szabadka/master Add the current version of the brotli specification.
707b78ae	2015-04-07 16:58:07	Add the current version of the brotli specification. Add the .nroff source file and a python script to generate the .txt version (requires the nroff command).
570c2950	2015-04-02 11:12:51	Merge pull request #64 from szabadka/master Limit the max input meta-block size to 16MB.
e377e65f	2015-04-02 11:12:04	Limit the max input meta-block size to 16MB.
17025f2b	2015-04-01 16:39:33	Merge pull request #63 from szabadka/master Proof-of-concept encoder for parallel compression.
1428d541	2015-04-01 16:35:52	Proof-of-concept encoder for parallel compression. Add a version of the brotli encoder that compresses each meta-block independently, only using the original input data from previous meta-blocks and nothing from the compressor state. This is a proof-of-concept to show that the current format is flexible enough to support parallel multi-threaded compression.
f25f65ab	2015-04-01 16:30:05	Merge pull request #62 from szabadka/master Add an input block size parameter to brotli.
817a3edd	2015-04-01 16:29:04	Add an input block size parameter to brotli. This will enable processing the input in smaller chunks than the currently default 2MB for the slow brotli, while still benefiting from the larger sliding window.
65ea6ef4	2015-04-01 16:25:44	Merge pull request #61 from szabadka/master Update the previous two bytes when decoding an uncompressed metablock.
2a7bbfc5	2015-04-01 16:23:18	Update the previous two bytes when decoding an uncompressed metablock.
28dea6a6	2015-04-01 16:20:59	Merge pull request #60 from szabadka/master Add a missing state transition to CopyUncompressedBlockToOutput().
fac8993b	2015-04-01 16:20:16	Add a missing state transition to CopyUncompressedBlockToOutput().
bdb4e333	2015-04-01 16:17:25	Merge pull request #59 from szabadka/master Faster decoder for data with trivial context maps.
fe6e5d1c	2015-04-01 16:15:39	Faster decoder for data with trivial context maps. This makes it 20% faster when decoding data with trivial context map (where the histogram type depends only on the block type and not the context).
872b058d	2015-04-01 16:12:18	Merge pull request #58 from szabadka/master Add quality and lgwin to the BrotliParams.
d6d69ec4	2015-04-01 16:10:15	Add quality and lgwin to the BrotliParams. Remove the hard-coded constants for window size and meta-block size. Initialize internal storage for each metablock separately and reserve only as much as needed for the actual input.
5e3e97e2	2015-03-31 17:40:53	Merge pull request #57 from anthrotype/sdist [python] moved setup.py to the root of repository
77c23995	2015-03-31 09:30:56	[python] moved setup.py to the root of repository
d44a174a	2015-03-30 18:02:15	Merge pull request #56 from lvandeve/master bugfixes affecting streaming decoding
f9e5a2d9	2015-03-30 18:00:40	bugfixes affecting streaming decoding
ad354af1	2015-03-30 13:47:00	Merge pull request #54 from szabadka/master Use FastLog2() instead of log() in BitsEntropy().
ca3a7a98	2015-03-30 13:41:52	Use FastLog2() instead of log() in BitsEntropy().
71d87863	2015-03-30 13:41:15	Merge pull request #53 from szabadka/master Add some missing state transitions to DecodeContextMap().
8f3092a0	2015-03-30 13:39:20	Add some missing state transitions to DecodeContextMap(). Update the states in DecodeContextMap to the next one, else it would continue at the wrong spot if exactly there the partial input is split.
44ca0e2c	2015-03-30 12:06:11	Merge pull request #51 from anthrotype/py_test [python] add test command to setup.py
4865fd1d	2015-03-30 10:20:50	[python] add test command to setup.py
fea88b86	2015-03-30 09:59:48	Merge pull request #49 from khaledhosny/fix-python-build Fixing building Python module after 534654d
fa7dd52d	2015-03-27 18:56:18	Fixing building Python module after 534654d
8bda9955	2015-03-27 14:28:32	Merge pull request #48 from szabadka/master Add a faster but less dense compression mode.
534654de	2015-03-27 14:20:35	Add a faster but less dense compression mode. The new mode can be used by setting the greedy_block_split field of BrotliParams to true. This commit moves all the meta-block processing code into its own library and moves the meta-block encoding code to brotli_bit_stream.cc from encode.cc
169c32d8	2015-03-27 13:56:35	Merge pull request #47 from szabadka/master Change the return value of decoder functions from integer codes to an enum.
c5ccd0df	2015-03-27 13:54:43	Change the return value of decoder functions from integer codes to an enum.
c9cc258c	2015-03-26 17:43:55	Merge pull request #45 from lvandeve/master Propagate error condition from ReadHuffmanCodeLengths()
85abce6c	2015-03-26 17:40:07	Propagate error condition from ReadHuffmanCodeLengths()
12abfaf5	2015-03-24 10:21:10	Merge pull request #44 from szabadka/master Remove the redundant EncodeMetaBlockLength() function.
497814ee	2015-03-24 10:18:06	Remove the redundant EncodeMetaBlockHeader() function. Use Store{Compressed,Uncompressed}MetaBlockHeader() instead.
e0aa0cc4	2015-03-23 13:42:15	Merge pull request #43 from anthrotype/fix_py [python] fix calling python script as subprocess on Windows
17866801	2015-03-23 12:09:42	[python] fix calling python script as subprocess on Windows
65c6e679	2015-03-23 09:57:53	Merge pull request #42 from anthrotype/fix_py [python] add state.c and state.h to Brotli extension's setup.py
203fe326	2015-03-22 00:15:54	[python] fix subprocess shell pipeline
064d8e0b	2015-03-21 20:05:02	[python] add new state.c and state.h to Brotli extension's setup.py
30dbb567	2015-03-20 17:03:58	Merge pull request #41 from lvandeve/master a few more tweaks to the streaming support
b1422079	2015-03-20 17:03:11	a few more tweaks to the streaming support
cb49d6a8	2015-03-20 16:17:33	Merge pull request #40 from lvandeve/master support for partial input (streaming)
8270250b	2015-03-20 16:13:15	support for partial input (streaming)
d5c4fb44	2015-03-20 15:56:02	Merge pull request #39 from lvandeve/master separate the licenses from documentation
81cb09f1	2015-03-20 15:44:15	separate the licenses from documentation
4836e87d	2015-03-16 20:35:19	Merge pull request #38 from anthrotype/py_tests add Python port of bro utility and scripts to test Brotli extension
e651c85f	2015-03-16 20:33:14	Merge pull request #37 from anthrotype/setup_py [python] setup.py fixes for Windows
b5ba646b	2015-03-16 20:31:18	Merge pull request #36 from khaledhosny/python-decompress [python] Use BrotliDecompress()
e0c5df8c	2015-03-13 23:55:03	[python] Use BrotliDecompress() So that we can use a callback to dynamically allocate the decompression buffer, getting rid of the optional bufsize argument to decompress.decompress().
b33e10e9	2015-03-16 17:56:10	add Python port of bro utility and scripts to test Brotli extension
3113fe71	2015-02-26 17:58:28	[setup.py] enable C++ exception handling on MSVC compiler to fix warning C4530
dec72c59	2015-02-26 17:56:25	[setup.py] use "-std=c++0x" only with GCC compiler (usupported on MSVC)
855efcf7	2015-02-24 16:10:09	[python/setup.py] use relative paths instead of symlinks (unsupported on Win)
ca29aa22	2015-02-27 16:54:15	Merge pull request #34 from szabadka/master Fix another use of log2() in literal_cost.cc
28135ea9	2015-02-27 16:53:00	Fix another use of log2() in literal_cost.cc
1fce8b80	2015-02-27 16:12:54	Merge pull request #33 from szabadka/master Fix encoder compilation error on MSVS 2010.
fab601e8	2015-02-27 16:04:43	Fix encoder compilation error on MSVS 2010. As reported by @anthrotype, log2() is missing from MSVS 2010. This patch uses log() and a multiplication in FastLog2() for _MSV_VER <= 1600 and uses FastLog2() in literal_cost.cc instead of log2().
e60b7b84	2015-02-25 18:40:17	Merge pull request #30 from szabadka/master Implement a 32-bit bitstream decoder + visual studio support
f0b88cbc	2015-02-25 18:19:51	Fixes to the encoder to support visual studio. Changes suggested by @r-lyeh and @anthrotype. - Use a portable simple PRNG instead of rand_r() - add missing <assert.h> include - disambiguate log2() argument type - remove endian.h include from write_bits.h
6da0c5c9	2015-02-25 13:32:17	Implement a 32-bit bitstream decoder. The 64-bit bitstream decoder seems to have portability problems with emscripten/asm.js as it does not compile into working code.
ff218b18	2015-02-25 10:31:52	Merge pull request #29 from szabadka/master Fully qualify std::max_element, std::push_heap and std::pop_heap names.
5bc56a17	2015-02-25 10:29:24	Fully qualify std::max_element, std::push_heap and std::pop_heap names.
c0d74980	2015-02-25 10:27:14	Merge pull request #28 from szabadka/master Speed up FindMatchLength for non-x86 64-bit targets.
e643328a	2015-02-25 10:24:13	Speed up FindMatchLength for non-x86 64-bit targets. This CL enables 64-bit optimization for non-x86 target.
c7b9821f	2015-02-24 11:35:01	Merge pull request #26 from szabadka/master Fix a sign-conversion warning in the decoder.
68d63f59	2015-02-24 11:22:29	Fix a sign-conversion warning in the decoder.
35cd3db9	2015-02-24 10:41:41	Merge pull request #25 from irori/sign-compare Make decoder code warning-free
65d655da	2015-02-24 17:48:26	Compile decoder with -Wall flag This also fixes two "comparison between signed and unsigned" warnings.
cb0ca3a3	2015-01-28 10:18:34	Merge pull request #17 from khaledhosny/master Add Python bindings
11306237	2014-11-20 14:16:26	Add Python bindings
93049d96	2015-01-13 16:44:13	Merge pull request #23 from szabadka/master Add more test cases.
1d763978	2015-01-13 16:42:35	Add more test cases.
7e350cd4	2014-11-26 12:12:20	Merge pull request #21 from szabadka/master Fix undefined behavior in decoder.
4278934e	2014-11-26 10:37:33	Fix undefined behavior in decoder. Use memmove() for copying overlapping buffers.
50b4f4e6	2014-11-24 16:21:58	Merge pull request #20 from szabadka/master Remove unneeded malloc.h header.
66f6b66c	2014-11-24 16:20:22	Remove unneeded malloc.h header.
88c07359	2014-11-24 10:20:04	Merge pull request #18 from khaledhosny/gitignore Add .gitignore file
9efdff7f	2014-11-22 16:55:58	Add .gitignore file
94000f64	2014-11-17 15:40:22	Merge pull request #16 from szabadka/master Add command-line tool and tests.
ac455c50	2014-11-17 15:31:00	Improvements to the command-line tool. - Don't read the whole input to memory. - Support reading from stdin and writing to stdout.
e1739826	2014-10-30 13:59:37	Add command-line tool and tests.