kc3-lang/brotli
Branch :
Log
| Author | Commit | Date | CI | Message |
|---|---|---|---|---|
 |
288f70d7 | 2015-05-08 11:11:22 | Merge pull request #104 from anthrotype/py3split [python] fix compatibility_test.py with Python 3 | |
 |
e6913b2e | 2015-05-08 10:06:18 | [python] use built-in split instead of 'string' module for py23 In python3, the 'string' module no longer has a 'split' function. | |
|
4e94277e | 2015-05-07 20:46:40 | Merge pull request #103 from szabadka/master Handle multiple compressed files per original in the test. | |
 |
10a2f374 | 2015-05-07 20:43:01 | Handle multiple compressed files per original in the test. Add some more test cases that decompress to the empty file or a one byte long file. These test cases have examples for the updated stream header and meta-block header formats. | |
|
7ee6449b | 2015-05-07 20:37:22 | Merge pull request #102 from szabadka/master Restrict the ARM optimizations to little endian architectures. | |
|
bef6938a | 2015-05-07 20:36:35 | Restrict the ARM optimizations to little endian architectures. | |
|
14c571ca | 2015-05-07 20:11:15 | Merge pull request #101 from szabadka/master Add an Acknowledgements section to the spec. | |
|
78350a91 | 2015-05-07 20:10:22 | Add an Acknowledgements section to the spec. | |
|
f0500266 | 2015-05-07 19:47:14 | Merge pull request #100 from szabadka/master Fix 32bit build. | |
|
f3e71e44 | 2015-05-07 19:45:21 | Fix 32bit build. | |
|
7c277c3e | 2015-05-07 17:45:18 | Merge pull request #99 from szabadka/master Support window bits 10 - 15 in the decoder. | |
|
54f69c9e | 2015-05-07 17:44:33 | Support window bits 10 - 15 in the decoder. The previous window bit value 17 is used to extend the range, since it has not been used in any previous encoders. | |
|
7bbfd5df | 2015-05-07 17:41:11 | Merge pull request #98 from szabadka/master Align distance code meaning in the brotli encoder. | |
|
12eb9bfd | 2015-05-07 17:40:00 | Align distance code meaning in the brotli encoder. Two different definitions (offset by 1) were used in command.h and hash.h. Now they have been made the same, also consistent with the spec (e.g. 0 means use previous dist, etc...) | |
|
fa2c6df4 | 2015-05-07 17:36:37 | Merge pull request #97 from szabadka/master Faster encoding for low quality settings. | |
|
7cde616c | 2015-05-07 17:30:10 | Faster encoding for low quality settings. With this commit, the encoder will skip some compression optimization steps for quality <= 4, which results in faster compression but higher compressed sizes. | |
|
e4a309ac | 2015-05-07 17:24:12 | Merge pull request #96 from szabadka/master Use a static context map with two buckets for UTF8 data. | |
|
945b0d02 | 2015-05-07 17:23:07 | Use a static context map with two buckets for UTF8 data. Enabled for quality >= 4, and if there are no obvious UTF8 violations detected. For each block, we gather two separate histograms, one for continuation bytes and one for ASCII or lead bytes. | |
|
762f9ba5 | 2015-05-07 17:13:06 | Merge pull request #95 from szabadka/master Decoder optimizations for ARM architecture. | |
|
5f39d607 | 2015-05-07 17:10:27 | Decoder optimizations for ARM architecture. | |
|
500c85ac | 2015-05-07 17:00:58 | Merge pull request #94 from szabadka/master Speed and memory usage improvements for the decoder. | |
|
83aa24dc | 2015-05-07 16:53:43 | Speed and memory usage improvements for the decoder. * Change order of members of bit reader state structure. * Remove unused includes for assert. Add BROTLI_DCHECK macros and use it instead of assert. * Do not calculate nbits in common case of ReadSymbol. * Introduce and use PREDICT_TRUE / PREDICT_FALSE macros. * Allocate less memory in the brotli decoder if it knows the result size beforehand. Before this, the decoder would always allocate 16MB if the encoder annotated the window size as 22 bit (which is the default), even if the file is only a few KB uncompressed. Now, it'll only allocate a ringbuffer as large as needed for the result file. But only if it can know the filesize, it's not possible to know that if there are multiple metablocks or too large uncompressed metablock. | |
|
47ea7618 | 2015-04-28 10:14:55 | Merge pull request #93 from szabadka/master Don't do any block splitting for quality 1. | |
|
0f726df1 | 2015-04-28 10:12:47 | Don't do any block splitting for quality 1. | |
|
344ea8ed | 2015-04-28 10:08:52 | Merge pull request #92 from szabadka/master Fix an error propagation bug in the decoder. | |
|
fe14d7b3 | 2015-04-28 10:07:12 | Fix an error propagation bug in the decoder. | |
|
4f902dcc | 2015-04-27 18:27:00 | Merge pull request #91 from szabadka/master Fix the year on the copyright message. | |
|
94bc27d8 | 2015-04-27 18:25:59 | Fix the year on the copyright message. | |
|
5a1cf141 | 2015-04-27 18:12:55 | Merge pull request #90 from szabadka/master Change the expiration date and title of the -03 draft. | |
|
fd4a0481 | 2015-04-27 18:12:09 | Change the expiration date and title of the -03 draft. | |
|
29a72665 | 2015-04-27 18:04:12 | Merge pull request #89 from szabadka/master Create -03 version of the internet draft. | |
|
98bd8841 | 2015-04-27 17:52:21 | Create -03 version of the internet draft. | |
|
f8bfe068 | 2015-04-23 16:44:35 | Merge pull request #88 from szabadka/master Remove the 'override' keyword from ~BrotliFileIn(). | |
|
99af4df8 | 2015-04-23 16:43:38 | Remove the 'override' keyword from ~BrotliFileIn(). Apparently MSVS 2010 does not support this. | |
|
977bec51 | 2015-04-23 16:23:36 | Merge pull request #87 from szabadka/master Remove quality parameter from bitstream writing functions. | |
|
98539223 | 2015-04-23 16:20:29 | Remove quality parameter from bitstream writing functions. Fix a few crashes related to some quality and param combinations. | |
|
e94bddd0 | 2015-04-23 15:56:54 | Merge pull request #86 from szabadka/master Add a static hash table based dictionary lookup to fast brotli. | |
|
e91a4492 | 2015-04-23 15:55:43 | Add dictionary_hash.h to setup.py. | |
|
fdfb1980 | 2015-04-23 15:52:32 | Add a static hash table based dictionary lookup to fast brotli. | |
|
16a219bb | 2015-04-23 15:45:48 | Merge pull request #85 from szabadka/master Encoder support for new empty meta-block format. | |
|
2fd80cdc | 2015-04-23 15:43:37 | Encoder support for new empty meta-block format. Changed the parallel implementation to sync meta-blocks to byte boundary by emitting empty meta-blocks. | |
|
098c9288 | 2015-04-23 15:36:03 | Merge pull request #84 from szabadka/master Fix entropy calculation. | |
|
6d80610f | 2015-04-23 15:35:16 | Fix entropy calculation. | |
|
5ea92475 | 2015-04-23 15:30:51 | Merge pull request #83 from szabadka/master Encoder implementation using input/output classes. | |
|
3dbe2e03 | 2015-04-23 15:26:08 | Encoder implementation using input/output classes. Add a BrotliCompress() method to the public encoder API that uses the BrotliIn and BrotliOut classes and use that in the 'bro' command-line tool. Use the streaming api in BrotliCompressBuffer() and BrotliCompressor::WriteMetaBlock(). Use the appropiate hashers for quality <= 9. | |
|
e42eaa09 | 2015-04-23 14:37:50 | Merge pull request #82 from szabadka/master Add input and output classes for streaming compression. | |
|
09aa9ca4 | 2015-04-23 14:35:43 | Add the streams.* files to Makefile and setup.py | |
|
6a530330 | 2015-04-23 14:29:01 | Add input and output classes for streaming compression. | |
|
ec03509d | 2015-04-23 13:55:38 | Merge pull request #81 from szabadka/master Add params to disable static dictionary and context modeling. | |
|
89a6fb85 | 2015-04-23 13:15:42 | Add params to disable static dictionary and context modeling. Disable all slow features for quality <= 9 (literal cost modeling, dictionary, context modeling, advanced block splitting). Change vector<Command> arguments of internal functions to Command* and size_t. | |
|
0c81a136 | 2015-04-23 12:05:39 | Merge pull request #35 from mitya57/master Makefile fixes and cleanups | |
|
2492f171 | 2015-04-23 10:44:35 | Merge pull request #80 from anthrotype/test_brotli_py [python] prepend build/lib folder to PYTHONPATH before running tests | |
|
cdde52ef | 2015-04-22 17:54:56 | [python] refactored tests and import shared utilities from module | |
|
906f4f52 | 2015-04-22 16:49:00 | [python] prepend build/lib folder to PYTHONPATH before running tests | |
|
7fa45860 | 2015-04-22 17:34:55 | Merge pull request #79 from szabadka/master Add partial output support to the decoder. | |
|
64c26111 | 2015-04-22 17:33:21 | Add partial output support to the decoder. | |
|
5ded1363 | 2015-04-22 14:43:06 | Merge pull request #78 from szabadka/master Implement some stricter format checks in the decoder. | |
|
84a76874 | 2015-04-22 14:38:26 | Merge remote-tracking branch 'upstream/master' | |
|
28b1f7a6 | 2015-04-22 14:35:21 | Implement some stricter format checks in the decoder. - Reject brotli streams where the number of nibbles is too large for the size of the meta-block - Reject brotli streams where the padding bits after a meta-block are not all zero - Reject brotli streams where the symbol in the simple prefix code is not in the symbol alphabet | |
|
42b8c74d | 2015-04-22 14:29:05 | Merge pull request #77 from szabadka/master Decoder support for new empty meta-block format. | |
|
a81f2ef4 | 2015-04-22 14:25:08 | Decoder support for new empty meta-block format. This change enforces the new 16MB limit on the size of the meta-blocks and adds support for empty meta-blocks with optional ignored metadata. | |
|
f393bff2 | 2015-04-22 13:18:52 | Merge pull request #76 from szabadka/master Support empty meta-blocks with optional ignored metadata. | |
|
2d8b2ec1 | 2015-04-22 12:41:57 | Support empty meta-blocks with optional ignored metadata. This is a partially backward incompatible format change, that makes previously valid brotli streams that contain larger than 16MB meta-blocks invalid. The impact of this should be minimal, since the 'bro' command-line tool does not create larger than 2MB meta-blocks, so the only streams this change could break are those created by a custom brotli encoder. This commit contains only the specification update, implementation in the decoder and encoder will follow in later commits. | |
|
d941130e | 2015-04-22 12:27:08 | Merge pull request #75 from szabadka/master Change the specification to be less strict in some cases. | |
|
5b80ef0f | 2015-04-22 12:08:16 | Change the specification to be less strict in some cases. In the following three cases we allow more choices for the compressor, which can potentially lead to less compressed bits. (1) Allow brotli streams where the block counts do not count down to exactly zero at the end of the meta-block. This makes it possible for compressors to sometimes choose a block count which can be represented with less bits than the exact block count. (2) Remove the restriction that prefix code descriptions with exactly one non-zero length symbol in the code length alphabet must have 1 bit depth. This is because bit depth 1 requires the most bits to encode. (3) Allow any copy length value in the last command where the copy part is ignored. This makes it possible for a compressor to choose a copy length which can be represented with the least amount of bits. In addition to the changes above, this commit also has a wording clarification in the overview section where the use of the 'context ID' expression is changed to be consistent with the rest of the specification, i.e. that it is a function of the last two literals or the copy length. | |
|
8fe88e4b | 2015-04-22 11:57:26 | Merge pull request #74 from szabadka/master Use consistent sentence spacing in the specification. | |
|
206d067c | 2015-04-22 11:55:29 | Use consistent sentence spacing in the specification. All sentence spacing was changed to one space, except in the boilerplate which must be preserved verbatim. | |
|
0c1a2221 | 2015-04-22 11:44:38 | Merge pull request #73 from szabadka/master Add Mark Adler's edits to the specification. | |
|
e9fd1a4f | 2015-04-22 11:33:38 | Add Mark Adler's edits to the specification. The specification source is changed in this commit to exactly mirror the specification edited by Mark Adler: https://github.com/madler/brotli/blob/master/brotli-02-edit.nroff (version 70e53d7) | |
|
7310f1b9 | 2015-04-16 14:35:55 | Merge pull request #71 from anthrotype/pypy_unbuffered [python] fix unbuffered binary mode for I/O streams in Windows pypy | |
|
b316cb74 | 2015-04-16 12:41:40 | [python] fix unbuffered binary mode for I/O streams in Windows pypy | |
|
9e53d522 | 2015-04-08 16:16:22 | Merge pull request #69 from szabadka/master Spec clarifications for Section 7. | |
|
f80ccecd | 2015-04-08 16:15:09 | Spec clarifications for Section 7. Based on Mark Adler's review comments. | |
|
653d9f94 | 2015-04-08 11:11:15 | Merge pull request #68 from szabadka/master Spec clarifications for Section 8. | |
|
dcdc68e6 | 2015-04-08 11:07:00 | Spec clarifications for Section 8. Based on Mark Adler's review comments. | |
|
8618383b | 2015-04-07 17:27:54 | Merge pull request #67 from szabadka/master Some wording changes to Section 2 of the spec. | |
|
92b55173 | 2015-04-07 17:23:37 | Some wording changes to Section 2 of the spec. | |
|
f9bb85eb | 2015-04-07 17:01:20 | Merge pull request #66 from szabadka/master Add the current version of the brotli specification. | |
|
707b78ae | 2015-04-07 16:58:07 | Add the current version of the brotli specification. Add the .nroff source file and a python script to generate the .txt version (requires the nroff command). | |
|
570c2950 | 2015-04-02 11:12:51 | Merge pull request #64 from szabadka/master Limit the max input meta-block size to 16MB. | |
|
e377e65f | 2015-04-02 11:12:04 | Limit the max input meta-block size to 16MB. | |
|
17025f2b | 2015-04-01 16:39:33 | Merge pull request #63 from szabadka/master Proof-of-concept encoder for parallel compression. | |
|
1428d541 | 2015-04-01 16:35:52 | Proof-of-concept encoder for parallel compression. Add a version of the brotli encoder that compresses each meta-block independently, only using the original input data from previous meta-blocks and nothing from the compressor state. This is a proof-of-concept to show that the current format is flexible enough to support parallel multi-threaded compression. | |
|
f25f65ab | 2015-04-01 16:30:05 | Merge pull request #62 from szabadka/master Add an input block size parameter to brotli. | |
|
817a3edd | 2015-04-01 16:29:04 | Add an input block size parameter to brotli. This will enable processing the input in smaller chunks than the currently default 2MB for the slow brotli, while still benefiting from the larger sliding window. | |
|
65ea6ef4 | 2015-04-01 16:25:44 | Merge pull request #61 from szabadka/master Update the previous two bytes when decoding an uncompressed metablock. | |
|
2a7bbfc5 | 2015-04-01 16:23:18 | Update the previous two bytes when decoding an uncompressed metablock. | |
|
28dea6a6 | 2015-04-01 16:20:59 | Merge pull request #60 from szabadka/master Add a missing state transition to CopyUncompressedBlockToOutput(). | |
|
fac8993b | 2015-04-01 16:20:16 | Add a missing state transition to CopyUncompressedBlockToOutput(). | |
|
bdb4e333 | 2015-04-01 16:17:25 | Merge pull request #59 from szabadka/master Faster decoder for data with trivial context maps. | |
|
fe6e5d1c | 2015-04-01 16:15:39 | Faster decoder for data with trivial context maps. This makes it 20% faster when decoding data with trivial context map (where the histogram type depends only on the block type and not the context). | |
|
872b058d | 2015-04-01 16:12:18 | Merge pull request #58 from szabadka/master Add quality and lgwin to the BrotliParams. | |
|
d6d69ec4 | 2015-04-01 16:10:15 | Add quality and lgwin to the BrotliParams. Remove the hard-coded constants for window size and meta-block size. Initialize internal storage for each metablock separately and reserve only as much as needed for the actual input. | |
|
5e3e97e2 | 2015-03-31 17:40:53 | Merge pull request #57 from anthrotype/sdist [python] moved setup.py to the root of repository | |
|
77c23995 | 2015-03-31 09:30:56 | [python] moved setup.py to the root of repository | |
 |
d44a174a | 2015-03-30 18:02:15 | Merge pull request #56 from lvandeve/master bugfixes affecting streaming decoding | |
 |
f9e5a2d9 | 2015-03-30 18:00:40 | bugfixes affecting streaming decoding | |
|
ad354af1 | 2015-03-30 13:47:00 | Merge pull request #54 from szabadka/master Use FastLog2() instead of log() in BitsEntropy(). | |
|
ca3a7a98 | 2015-03-30 13:41:52 | Use FastLog2() instead of log() in BitsEntropy(). | |
|
71d87863 | 2015-03-30 13:41:15 | Merge pull request #53 from szabadka/master Add some missing state transitions to DecodeContextMap(). |