kc3-lang/brotli/enc/encode_parallel.cc

Branch : - branch - master - tag - dev/null go/brotli/v1.1.1-rc0 go/cbrotli/v1.1.0 go/cbrotli/v1.1.0.bcr.0 go/cbrotli/v1.1.0.bcr.1 go/cbrotli/v1.1.1-rc0 v0.1.0 v0.2.0 v0.3.0 v0.4.0 v0.6.0 v1.0.0 v1.0.1 v1.0.2 v1.0.3 v1.0.4 v1.0.5 v1.0.6 v1.0.7 v1.0.8 v1.0.9 v1.1.0 v1.1.0rc v1.2.0rc1 v1.2.0rc2

Log

Author	Commit	Date	CI	Message
	20481890	2016-07-26 14:41:59		Update encoder: * booleanification * integer BR scores, may improve performance if FPU is slow * condense speed-quality constants in quality.h * code massage to calm down CoverityScan * hashers refactoring * new hasher - improved speed, compression and reduced memory usage for q:5-9 w:10-16 * reduced static recources -> binary size
	f1c9ab29	2016-06-03 10:51:04		Extract common parts: constants, dictionary, etc.
	3ccbf05d	2016-06-13 11:01:04		Convert encoder to plain C.
	58a3023e	2016-06-03 11:19:23		Transform most of C++ comments to C-style.
	b972c677	2016-06-13 11:01:04		Convert encoder to plain C.
	352b0b28	2016-06-03 11:19:23		Transform most of C++ comments to C-style.
	02829186	2016-06-03 10:51:04		Extract common parts: constants, dictionary, etc.
	b820c39b	2016-03-15 10:50:16		Reduce memory usage of brotli encoder at quality 10 and 11.
	dbb53e64	2016-01-27 09:50:39		Use a hash-to-binary-tree data structure for quality 11 as suggested by Issue #180.
	8844b7f0	2016-01-07 16:27:49		Fix more conversion warnings.
	24ffa784	2015-12-11 11:11:51		Fix headers
	771eb107	2015-11-27 11:27:11		Update license statement in source files.
	ea48ce5a	2015-10-28 17:44:47		Fix --Wconversion and --pedantic-erros for the encoder.
	2726b8a4	2015-10-06 11:23:44		Encoder fixes. * Remove default constructors. * Initialize bit_cost in histogram.Clear(). * Check fseek result in FileSize. * Replace malloc in BrotliFileIn constructor with "new". * Catch bad_alloc in bro tool.
	b39eec88	2015-10-05 11:43:49		Remove C++11 vector::data() calls from encoder.
	4c37566f	2015-10-01 15:10:42		Move literal cost computation to where it's used. Move utf8 heuristics functions to their own file.
	4a7024dc	2015-10-01 12:08:14		Make the brotli encoder C++98 compatible.
	17ed2589	2015-08-10 13:13:58		msan bugfixes to the brotli encoder
	618287b3	2015-06-12 16:50:49		Deprecate greedy_block_split and enable_context_modeling brotli params. These affected only quality 11, and now it does not make sense to disable block splitting or context modeling because most of the time is spent in zopfli anyway. Now all speed vs size compromises are controlled by the quality param.
	66098830	2015-06-12 16:45:17		Use a static hash table to look up dictionary words and transforms. This is used for quality 11, for qualities <= 9 we already have a simpler hash table. The static data size is 252 kB, and this removes the need to initialize a huge hash map at startup, which was the reason why transforms had to be disabled by default. In comparison, the static dictionary itself is 120 kB. This supports every transform, except the kOmitFirstN.
	b3d3723f	2015-06-12 16:25:41		Add "zopfli"-style backward reference search to brotli. This commit adopts the backward reference search algorithm from the zopfli project (see https://github.com/google/zopfli) to brotli. This slower backward reference search is run only in quality 11 and it runs two iterations of entropy cost modeling and shortest path search. As a result, the original backward reference search function can be simplified a bit, since we can remove some heuristics that were replaced with the zopfli-style search.
	65f3fc55	2015-06-12 16:11:50		Bug fixes for the brotli encoder. * Fix an out-of-bounds access to depth_histo in the bit cost calculation function. * Change type of distance symbol to uint16_t in block splitter, because if all postfix bits are used, there can be 520 distance symbols. * Save the distance cache between meta-blocks at the correct place. This fixes a roundtrip failure that can occur when there is an uncompressed metablock between two compressed metablocks. * Fix a bug when setting lgwin to 24 in the encoder parameters It ended up making metablocks larger than 24 bits in size. * Fix out-of-bounds memory accesses in parallel encoder. CreateBackwardReferences can read up to 4 bytes past end of input if the end of input is before mask. * Add missing header for memcpy() in port.h
	54f69c9e	2015-05-07 17:44:33		Support window bits 10 - 15 in the decoder. The previous window bit value 17 is used to extend the range, since it has not been used in any previous encoders.
	0f726df1	2015-04-28 10:12:47		Don't do any block splitting for quality 1.
	98539223	2015-04-23 16:20:29		Remove quality parameter from bitstream writing functions. Fix a few crashes related to some quality and param combinations.
	2fd80cdc	2015-04-23 15:43:37		Encoder support for new empty meta-block format. Changed the parallel implementation to sync meta-blocks to byte boundary by emitting empty meta-blocks.
	89a6fb85	2015-04-23 13:15:42		Add params to disable static dictionary and context modeling. Disable all slow features for quality <= 9 (literal cost modeling, dictionary, context modeling, advanced block splitting). Change vector<Command> arguments of internal functions to Command* and size_t.
	1428d541	2015-04-01 16:35:52		Proof-of-concept encoder for parallel compression. Add a version of the brotli encoder that compresses each meta-block independently, only using the original input data from previous meta-blocks and nothing from the compressor state. This is a proof-of-concept to show that the current format is flexible enough to support parallel multi-threaded compression.