1v1.5.0  (May 11, 2021)
2api: Various functions promoted from experimental to stable API: (#2579-2581, @senhuang42)
3  `ZSTD_defaultCLevel()`
4  `ZSTD_getDictID_fromCDict()`
5api: Several experimental functions have been deprecated and will emit a compiler warning (#2582, @senhuang42)
6  `ZSTD_compress_advanced()`
7  `ZSTD_compress_usingCDict_advanced()`
8  `ZSTD_compressBegin_advanced()`
9  `ZSTD_compressBegin_usingCDict_advanced()`
10  `ZSTD_initCStream_srcSize()`
11  `ZSTD_initCStream_usingDict()`
12  `ZSTD_initCStream_usingCDict()`
13  `ZSTD_initCStream_advanced()`
14  `ZSTD_initCStream_usingCDict_advanced()`
15  `ZSTD_resetCStream()`
16api: ZSTDMT_NBWORKERS_MAX reduced to 64 for 32-bit environments (@Cyan4973)
17perf: Significant speed improvements for middle compression levels (#2494, @senhuang42 @terrelln)
18perf: Block splitter to improve compression ratio, enabled by default for high compression levels (#2447, @senhuang42)
19perf: Decompression loop refactor, speed improvements on `clang` and for `--long` modes (#2614 #2630, @Cyan4973)
20perf: Reduced stack usage during compression and decompression entropy stage (#2522 #2524, @terrelln)
21bug: Improve setting permissions of created files (#2525, @felixhandte)
22bug: Fix large dictionary non-determinism (#2607, @terrelln)
23bug: Fix non-determinism test failures on Linux i686 (#2606, @terrelln)
24bug: Fix various dedicated dictionary search bugs (#2540 #2586, @senhuang42 @felixhandte)
25bug: Ensure `ZSTD_estimateCCtxSize*() `monotonically increases with compression level (#2538, @senhuang42)
26bug: Fix --patch-from mode parameter bound bug with small files (#2637, @occivink)
27bug: Fix UBSAN error in decompression (#2625, @terrelln)
28bug: Fix superblock compression divide by zero bug (#2592, @senhuang42)
29bug: Make the number of physical CPU cores detection more robust (#2517, @PaulBone)
30doc: Improve `zdict.h` dictionary training API documentation (#2622, @terrelln)
31doc: Note that public `ZSTD_free*()` functions accept NULL pointers (#2521, @animalize)
32doc: Add style guide docs for open source contributors (#2626, @Cyan4973)
33tests: Better regression test coverage for different dictionary modes (#2559, @senhuang42)
34tests: Better test coverage of index reduction (#2603, @terrelln)
35tests: OSS-Fuzz coverage for seekable format (#2617, @senhuang42)
36tests: Test coverage for ZSTD threadpool API (#2604, @senhuang42)
37build: Dynamic library built multithreaded by default (#2584, @senhuang42)
38build: Move  `zstd_errors.h`  and  `zdict.h`  to  `lib/`  root (#2597, @terrelln)
39build: Allow `ZSTDMT_JOBSIZE_MIN` to be configured at compile-time, reduce default to 512KB (#2611, @Cyan4973)
40build: Single file library build script moved to `build/` directory (#2618, @felixhandte)
41build: `ZBUFF_*()` is no longer built by default (#2583, @senhuang42)
42build: Fixed Meson build (#2548, @SupervisedThinking @kloczek)
43build: Fix excessive compiler warnings with clang-cl and CMake (#2600, @nickhutchinson)
44build: Detect presence of `md5` on Darwin (#2609, @felixhandte)
45build: Avoid SIGBUS on armv6 (#2633, @bmwiedmann)
46cli: `--progress` flag added to always display progress bar (#2595, @senhuang42)
47cli: Allow reading from block devices with `--force` (#2613, @felixhandte)
48cli: Fix CLI filesize display bug (#2550, @Cyan4973)
49cli: Fix windows CLI `--filelist` end-of-line bug (#2620, @Cyan4973)
50contrib: Various fixes for linux kernel patch (#2539, @terrelln)
51contrib: Seekable format - Decompression hanging edge case fix (#2516, @senhuang42)
52contrib: Seekable format - New seek table-only API  (#2113 #2518, @mdittmer @Cyan4973)
53contrib: Seekable format - Fix seek table descriptor check when loading (#2534, @foxeng)
54contrib: Seekable format - Decompression fix for large offsets, (#2594, @azat)
55misc: Automatically published release tarballs available on Github (#2535, @felixhandte)
56
57v1.4.9  (Mar 1, 2021)
58bug: Use `umask()` to Constrain Created File Permissions (#2495, @felixhandte)
59bug: Make Simple Single-Pass Functions Ignore Advanced Parameters (#2498, @terrelln)
60api: Add (De)Compression Tracing Functionality (#2482, @terrelln)
61api: Support References to Multiple DDicts (#2446, @senhuang42)
62api: Add Function to Generate Skippable Frame (#2439, @senhuang42)
63perf: New Algorithms for the Long Distance Matcher (#2483, @mpu)
64perf: Performance Improvements for Long Distance Matcher (#2464, @mpu)
65perf: Don't Shrink Window Log when Streaming with a Dictionary (#2451, @terrelln)
66cli: Fix `--output-dir-mirror`'s Rejection of `..`-Containing Paths (#2512, @felixhandte)
67cli: Allow Input From Console When `-f`/`--force` is Passed (#2466, @felixhandte)
68cli: Improve Help Message (#2500, @senhuang42)
69tests: Remove Flaky Tests (#2455, #2486, #2445, @Cyan4973)
70tests: Correctly Invoke md5 Utility on NetBSD (#2492, @niacat)
71tests: Avoid Using `stat -c` on NetBSD (#2513, @felixhandte)
72build: Zstd CLI Can Now be Linked to Dynamic `libzstd` (#2457, #2454 @Cyan4973)
73build: Hide and Avoid Using Static-Only Symbols (#2501, #2504, @skitt)
74build: CMake: Enable Only C for lib/ and programs/ Projects (#2498, @concatime)
75build: CMake: Use `configure_file()` to Create the `.pc` File (#2462, @lazka)
76build: Fix Fuzzer Compiler Detection & Update UBSAN Flags (#2503, @terrelln)
77build: Add Guards for `_LARGEFILE_SOURCE` and `_LARGEFILE64_SOURCE` (#2444, @indygreg)
78build: Improve `zlibwrapper` Makefile (#2437, @Cyan4973)
79contrib: Add `recover_directory` Program (#2473, @terrelln)
80doc: Change License Year to 2021 (#2452 & #2465, @terrelln & @senhuang42)
81doc: Fix Typos (#2459, @ThomasWaldmann)
82
83v1.4.8  (Dec 18, 2020)
84hotfix: wrong alignment of an internal buffer
85
86v1.4.7  (Dec 16, 2020)
87perf: stronger --long mode at high compression levels, by @senhuang42
88perf: stronger --patch-from at high compression levels, thanks to --long improvements
89perf: faster dictionary compression at medium compression levels, by @felixhandte
90perf: small speed & memory usage improvements for ZSTD_compress2(), by @terrelln
91perf: improved fast compression speeds with Visual Studio, by @animalize
92cli : Set nb of threads with environment variable ZSTD_NBTHREADS, by @senhuang42
93cli : accept decompressing files with *.zstd suffix
94cli : provide a condensed summary by default when processing multiple files
95cli : fix : stdin input no longer confused as user prompt
96cli : improve accuracy of several error messages
97api : new sequence ingestion API, by @senhuang42
98api : shared thread pool: control total nb of threads used by multiple compression jobs, by @marxin
99api : new ZSTD_getDictID_fromCDict(), by @LuAPi
100api : zlibWrapper only uses public API, and is compatible with dynamic library, by @terrelln
101api : fix : multithreaded compression has predictable output even in special cases (see #2327) (issue not accessible from cli)
102api : fix : dictionary compression correctly respects dictionary compression level (see #2303) (issue not accessible from cli)
103build: fix cmake script when using path with spaces, by @terrelln
104build: improved compile-time detection of aarch64/neon platforms, by @bsdimp
105build: Fix building on AIX 5.1, by @likema
106build: compile paramgrill with cmake on Windows, requested by @mirh
107doc : clarify repcode updates in format specification, by @felixhandte
108
109v1.4.6
110fix : Always return dstSize_tooSmall when that is the case
111fix : Fix ZSTD_initCStream_advanced() with static allocation and no dictionary
112perf: Improve small block decompression speed by 20%+, by @terrelln
113perf: Reduce compression stack usage by 1 KB, by @terrelln
114perf: Improve decompression speed by improving ZSTD_wildcopy, by @helloguo (#2252, #2256)
115perf: Improve histogram construction, by @cyan4973 (#2253)
116cli : Add --output-dir-mirror option, by @xxie24 (#2219)
117cli : Warn when (de)compressing multiple files into a single output, by @senhuang42 (#2279)
118cli : Improved progress bar and status summary when (de)compressing multiple files, by @senhuang42 (#2283)
119cli : Call stat less often, by @felixhandte (#2262)
120cli : Allow --patch-from XXX and --filelist XXX in addition to --patch-from=XXX and --filelist=XXX, by @cyan4973 (#2250)
121cli : Allow --patch-from to compress stdin with --stream-size, by @bimbashrestha (#2206)
122api : Do not install zbuff.h, since it has long been deprecated, by @cyan4973 (#2166).
123api : Fix ZSTD_CCtx_setParameter() with ZSTD_c_compressionLevel to make 0 mean default level, by @i-do-cpp (#2291)
124api : Rename ZSTDMT_NBTHREADS_MAX to ZSTDMT_NBWORKERS_MAX, by @marxin (#2228).
125build: Install pkg-config file with CMake and MinGW, by @tonytheodore (#2183)
126build: Install DLL with CMake on Windows, by @BioDataAnalysis (#2221)
127build: Fix DLL install location with CMake, by @xantares and @bimbashrestha (#2186)
128build: Add ZSTD_NO_UNUSED_FUNCTIONS macro to hide unused functions
129build: Add ZSTD_NO_INTRINSICS macro to avoid explicit intrinsics
130build: Add STATIC_BMI2 macro for compile time detection of BMI2 on MSVC, by @Niadb (#2258)
131build: Fix -Wcomma warnings, by @cwoffenden
132build: Remove distutils requirement for meson build, by @neheb (#2197)
133build: Fix cli compilation with uclibc
134build: Fix cli compilation without st_mtime, by @ffontaine (#2246)
135build: Fix shadowing warnings in library
136build: Fix single file library compilation with Enscripten, by @yoshihitoh (#2227)
137misc: Improve single file library and include dictBuilder, by @cwoffenden
138misc: Allow compression dictionaries with missing symbols
139misc: Add freestanding translation script in contrib/freestanding_lib
140misc: Collect all of zstd's libc dependencies into zstd_deps.h
141doc : Add ZSTD_versionString() to manual, by @animalize
142doc : Fix documentation for ZSTD_CCtxParams_setParameter(), by @felixhandte (#2270)
143
144v1.4.5  (May 22, 2020)
145fix : Compression ratio regression on huge files (> 3 GB) using high levels (--ultra) and multithreading, by @terrelln
146perf: Improved decompression speed: x64 : +10% (clang) / +5% (gcc); ARM : from +15% to +50%, depending on SoC, by @terrelln
147perf: Automatically downsizes ZSTD_DCtx when too large for too long (#2069, by @bimbashreshta)
148perf: Improved fast compression speed on aarch64 (#2040, ~+3%, by @caoyzh)
149perf: Small level 1 compression speed gains (depending on compiler)
150cli : New --patch-from command, create and apply patches from files, by @bimbashreshta
151cli : New --filelist= : Provide a list of files to operate upon from a file
152cli : -b -d command can now benchmark decompression on multiple files
153cli : New --no-content-size command
154cli : New --show-default-cparams information command
155api : ZDICT_finalizeDictionary() is promoted to stable (#2111)
156api : new experimental parameter ZSTD_d_stableOutBuffer (#2094)
157build: Generate a single-file libzstd library (#2065, by @cwoffenden)
158build: Relative includes no longer require -I compiler flags for zstd lib subdirs (#2103, by @felixhandte)
159build: zstd now compiles cleanly under -pedantic (#2099)
160build: zstd now compiles with make-4.3
161build: Support mingw cross-compilation from Linux, by @Ericson2314
162build: Meson multi-thread build fix on windows
163build: Some misc icc fixes backed by new ci test on travis
164misc: bitflip analyzer tool, by @felixhandte
165misc: Extend largeNbDicts benchmark to compression
166misc: Edit-distance match finder in contrib/
167doc : Improved beginner CONTRIBUTING.md docs
168doc : New issue templates for zstd
169
170v1.4.4  (Nov 6, 2019)
171perf: Improved decompression speed, by > 10%, by @terrelln
172perf: Better compression speed when re-using a context, by @felixhandte
173perf: Fix compression ratio when compressing large files with small dictionary, by @senhuang42
174perf: zstd reference encoder can generate RLE blocks, by @bimbashrestha
175perf: minor generic speed optimization, by @davidbolvansky
176api: new ability to extract sequences from the parser for analysis, by @bimbashrestha
177api: fixed decoding of magic-less frames, by @terrelln
178api: fixed ZSTD_initCStream_advanced() performance with fast modes, reported by @QrczakMK
179cli: Named pipes support, by @bimbashrestha
180cli: short tar's extension support, by @stokito
181cli: command --output-dir-flat= , generates target files into requested directory, by @senhuang42
182cli: commands --stream-size=# and --size-hint=#, by @nmagerko
183cli: command --exclude-compressed, by @shashank0791
184cli: faster `-t` test mode
185cli: improved some error messages, by @vangyzen
186cli: fix command `-D dictionary` on Windows, reported by @artyompetrov
187cli: fix rare deadlock condition within dictionary builder, by @terrelln
188build: single-file decoder with emscripten compilation script, by @cwoffenden
189build: fixed zlibWrapper compilation on Visual Studio, reported by @bluenlive
190build: fixed deprecation warning for certain gcc version, reported by @jasonma163
191build: fix compilation on old gcc versions, by @cemeyer
192build: improved installation directories for cmake script, by Dmitri Shubin
193pack: modified pkgconfig, for better integration into openwrt, requested by @neheb
194misc: Improved documentation : ZSTD_CLEVEL, DYNAMIC_BMI2, ZSTD_CDict, function deprecation, zstd format
195misc: fixed educational decoder : accept larger literals section, and removed UNALIGNED() macro
196
197v1.4.3  (Aug 20, 2019)
198bug: Fix Dictionary Compression Ratio Regression by @cyan4973 (#1709)
199bug: Fix Buffer Overflow in legacy v0.3 decompression by @felixhandte (#1722)
200build: Add support for IAR C/C++ Compiler for Arm by @joseph0918 (#1705)
201
202v1.4.2  (Jul 26, 2019)
203bug: Fix bug in zstd-0.5 decoder by @terrelln (#1696)
204bug: Fix seekable decompression in-memory API by @iburinoc (#1695)
205misc: Validate blocks are smaller than size limit by @vivekmg (#1685)
206misc: Restructure source files by @ephiepark (#1679)
207
208v1.4.1  (Jul 20, 2019)
209bug: Fix data corruption in niche use cases by @terrelln (#1659)
210bug: Fuzz legacy modes, fix uncovered bugs by @terrelln (#1593, #1594, #1595)
211bug: Fix out of bounds read by @terrelln (#1590)
212perf: Improve decode speed by ~7% @mgrice (#1668)
213perf: Slightly improved compression ratio of level 3 and 4 (ZSTD_dfast) by @cyan4973 (#1681)
214perf: Slightly faster compression speed when re-using a context by @cyan4973 (#1658)
215perf: Improve compression ratio for small windowLog by @cyan4973 (#1624)
216perf: Faster compression speed in high compression mode for repetitive data by @terrelln (#1635)
217api: Add parameter to generate smaller dictionaries by @tyler-tran (#1656)
218cli: Recognize symlinks when built in C99 mode by @felixhandte (#1640)
219cli: Expose cpu load indicator for each file on -vv mode by @ephiepark (#1631)
220cli: Restrict read permissions on destination files by @chungy (#1644)
221cli: zstdgrep: handle -f flag by @felixhandte (#1618)
222cli: zstdcat: follow symlinks by @vejnar (#1604)
223doc: Remove extra size limit on compressed blocks by @felixhandte (#1689)
224doc: Fix typo by @yk-tanigawa (#1633)
225doc: Improve documentation on streaming buffer sizes by @cyan4973 (#1629)
226build: CMake: support building with LZ4 @leeyoung624 (#1626)
227build: CMake: install zstdless and zstdgrep by @leeyoung624 (#1647)
228build: CMake: respect existing uninstall target by @j301scott (#1619)
229build: Make: skip multithread tests when built without support by @michaelforney (#1620)
230build: Make: Fix examples/ test target by @sjnam (#1603)
231build: Meson: rename options out of deprecated namespace by @lzutao (#1665)
232build: Meson: fix build by @lzutao (#1602)
233build: Visual Studio: don't export symbols in static lib by @scharan (#1650)
234build: Visual Studio: fix linking by @absotively (#1639)
235build: Fix MinGW-W64 build by @myzhang1029 (#1600)
236misc: Expand decodecorpus coverage by @ephiepark (#1664)
237
238v1.4.0  (Apr 17, 2019)
239perf: Improve level 1 compression speed in most scenarios by 6% by @gbtucker and @terrelln
240api: Move the advanced API, including all functions in the staging section, to the stable section
241api: Make ZSTD_e_flush and ZSTD_e_end block for maximum forward progress
242api: Rename ZSTD_CCtxParam_getParameter to ZSTD_CCtxParams_getParameter
243api: Rename ZSTD_CCtxParam_setParameter to ZSTD_CCtxParams_setParameter
244api: Don't export ZSTDMT functions from the shared library by default
245api: Require ZSTD_MULTITHREAD to be defined to use ZSTDMT
246api: Add ZSTD_decompressBound() to provide an upper bound on decompressed size by @shakeelrao
247api: Fix ZSTD_decompressDCtx() corner cases with a dictionary
248api: Move ZSTD_getDictID_*() functions to the stable section
249api: Add ZSTD_c_literalCompressionMode flag to enable or disable literal compression by @terrelln
250api: Allow compression parameters to be set when a dictionary is used
251api: Allow setting parameters before or after ZSTD_CCtx_loadDictionary() is called
252api: Fix ZSTD_estimateCStreamSize_usingCCtxParams()
253api: Setting ZSTD_d_maxWindowLog to 0 means use the default
254cli: Ensure that a dictionary is not used to compress itself by @shakeelrao
255cli: Add --[no-]compress-literals flag to enable or disable literal compression
256doc: Update the examples to use the advanced API
257doc: Explain how to transition from old streaming functions to the advanced API in the header
258build: Improve the Windows release packages
259build: Improve CMake build by @hjmjohnson
260build: Build fixes for FreeBSD by @lwhsu
261build: Remove redundant warnings by @thatsafunnyname
262build: Fix tests on OpenBSD by @bket
263build: Extend fuzzer build system to work with the new clang engine
264build: CMake now creates the libzstd.so.1 symlink
265build: Improve Menson build by @lzutao
266misc: Fix symbolic link detection on FreeBSD
267misc: Use physical core count for -T0 on FreeBSD by @cemeyer
268misc: Fix zstd --list on truncated files by @kostmo
269misc: Improve logging in debug mode by @felixhandte
270misc: Add CirrusCI tests by @lwhsu
271misc: Optimize dictionary memory usage in corner cases
272misc: Improve the dictionary builder on small or homogeneous data
273misc: Fix spelling across the repo by @jsoref
274
275v1.3.8  (Dec 28, 2018)
276perf: better decompression speed on large files (+7%) and cold dictionaries (+15%)
277perf: slightly better compression ratio at high compression modes
278api : finalized advanced API, last stage before "stable" status
279api : new --rsyncable mode, by @terrelln
280api : support decompression of empty frames into NULL (used to be an error) (#1385)
281build: new set of macros to build a minimal size decoder, by @felixhandte
282build: fix compilation on MIPS32, reported by @clbr (#1441)
283build: fix compilation with multiple -arch flags, by @ryandesign
284build: highly upgraded meson build, by @lzutao
285build: improved buck support, by @obelisk
286build: fix cmake script : can create debug build, by @pitrou
287build: Makefile : grep works on both colored consoles and systems without color support
288build: fixed zstd-pgo, by @bmwiedemann
289cli : support ZSTD_CLEVEL environment variable, by @yijinfb (#1423)
290cli : --no-progress flag, preserving final summary (#1371), by @terrelln
291cli : ensure destination file is not source file (#1422)
292cli : clearer error messages, especially when input file not present
293doc : clarified zstd_compression_format.md, by @ulikunitz
294misc: fixed zstdgrep, returns 1 on failure, by @lzutao
295misc: NEWS renamed as CHANGELOG, in accordance with fboss
296
297v1.3.7  (Oct 20, 2018)
298perf: slightly better decompression speed on clang (depending on hardware target)
299fix : performance of dictionary compression for small input < 4 KB at levels 9 and 10
300build: no longer build backtrace by default in release mode; restrict further automatic mode
301build: control backtrace support through build macro BACKTRACE
302misc: added man pages for zstdless and zstdgrep, by @samrussell
303
304v1.3.6  (Oct 6, 2018)
305perf: much faster dictionary builder, by @jenniferliu
306perf: faster dictionary compression on small data when using multiple contexts, by @felixhandte
307perf: faster dictionary decompression when using a very large number of dictionaries simultaneously
308cli : fix : does no longer overwrite destination when source does not exist (#1082)
309cli : new command --adapt, for automatic compression level adaptation
310api : fix : block api can be streamed with > 4 GB, reported by @catid
311api : reduced ZSTD_DDict size by 2 KB
312api : minimum negative compression level is defined, and can be queried using ZSTD_minCLevel().
313build: support Haiku target, by @korli
314build: Read Legacy format is limited to v0.5+ by default. Can be changed at compile time with macro ZSTD_LEGACY_SUPPORT.
315doc : zstd_compression_format.md updated to match wording in IETF RFC 8478
316misc: tests/paramgrill, a parameter optimizer, by @GeorgeLu97
317
318v1.3.5  (Jun 29, 2018)
319perf: much faster dictionary compression, by @felixhandte
320perf: small quality improvement for dictionary generation, by @terrelln
321perf: slightly improved high compression levels (notably level 19)
322mem : automatic memory release for long duration contexts
323cli : fix : overlapLog can be manually set
324cli : fix : decoding invalid lz4 frames
325api : fix : performance degradation for dictionary compression when using advanced API, by @terrelln
326api : change : clarify ZSTD_CCtx_reset() vs ZSTD_CCtx_resetParameters(), by @terrelln
327build: select custom libzstd scope through control macros, by @GeorgeLu97
328build: OpenBSD patch, by @bket
329build: make and make all are compatible with -j
330doc : clarify zstd_compression_format.md, updated for IETF RFC process
331misc: pzstd compatible with reproducible compilation, by @lamby
332
333v1.3.4  (Mar 27, 2018)
334perf: faster speed (especially decoding speed) on recent cpus (haswell+)
335perf: much better performance associating --long with multi-threading, by @terrelln
336perf: better compression at levels 13-15
337cli : asynchronous compression by default, for faster experience (use --single-thread for former behavior)
338cli : smoother status report in multi-threading mode
339cli : added command --fast=#, for faster compression modes
340cli : fix crash when not overwriting existing files, by Pádraig Brady (@pixelb)
341api : `nbThreads` becomes `nbWorkers` : 1 triggers asynchronous mode
342api : compression levels can be negative, for even more speed
343api : ZSTD_getFrameProgression() : get precise progress status of ZSTDMT anytime
344api : ZSTDMT can accept new compression parameters during compression
345api : implemented all advanced dictionary decompression prototypes
346build: improved meson recipe, by Shawn Landden (@shawnl)
347build: VS2017 scripts, by @HaydnTrigg
348misc: all /contrib projects fixed
349misc: added /contrib/docker script by @gyscos
350
351v1.3.3  (Dec 21, 2017)
352perf: faster zstd_opt strategy (levels 16-19)
353fix : bug #944 : multithreading with shared ditionary and large data, reported by @gsliepen
354cli : fix : content size written in header by default
355cli : fix : improved LZ4 format support, by @felixhandte
356cli : new : hidden command `-S`, to benchmark multiple files while generating one result per file
357api : fix : support large skippable frames, by @terrelln
358api : fix : streaming interface was adding a useless 3-bytes null block to small frames
359api : change : when setting `pledgedSrcSize`, use `ZSTD_CONTENTSIZE_UNKNOWN` macro value to mean "unknown"
360build: fix : compilation under rhel6 and centos6, reported by @pixelb
361build: added `check` target
362
363v1.3.2  (Oct 10, 2017)
364new : long range mode, using --long command, by Stella Lau (@stellamplau)
365new : ability to generate and decode magicless frames (#591)
366changed : maximum nb of threads reduced to 200, to avoid address space exhaustion in 32-bits mode
367fix : multi-threading compression works with custom allocators
368fix : ZSTD_sizeof_CStream() was over-evaluating memory usage
369fix : a rare compression bug when compression generates very large distances and bunch of other conditions (only possible at --ultra -22)
370fix : 32-bits build can now decode large offsets (levels 21+)
371cli : added LZ4 frame support by default, by Felix Handte (@felixhandte)
372cli : improved --list output
373cli : new : can split input file for dictionary training, using command -B#
374cli : new : clean operation artefact on Ctrl-C interruption
375cli : fix : do not change /dev/null permissions when using command -t with root access, reported by @mike155 (#851)
376cli : fix : write file size in header in multiple-files mode
377api : added macro ZSTD_COMPRESSBOUND() for static allocation
378api : experimental : new advanced decompression API
379api : fix : sizeof_CCtx() used to over-estimate
380build: fix : no-multithread variant compiles without pool.c dependency, reported by Mitchell Blank Jr (@mitchblank) (#819)
381build: better compatibility with reproducible builds, by Bernhard M. Wiedemann (@bmwiedemann) (#818)
382example : added streaming_memory_usage
383license : changed /examples license to BSD + GPLv2
384license : fix a few header files to reflect new license (#825)
385
386v1.3.1  (Aug 21, 2017)
387New license : BSD + GPLv2
388perf: substantially decreased memory usage in Multi-threading mode, thanks to reports by Tino Reichardt (@mcmilk)
389perf: Multi-threading supports up to 256 threads. Cap at 256 when more are requested (#760)
390cli : improved and fixed --list command, by @ib (#772)
391cli : command -vV to list supported formats, by @ib (#771)
392build : fixed binary variants, reported by @svenha (#788)
393build : fix Visual compilation for non x86/x64 targets, reported by Greg Slazinski (@GregSlazinski) (#718)
394API exp : breaking change : ZSTD_getframeHeader() provides more information
395API exp : breaking change : pinned down values of error codes
396doc : fixed huffman example, by Ulrich Kunitz (@ulikunitz)
397new : contrib/adaptive-compression, I/O driven compression strength, by Paul Cruz (@paulcruz74)
398new : contrib/long_distance_matching, statistics by Stella Lau (@stellamplau)
399updated : contrib/linux-kernel, by Nick Terrell (@terrelln)
400
401v1.3.0  (Jul 6, 2017)
402cli : new : `--list` command, by Paul Cruz
403cli : changed : xz/lzma support enabled by default
404cli : changed : `-t *` continue processing list after a decompression error
405API : added : ZSTD_versionString()
406API : promoted to stable status : ZSTD_getFrameContentSize(), by Sean Purcell
407API exp : new advanced API : ZSTD_compress_generic(), ZSTD_CCtx_setParameter()
408API exp : new : API for static or external allocation : ZSTD_initStatic?Ctx()
409API exp : added : ZSTD_decompressBegin_usingDDict(), requested by Guy Riddle (#700)
410API exp : clarified memory estimation / measurement functions.
411API exp : changed : strongest strategy renamed ZSTD_btultra, fastest strategy ZSTD_fast set to 1
412tools : decodecorpus can generate random dictionary-compressed samples, by Paul Cruz
413new : contrib/seekable_format, demo and API, by Sean Purcell
414changed : contrib/linux-kernel, updated version and license, by Nick Terrell
415
416v1.2.0  (May 5, 2017)
417cli : changed : Multithreading enabled by default (use target zstd-nomt or HAVE_THREAD=0 to disable)
418cli : new : command -T0 means "detect and use nb of cores", by Sean Purcell
419cli : new : zstdmt symlink hardwired to `zstd -T0`
420cli : new : command --threads=# (#671)
421cli : changed : cover dictionary builder by default, for improved quality, by Nick Terrell
422cli : new : commands --train-cover and --train-legacy, to select dictionary algorithm and parameters
423cli : experimental targets `zstd4` and `xzstd4`, with support for lz4 format, by Sean Purcell
424cli : fix : does not output compressed data on console
425cli : fix : ignore symbolic links unless --force specified,
426API : breaking change : ZSTD_createCDict_advanced(), only use compressionParameters as argument
427API : added : prototypes ZSTD_*_usingCDict_advanced(), for direct control over frameParameters.
428API : improved: ZSTDMT_compressCCtx() reduced memory usage
429API : fix : ZSTDMT_compressCCtx() now provides srcSize in header (#634)
430API : fix : src size stored in frame header is controlled at end of frame
431API : fix : enforced consistent rules for pledgedSrcSize==0 (#641)
432API : fix : error code "GENERIC" replaced by "dstSizeTooSmall" when appropriate
433build: improved cmake script, by @Majlen
434build: enabled Multi-threading support for *BSD, by Baptiste Daroussin
435tools: updated Paramgrill. Command -O# provides best parameters for sample and speed target.
436new : contrib/linux-kernel version, by Nick Terrell
437
438v1.1.4  (Mar 18, 2017)
439cli : new : can compress in *.gz format, using --format=gzip command, by Przemyslaw Skibinski
440cli : new : advanced benchmark command --priority=rt
441cli : fix : write on sparse-enabled file systems in 32-bits mode, by @ds77
442cli : fix : --rm remains silent when input is stdin
443cli : experimental : xzstd, with support for xz/lzma decoding, by Przemyslaw Skibinski
444speed : improved decompression speed in streaming mode for single shot scenarios (+5%)
445memory: DDict (decompression dictionary) memory usage down from 150 KB to 20 KB
446arch: 32-bits variant able to generate and decode very long matches (>32 MB), by Sean Purcell
447API : new : ZSTD_findFrameCompressedSize(), ZSTD_getFrameContentSize(), ZSTD_findDecompressedSize()
448API : changed : dropped support of legacy versions <= v0.3 (can be changed by modifying ZSTD_LEGACY_SUPPORT value)
449build : new: meson build system in contrib/meson, by Dima Krasner
450build : improved cmake script, by @Majlen
451build : added -Wformat-security flag, as recommended by Padraig Brady
452doc : new : educational decoder, by Sean Purcell
453
454v1.1.3  (Feb 7, 2017)
455cli : zstd can decompress .gz files (can be disabled with `make zstd-nogz` or `make HAVE_ZLIB=0`)
456cli : new : experimental target `make zstdmt`, with multi-threading support
457cli : new : improved dictionary builder "cover" (experimental), by Nick Terrell, based on prior work by Giuseppe Ottaviano.
458cli : new : advanced commands for detailed parameters, by Przemyslaw Skibinski
459cli : fix zstdless on Mac OS-X, by Andrew Janke
460cli : fix #232 "compress non-files"
461dictBuilder : improved dictionary generation quality, thanks to Nick Terrell
462API : new : lib/compress/ZSTDMT_compress.h multithreading API (experimental)
463API : new : ZSTD_create?Dict_byReference(), requested by Bartosz Taudul
464API : new : ZDICT_finalizeDictionary()
465API : fix : ZSTD_initCStream_usingCDict() properly writes dictID into frame header, by Gregory Szorc (#511)
466API : fix : all symbols properly exposed in libzstd, by Nick Terrell
467build : support for Solaris target, by Przemyslaw Skibinski
468doc : clarified specification, by Sean Purcell
469
470v1.1.2  (Dec 15, 2016)
471API : streaming : decompression : changed : automatic implicit reset when chain-decoding new frames without init
472API : experimental : added : dictID retrieval functions, and ZSTD_initCStream_srcSize()
473API : zbuff : changed : prototypes now generate deprecation warnings
474lib : improved : faster decompression speed at ultra compression settings and 32-bits mode
475lib : changed : only public ZSTD_ symbols are now exposed
476lib : changed : reduced usage  of stack memory
477lib : fixed : several corner case bugs, by Nick Terrell
478cli : new : gzstd, experimental version able to decode .gz files, by Przemyslaw Skibinski
479cli : new : preserve file attributes
480cli : new : added zstdless and zstdgrep tools
481cli : fixed : status displays total amount decoded, even for file consisting of multiple frames (like pzstd)
482cli : fixed : zstdcat
483zlib_wrapper : added support for gz* functions, by Przemyslaw Skibinski
484install : better compatibility with FreeBSD, by Dimitry Andric
485source tree : changed : zbuff source files moved to lib/deprecated
486
487v1.1.1  (Nov 2, 2016)
488New : command -M#, --memory=, --memlimit=, --memlimit-decompress= to limit allowed memory consumption
489New : doc/zstd_manual.html, by Przemyslaw Skibinski
490Improved : slightly better compression ratio at --ultra levels (>= 20)
491Improved : better memory usage when using streaming compression API, thanks to @Rogier-5 report
492Added : API : ZSTD_initCStream_usingCDict(), ZSTD_initDStream_usingDDict() (experimental section)
493Added : example/multiple_streaming_compression.c
494Changed : zstd_errors.h is now installed within /include (and replaces errors_public.h)
495Updated man page
496Fixed : zstd-small, zstd-compress and zstd-decompress compilation targets
497
498v1.1.0  (Sep 28, 2016)
499New : contrib/pzstd, parallel version of zstd, by Nick Terrell
500added : NetBSD install target (#338)
501Improved : speed for batches of small files
502Improved : speed of zlib wrapper, by Przemyslaw Skibinski
503Changed : libzstd on Windows supports legacy formats, by Christophe Chevalier
504Fixed : CLI -d output to stdout by default when input is stdin (#322)
505Fixed : CLI correctly detects console on Mac OS-X
506Fixed : CLI supports recursive mode `-r` on Mac OS-X
507Fixed : Legacy decoders use unified error codes, reported by benrg (#341), fixed by Przemyslaw Skibinski
508Fixed : compatibility with OpenBSD, reported by Juan Francisco Cantero Hurtado (#319)
509Fixed : compatibility with Hurd, by Przemyslaw Skibinski (#365)
510Fixed : zstd-pgo, reported by octoploid (#329)
511
512v1.0.0  (Sep 1, 2016)
513Change Licensing, all project is now BSD, Copyright Facebook
514Small decompression speed improvement
515API : Streaming API supports legacy format
516API : ZDICT_getDictID(), ZSTD_sizeof_{CCtx, DCtx, CStream, DStream}(), ZSTD_setDStreamParameter()
517CLI supports legacy formats v0.4+
518Fixed : compression fails on certain huge files, reported by Jesse McGrew
519Enhanced documentation, by Przemyslaw Skibinski
520
521v0.8.1  (Aug 18, 2016)
522New streaming API
523Changed : --ultra now enables levels beyond 19
524Changed : -i# now selects benchmark time in second
525Fixed : ZSTD_compress* can now compress > 4 GB in a single pass, reported by Nick Terrell
526Fixed : speed regression on specific patterns (#272)
527Fixed : support for Z_SYNC_FLUSH, by Dmitry Krot (#291)
528Fixed : ICC compilation, by Przemyslaw Skibinski
529
530v0.8.0  (Aug 2, 2016)
531Improved : better speed on clang and gcc -O2, thanks to Eric Biggers
532New : Build on FreeBSD and DragonFly, thanks to JrMarino
533Changed : modified API : ZSTD_compressEnd()
534Fixed : legacy mode with ZSTD_HEAPMODE=0, by Christopher Bergqvist
535Fixed : premature end of frame when zero-sized raw block, reported by Eric Biggers
536Fixed : large dictionaries (> 384 KB), reported by Ilona Papava
537Fixed : checksum correctly checked in single-pass mode
538Fixed : combined --test amd --rm, reported by Andreas M. Nilsson
539Modified : minor compression level adaptations
540Updated : compression format specification to v0.2.0
541changed : zstd.h moved to /lib directory
542
543v0.7.5  (Aug 1, 2016)
544Transition version, supporting decoding of v0.8.x
545
546v0.7.4  (Jul 17, 2016)
547Added : homebrew for Mac, by Daniel Cade
548Added : more examples
549Fixed : segfault when using small dictionaries, reported by Felix Handte
550Modified : default compression level for CLI is now 3
551Updated : specification, to v0.1.1
552
553v0.7.3  (Jul 9, 2016)
554New : compression format specification
555New : `--` separator, stating that all following arguments are file names. Suggested by Chip Turner.
556New : `ZSTD_getDecompressedSize()`
557New : OpenBSD target, by Juan Francisco Cantero Hurtado
558New : `examples` directory
559fixed : dictBuilder using HC levels, reported by Bartosz Taudul
560fixed : legacy support from ZSTD_decompress_usingDDict(), reported by Felix Handte
561fixed : multi-blocks decoding with intermediate uncompressed blocks, reported by Greg Slazinski
562modified : removed "mem.h" and "error_public.h" dependencies from "zstd.h" (experimental section)
563modified : legacy functions no longer need magic number
564
565v0.7.2  (Jul 4, 2016)
566fixed : ZSTD_decompressBlock() using multiple consecutive blocks. Reported by Greg Slazinski.
567fixed : potential segfault on very large files (many gigabytes). Reported by Chip Turner.
568fixed : CLI displays system error message when destination file cannot be created (#231). Reported by Chip Turner.
569
570v0.7.1  (Jun 23, 2016)
571fixed : ZBUFF_compressEnd() called multiple times with too small `dst` buffer, reported by Christophe Chevalier
572fixed : dictBuilder fails if first sample is too small, reported by Руслан Ковалёв
573fixed : corruption issue, reported by cj
574modified : checksum enabled by default in command line mode
575
576v0.7.0  (Jun 17, 2016)
577New : Support for directory compression, using `-r`, thanks to Przemyslaw Skibinski
578New : Command `--rm`, to remove source file after successful de/compression
579New : Visual build scripts, by Christophe Chevalier
580New : Support for Sparse File-systems (do not use space for zero-filled sectors)
581New : Frame checksum support
582New : Support pass-through mode (when using `-df`)
583API : more efficient Dictionary API : `ZSTD_compress_usingCDict()`, `ZSTD_decompress_usingDDict()`
584API : create dictionary files from custom content, by Giuseppe Ottaviano
585API : support for custom malloc/free functions
586New : controllable Dictionary ID
587New : Support for skippable frames
588
589v0.6.1  (May 13, 2016)
590New : zlib wrapper API, thanks to Przemyslaw Skibinski
591New : Ability to compile compressor / decompressor separately
592Changed : new lib directory structure
593Fixed : Legacy codec v0.5 compatible with dictionary decompression
594Fixed : Decoder corruption error (#173)
595Fixed : null-string roundtrip (#176)
596New : benchmark mode can select directory as input
597Experimental : midipix support, VMS support
598
599v0.6.0  (Apr 13, 2016)
600Stronger high compression modes, thanks to Przemyslaw Skibinski
601API : ZSTD_getFrameParams() provides size of decompressed content
602New : highest compression modes require `--ultra` command to fully unleash their capacity
603Fixed : zstd cli return error code > 0 and removes dst file artifact when decompression fails, thanks to Chip Turner
604
605v0.5.1  (Feb 18, 2016)
606New : Optimal parsing => Very high compression modes, thanks to Przemyslaw Skibinski
607Changed : Dictionary builder integrated into libzstd and zstd cli
608Changed (!) : zstd cli now uses "multiple input files" as default mode. See `zstd -h`.
609Fix : high compression modes for big-endian platforms
610New : zstd cli : `-t` | `--test` command
611
612v0.5.0  (Feb 5, 2016)
613New : dictionary builder utility
614Changed : streaming & dictionary API
615Improved : better compression of small data
616
617v0.4.7  (Jan 22, 2016)
618Improved : small compression speed improvement in HC mode
619Changed : `zstd_decompress.c` has ZSTD_LEGACY_SUPPORT to 0 by default
620fix : bt search bug
621
622v0.4.6  (Jan 13, 2016)
623fix : fast compression mode on Windows
624New : cmake configuration file, thanks to Artyom Dymchenko
625Improved : high compression mode on repetitive data
626New : block-level API
627New : ZSTD_duplicateCCtx()
628
629v0.4.5  (Dec 18, 2015)
630new : -m/--multiple : compress/decompress multiple files
631
632v0.4.4  (Dec 14, 2015)
633Fixed : high compression modes for Windows 32 bits
634new : external dictionary API extended to buffered mode and accessible through command line
635new : windows DLL project, thanks to Christophe Chevalier
636
637v0.4.3  (Dec 7, 2015)
638new : external dictionary API
639new : zstd-frugal
640
641v0.4.2  (Dec 2, 2015)
642Generic minor improvements for small blocks
643Fixed : big-endian compatibility, by Peter Harris (#85)
644
645v0.4.1  (Dec 1, 2015)
646Fixed : ZSTD_LEGACY_SUPPORT=0 build mode (reported by Luben)
647removed `zstd.c`
648
649v0.4.0  (Nov 29, 2015)
650Command line utility compatible with high compression levels
651Removed zstdhc => merged into zstd
652Added : ZBUFF API (see zstd_buffered.h)
653Rolling buffer support
654
655v0.3.6  (Nov 10, 2015)
656small blocks params
657
658v0.3.5  (Nov 9, 2015)
659minor generic compression improvements
660
661v0.3.4  (Nov 6, 2015)
662Faster fast cLevels
663
664v0.3.3  (Nov 5, 2015)
665Small compression ratio improvement
666
667v0.3.2  (Nov 2, 2015)
668Fixed Visual Studio
669
670v0.3.1  (Nov 2, 2015)
671Small compression ratio improvement
672
673v0.3  (Oct 30, 2015)
674HC mode : compression levels 2-26
675
676v0.2.2  (Oct 28, 2015)
677Fix : Visual Studio 2013 & 2015 release compilation, by Christophe Chevalier
678
679v0.2.1  (Oct 24, 2015)
680Fix : Read errors, advanced fuzzer tests, by Hanno Böck
681
682v0.2.0  (Oct 22, 2015)
683**Breaking format change**
684Faster decompression speed
685Can still decode v0.1 format
686
687v0.1.3  (Oct 15, 2015)
688fix uninitialization warning, reported by Evan Nemerson
689
690v0.1.2  (Sep 11, 2015)
691frame concatenation support
692
693v0.1.1  (Aug 27, 2015)
694fix compression bug
695detects write-flush errors
696
697v0.1.0  (Aug 25, 2015)
698first release
699