1v1.5.0 (May 11, 2021) 2api: Various functions promoted from experimental to stable API: (#2579-2581, @senhuang42) 3 `ZSTD_defaultCLevel()` 4 `ZSTD_getDictID_fromCDict()` 5api: Several experimental functions have been deprecated and will emit a compiler warning (#2582, @senhuang42) 6 `ZSTD_compress_advanced()` 7 `ZSTD_compress_usingCDict_advanced()` 8 `ZSTD_compressBegin_advanced()` 9 `ZSTD_compressBegin_usingCDict_advanced()` 10 `ZSTD_initCStream_srcSize()` 11 `ZSTD_initCStream_usingDict()` 12 `ZSTD_initCStream_usingCDict()` 13 `ZSTD_initCStream_advanced()` 14 `ZSTD_initCStream_usingCDict_advanced()` 15 `ZSTD_resetCStream()` 16api: ZSTDMT_NBWORKERS_MAX reduced to 64 for 32-bit environments (@Cyan4973) 17perf: Significant speed improvements for middle compression levels (#2494, @senhuang42 @terrelln) 18perf: Block splitter to improve compression ratio, enabled by default for high compression levels (#2447, @senhuang42) 19perf: Decompression loop refactor, speed improvements on `clang` and for `--long` modes (#2614 #2630, @Cyan4973) 20perf: Reduced stack usage during compression and decompression entropy stage (#2522 #2524, @terrelln) 21bug: Improve setting permissions of created files (#2525, @felixhandte) 22bug: Fix large dictionary non-determinism (#2607, @terrelln) 23bug: Fix non-determinism test failures on Linux i686 (#2606, @terrelln) 24bug: Fix various dedicated dictionary search bugs (#2540 #2586, @senhuang42 @felixhandte) 25bug: Ensure `ZSTD_estimateCCtxSize*() `monotonically increases with compression level (#2538, @senhuang42) 26bug: Fix --patch-from mode parameter bound bug with small files (#2637, @occivink) 27bug: Fix UBSAN error in decompression (#2625, @terrelln) 28bug: Fix superblock compression divide by zero bug (#2592, @senhuang42) 29bug: Make the number of physical CPU cores detection more robust (#2517, @PaulBone) 30doc: Improve `zdict.h` dictionary training API documentation (#2622, @terrelln) 31doc: Note that public `ZSTD_free*()` functions accept NULL pointers (#2521, @animalize) 32doc: Add style guide docs for open source contributors (#2626, @Cyan4973) 33tests: Better regression test coverage for different dictionary modes (#2559, @senhuang42) 34tests: Better test coverage of index reduction (#2603, @terrelln) 35tests: OSS-Fuzz coverage for seekable format (#2617, @senhuang42) 36tests: Test coverage for ZSTD threadpool API (#2604, @senhuang42) 37build: Dynamic library built multithreaded by default (#2584, @senhuang42) 38build: Move `zstd_errors.h` and `zdict.h` to `lib/` root (#2597, @terrelln) 39build: Allow `ZSTDMT_JOBSIZE_MIN` to be configured at compile-time, reduce default to 512KB (#2611, @Cyan4973) 40build: Single file library build script moved to `build/` directory (#2618, @felixhandte) 41build: `ZBUFF_*()` is no longer built by default (#2583, @senhuang42) 42build: Fixed Meson build (#2548, @SupervisedThinking @kloczek) 43build: Fix excessive compiler warnings with clang-cl and CMake (#2600, @nickhutchinson) 44build: Detect presence of `md5` on Darwin (#2609, @felixhandte) 45build: Avoid SIGBUS on armv6 (#2633, @bmwiedmann) 46cli: `--progress` flag added to always display progress bar (#2595, @senhuang42) 47cli: Allow reading from block devices with `--force` (#2613, @felixhandte) 48cli: Fix CLI filesize display bug (#2550, @Cyan4973) 49cli: Fix windows CLI `--filelist` end-of-line bug (#2620, @Cyan4973) 50contrib: Various fixes for linux kernel patch (#2539, @terrelln) 51contrib: Seekable format - Decompression hanging edge case fix (#2516, @senhuang42) 52contrib: Seekable format - New seek table-only API (#2113 #2518, @mdittmer @Cyan4973) 53contrib: Seekable format - Fix seek table descriptor check when loading (#2534, @foxeng) 54contrib: Seekable format - Decompression fix for large offsets, (#2594, @azat) 55misc: Automatically published release tarballs available on Github (#2535, @felixhandte) 56 57v1.4.9 (Mar 1, 2021) 58bug: Use `umask()` to Constrain Created File Permissions (#2495, @felixhandte) 59bug: Make Simple Single-Pass Functions Ignore Advanced Parameters (#2498, @terrelln) 60api: Add (De)Compression Tracing Functionality (#2482, @terrelln) 61api: Support References to Multiple DDicts (#2446, @senhuang42) 62api: Add Function to Generate Skippable Frame (#2439, @senhuang42) 63perf: New Algorithms for the Long Distance Matcher (#2483, @mpu) 64perf: Performance Improvements for Long Distance Matcher (#2464, @mpu) 65perf: Don't Shrink Window Log when Streaming with a Dictionary (#2451, @terrelln) 66cli: Fix `--output-dir-mirror`'s Rejection of `..`-Containing Paths (#2512, @felixhandte) 67cli: Allow Input From Console When `-f`/`--force` is Passed (#2466, @felixhandte) 68cli: Improve Help Message (#2500, @senhuang42) 69tests: Remove Flaky Tests (#2455, #2486, #2445, @Cyan4973) 70tests: Correctly Invoke md5 Utility on NetBSD (#2492, @niacat) 71tests: Avoid Using `stat -c` on NetBSD (#2513, @felixhandte) 72build: Zstd CLI Can Now be Linked to Dynamic `libzstd` (#2457, #2454 @Cyan4973) 73build: Hide and Avoid Using Static-Only Symbols (#2501, #2504, @skitt) 74build: CMake: Enable Only C for lib/ and programs/ Projects (#2498, @concatime) 75build: CMake: Use `configure_file()` to Create the `.pc` File (#2462, @lazka) 76build: Fix Fuzzer Compiler Detection & Update UBSAN Flags (#2503, @terrelln) 77build: Add Guards for `_LARGEFILE_SOURCE` and `_LARGEFILE64_SOURCE` (#2444, @indygreg) 78build: Improve `zlibwrapper` Makefile (#2437, @Cyan4973) 79contrib: Add `recover_directory` Program (#2473, @terrelln) 80doc: Change License Year to 2021 (#2452 & #2465, @terrelln & @senhuang42) 81doc: Fix Typos (#2459, @ThomasWaldmann) 82 83v1.4.8 (Dec 18, 2020) 84hotfix: wrong alignment of an internal buffer 85 86v1.4.7 (Dec 16, 2020) 87perf: stronger --long mode at high compression levels, by @senhuang42 88perf: stronger --patch-from at high compression levels, thanks to --long improvements 89perf: faster dictionary compression at medium compression levels, by @felixhandte 90perf: small speed & memory usage improvements for ZSTD_compress2(), by @terrelln 91perf: improved fast compression speeds with Visual Studio, by @animalize 92cli : Set nb of threads with environment variable ZSTD_NBTHREADS, by @senhuang42 93cli : accept decompressing files with *.zstd suffix 94cli : provide a condensed summary by default when processing multiple files 95cli : fix : stdin input no longer confused as user prompt 96cli : improve accuracy of several error messages 97api : new sequence ingestion API, by @senhuang42 98api : shared thread pool: control total nb of threads used by multiple compression jobs, by @marxin 99api : new ZSTD_getDictID_fromCDict(), by @LuAPi 100api : zlibWrapper only uses public API, and is compatible with dynamic library, by @terrelln 101api : fix : multithreaded compression has predictable output even in special cases (see #2327) (issue not accessible from cli) 102api : fix : dictionary compression correctly respects dictionary compression level (see #2303) (issue not accessible from cli) 103build: fix cmake script when using path with spaces, by @terrelln 104build: improved compile-time detection of aarch64/neon platforms, by @bsdimp 105build: Fix building on AIX 5.1, by @likema 106build: compile paramgrill with cmake on Windows, requested by @mirh 107doc : clarify repcode updates in format specification, by @felixhandte 108 109v1.4.6 110fix : Always return dstSize_tooSmall when that is the case 111fix : Fix ZSTD_initCStream_advanced() with static allocation and no dictionary 112perf: Improve small block decompression speed by 20%+, by @terrelln 113perf: Reduce compression stack usage by 1 KB, by @terrelln 114perf: Improve decompression speed by improving ZSTD_wildcopy, by @helloguo (#2252, #2256) 115perf: Improve histogram construction, by @cyan4973 (#2253) 116cli : Add --output-dir-mirror option, by @xxie24 (#2219) 117cli : Warn when (de)compressing multiple files into a single output, by @senhuang42 (#2279) 118cli : Improved progress bar and status summary when (de)compressing multiple files, by @senhuang42 (#2283) 119cli : Call stat less often, by @felixhandte (#2262) 120cli : Allow --patch-from XXX and --filelist XXX in addition to --patch-from=XXX and --filelist=XXX, by @cyan4973 (#2250) 121cli : Allow --patch-from to compress stdin with --stream-size, by @bimbashrestha (#2206) 122api : Do not install zbuff.h, since it has long been deprecated, by @cyan4973 (#2166). 123api : Fix ZSTD_CCtx_setParameter() with ZSTD_c_compressionLevel to make 0 mean default level, by @i-do-cpp (#2291) 124api : Rename ZSTDMT_NBTHREADS_MAX to ZSTDMT_NBWORKERS_MAX, by @marxin (#2228). 125build: Install pkg-config file with CMake and MinGW, by @tonytheodore (#2183) 126build: Install DLL with CMake on Windows, by @BioDataAnalysis (#2221) 127build: Fix DLL install location with CMake, by @xantares and @bimbashrestha (#2186) 128build: Add ZSTD_NO_UNUSED_FUNCTIONS macro to hide unused functions 129build: Add ZSTD_NO_INTRINSICS macro to avoid explicit intrinsics 130build: Add STATIC_BMI2 macro for compile time detection of BMI2 on MSVC, by @Niadb (#2258) 131build: Fix -Wcomma warnings, by @cwoffenden 132build: Remove distutils requirement for meson build, by @neheb (#2197) 133build: Fix cli compilation with uclibc 134build: Fix cli compilation without st_mtime, by @ffontaine (#2246) 135build: Fix shadowing warnings in library 136build: Fix single file library compilation with Enscripten, by @yoshihitoh (#2227) 137misc: Improve single file library and include dictBuilder, by @cwoffenden 138misc: Allow compression dictionaries with missing symbols 139misc: Add freestanding translation script in contrib/freestanding_lib 140misc: Collect all of zstd's libc dependencies into zstd_deps.h 141doc : Add ZSTD_versionString() to manual, by @animalize 142doc : Fix documentation for ZSTD_CCtxParams_setParameter(), by @felixhandte (#2270) 143 144v1.4.5 (May 22, 2020) 145fix : Compression ratio regression on huge files (> 3 GB) using high levels (--ultra) and multithreading, by @terrelln 146perf: Improved decompression speed: x64 : +10% (clang) / +5% (gcc); ARM : from +15% to +50%, depending on SoC, by @terrelln 147perf: Automatically downsizes ZSTD_DCtx when too large for too long (#2069, by @bimbashreshta) 148perf: Improved fast compression speed on aarch64 (#2040, ~+3%, by @caoyzh) 149perf: Small level 1 compression speed gains (depending on compiler) 150cli : New --patch-from command, create and apply patches from files, by @bimbashreshta 151cli : New --filelist= : Provide a list of files to operate upon from a file 152cli : -b -d command can now benchmark decompression on multiple files 153cli : New --no-content-size command 154cli : New --show-default-cparams information command 155api : ZDICT_finalizeDictionary() is promoted to stable (#2111) 156api : new experimental parameter ZSTD_d_stableOutBuffer (#2094) 157build: Generate a single-file libzstd library (#2065, by @cwoffenden) 158build: Relative includes no longer require -I compiler flags for zstd lib subdirs (#2103, by @felixhandte) 159build: zstd now compiles cleanly under -pedantic (#2099) 160build: zstd now compiles with make-4.3 161build: Support mingw cross-compilation from Linux, by @Ericson2314 162build: Meson multi-thread build fix on windows 163build: Some misc icc fixes backed by new ci test on travis 164misc: bitflip analyzer tool, by @felixhandte 165misc: Extend largeNbDicts benchmark to compression 166misc: Edit-distance match finder in contrib/ 167doc : Improved beginner CONTRIBUTING.md docs 168doc : New issue templates for zstd 169 170v1.4.4 (Nov 6, 2019) 171perf: Improved decompression speed, by > 10%, by @terrelln 172perf: Better compression speed when re-using a context, by @felixhandte 173perf: Fix compression ratio when compressing large files with small dictionary, by @senhuang42 174perf: zstd reference encoder can generate RLE blocks, by @bimbashrestha 175perf: minor generic speed optimization, by @davidbolvansky 176api: new ability to extract sequences from the parser for analysis, by @bimbashrestha 177api: fixed decoding of magic-less frames, by @terrelln 178api: fixed ZSTD_initCStream_advanced() performance with fast modes, reported by @QrczakMK 179cli: Named pipes support, by @bimbashrestha 180cli: short tar's extension support, by @stokito 181cli: command --output-dir-flat= , generates target files into requested directory, by @senhuang42 182cli: commands --stream-size=# and --size-hint=#, by @nmagerko 183cli: command --exclude-compressed, by @shashank0791 184cli: faster `-t` test mode 185cli: improved some error messages, by @vangyzen 186cli: fix command `-D dictionary` on Windows, reported by @artyompetrov 187cli: fix rare deadlock condition within dictionary builder, by @terrelln 188build: single-file decoder with emscripten compilation script, by @cwoffenden 189build: fixed zlibWrapper compilation on Visual Studio, reported by @bluenlive 190build: fixed deprecation warning for certain gcc version, reported by @jasonma163 191build: fix compilation on old gcc versions, by @cemeyer 192build: improved installation directories for cmake script, by Dmitri Shubin 193pack: modified pkgconfig, for better integration into openwrt, requested by @neheb 194misc: Improved documentation : ZSTD_CLEVEL, DYNAMIC_BMI2, ZSTD_CDict, function deprecation, zstd format 195misc: fixed educational decoder : accept larger literals section, and removed UNALIGNED() macro 196 197v1.4.3 (Aug 20, 2019) 198bug: Fix Dictionary Compression Ratio Regression by @cyan4973 (#1709) 199bug: Fix Buffer Overflow in legacy v0.3 decompression by @felixhandte (#1722) 200build: Add support for IAR C/C++ Compiler for Arm by @joseph0918 (#1705) 201 202v1.4.2 (Jul 26, 2019) 203bug: Fix bug in zstd-0.5 decoder by @terrelln (#1696) 204bug: Fix seekable decompression in-memory API by @iburinoc (#1695) 205misc: Validate blocks are smaller than size limit by @vivekmg (#1685) 206misc: Restructure source files by @ephiepark (#1679) 207 208v1.4.1 (Jul 20, 2019) 209bug: Fix data corruption in niche use cases by @terrelln (#1659) 210bug: Fuzz legacy modes, fix uncovered bugs by @terrelln (#1593, #1594, #1595) 211bug: Fix out of bounds read by @terrelln (#1590) 212perf: Improve decode speed by ~7% @mgrice (#1668) 213perf: Slightly improved compression ratio of level 3 and 4 (ZSTD_dfast) by @cyan4973 (#1681) 214perf: Slightly faster compression speed when re-using a context by @cyan4973 (#1658) 215perf: Improve compression ratio for small windowLog by @cyan4973 (#1624) 216perf: Faster compression speed in high compression mode for repetitive data by @terrelln (#1635) 217api: Add parameter to generate smaller dictionaries by @tyler-tran (#1656) 218cli: Recognize symlinks when built in C99 mode by @felixhandte (#1640) 219cli: Expose cpu load indicator for each file on -vv mode by @ephiepark (#1631) 220cli: Restrict read permissions on destination files by @chungy (#1644) 221cli: zstdgrep: handle -f flag by @felixhandte (#1618) 222cli: zstdcat: follow symlinks by @vejnar (#1604) 223doc: Remove extra size limit on compressed blocks by @felixhandte (#1689) 224doc: Fix typo by @yk-tanigawa (#1633) 225doc: Improve documentation on streaming buffer sizes by @cyan4973 (#1629) 226build: CMake: support building with LZ4 @leeyoung624 (#1626) 227build: CMake: install zstdless and zstdgrep by @leeyoung624 (#1647) 228build: CMake: respect existing uninstall target by @j301scott (#1619) 229build: Make: skip multithread tests when built without support by @michaelforney (#1620) 230build: Make: Fix examples/ test target by @sjnam (#1603) 231build: Meson: rename options out of deprecated namespace by @lzutao (#1665) 232build: Meson: fix build by @lzutao (#1602) 233build: Visual Studio: don't export symbols in static lib by @scharan (#1650) 234build: Visual Studio: fix linking by @absotively (#1639) 235build: Fix MinGW-W64 build by @myzhang1029 (#1600) 236misc: Expand decodecorpus coverage by @ephiepark (#1664) 237 238v1.4.0 (Apr 17, 2019) 239perf: Improve level 1 compression speed in most scenarios by 6% by @gbtucker and @terrelln 240api: Move the advanced API, including all functions in the staging section, to the stable section 241api: Make ZSTD_e_flush and ZSTD_e_end block for maximum forward progress 242api: Rename ZSTD_CCtxParam_getParameter to ZSTD_CCtxParams_getParameter 243api: Rename ZSTD_CCtxParam_setParameter to ZSTD_CCtxParams_setParameter 244api: Don't export ZSTDMT functions from the shared library by default 245api: Require ZSTD_MULTITHREAD to be defined to use ZSTDMT 246api: Add ZSTD_decompressBound() to provide an upper bound on decompressed size by @shakeelrao 247api: Fix ZSTD_decompressDCtx() corner cases with a dictionary 248api: Move ZSTD_getDictID_*() functions to the stable section 249api: Add ZSTD_c_literalCompressionMode flag to enable or disable literal compression by @terrelln 250api: Allow compression parameters to be set when a dictionary is used 251api: Allow setting parameters before or after ZSTD_CCtx_loadDictionary() is called 252api: Fix ZSTD_estimateCStreamSize_usingCCtxParams() 253api: Setting ZSTD_d_maxWindowLog to 0 means use the default 254cli: Ensure that a dictionary is not used to compress itself by @shakeelrao 255cli: Add --[no-]compress-literals flag to enable or disable literal compression 256doc: Update the examples to use the advanced API 257doc: Explain how to transition from old streaming functions to the advanced API in the header 258build: Improve the Windows release packages 259build: Improve CMake build by @hjmjohnson 260build: Build fixes for FreeBSD by @lwhsu 261build: Remove redundant warnings by @thatsafunnyname 262build: Fix tests on OpenBSD by @bket 263build: Extend fuzzer build system to work with the new clang engine 264build: CMake now creates the libzstd.so.1 symlink 265build: Improve Menson build by @lzutao 266misc: Fix symbolic link detection on FreeBSD 267misc: Use physical core count for -T0 on FreeBSD by @cemeyer 268misc: Fix zstd --list on truncated files by @kostmo 269misc: Improve logging in debug mode by @felixhandte 270misc: Add CirrusCI tests by @lwhsu 271misc: Optimize dictionary memory usage in corner cases 272misc: Improve the dictionary builder on small or homogeneous data 273misc: Fix spelling across the repo by @jsoref 274 275v1.3.8 (Dec 28, 2018) 276perf: better decompression speed on large files (+7%) and cold dictionaries (+15%) 277perf: slightly better compression ratio at high compression modes 278api : finalized advanced API, last stage before "stable" status 279api : new --rsyncable mode, by @terrelln 280api : support decompression of empty frames into NULL (used to be an error) (#1385) 281build: new set of macros to build a minimal size decoder, by @felixhandte 282build: fix compilation on MIPS32, reported by @clbr (#1441) 283build: fix compilation with multiple -arch flags, by @ryandesign 284build: highly upgraded meson build, by @lzutao 285build: improved buck support, by @obelisk 286build: fix cmake script : can create debug build, by @pitrou 287build: Makefile : grep works on both colored consoles and systems without color support 288build: fixed zstd-pgo, by @bmwiedemann 289cli : support ZSTD_CLEVEL environment variable, by @yijinfb (#1423) 290cli : --no-progress flag, preserving final summary (#1371), by @terrelln 291cli : ensure destination file is not source file (#1422) 292cli : clearer error messages, especially when input file not present 293doc : clarified zstd_compression_format.md, by @ulikunitz 294misc: fixed zstdgrep, returns 1 on failure, by @lzutao 295misc: NEWS renamed as CHANGELOG, in accordance with fboss 296 297v1.3.7 (Oct 20, 2018) 298perf: slightly better decompression speed on clang (depending on hardware target) 299fix : performance of dictionary compression for small input < 4 KB at levels 9 and 10 300build: no longer build backtrace by default in release mode; restrict further automatic mode 301build: control backtrace support through build macro BACKTRACE 302misc: added man pages for zstdless and zstdgrep, by @samrussell 303 304v1.3.6 (Oct 6, 2018) 305perf: much faster dictionary builder, by @jenniferliu 306perf: faster dictionary compression on small data when using multiple contexts, by @felixhandte 307perf: faster dictionary decompression when using a very large number of dictionaries simultaneously 308cli : fix : does no longer overwrite destination when source does not exist (#1082) 309cli : new command --adapt, for automatic compression level adaptation 310api : fix : block api can be streamed with > 4 GB, reported by @catid 311api : reduced ZSTD_DDict size by 2 KB 312api : minimum negative compression level is defined, and can be queried using ZSTD_minCLevel(). 313build: support Haiku target, by @korli 314build: Read Legacy format is limited to v0.5+ by default. Can be changed at compile time with macro ZSTD_LEGACY_SUPPORT. 315doc : zstd_compression_format.md updated to match wording in IETF RFC 8478 316misc: tests/paramgrill, a parameter optimizer, by @GeorgeLu97 317 318v1.3.5 (Jun 29, 2018) 319perf: much faster dictionary compression, by @felixhandte 320perf: small quality improvement for dictionary generation, by @terrelln 321perf: slightly improved high compression levels (notably level 19) 322mem : automatic memory release for long duration contexts 323cli : fix : overlapLog can be manually set 324cli : fix : decoding invalid lz4 frames 325api : fix : performance degradation for dictionary compression when using advanced API, by @terrelln 326api : change : clarify ZSTD_CCtx_reset() vs ZSTD_CCtx_resetParameters(), by @terrelln 327build: select custom libzstd scope through control macros, by @GeorgeLu97 328build: OpenBSD patch, by @bket 329build: make and make all are compatible with -j 330doc : clarify zstd_compression_format.md, updated for IETF RFC process 331misc: pzstd compatible with reproducible compilation, by @lamby 332 333v1.3.4 (Mar 27, 2018) 334perf: faster speed (especially decoding speed) on recent cpus (haswell+) 335perf: much better performance associating --long with multi-threading, by @terrelln 336perf: better compression at levels 13-15 337cli : asynchronous compression by default, for faster experience (use --single-thread for former behavior) 338cli : smoother status report in multi-threading mode 339cli : added command --fast=#, for faster compression modes 340cli : fix crash when not overwriting existing files, by Pádraig Brady (@pixelb) 341api : `nbThreads` becomes `nbWorkers` : 1 triggers asynchronous mode 342api : compression levels can be negative, for even more speed 343api : ZSTD_getFrameProgression() : get precise progress status of ZSTDMT anytime 344api : ZSTDMT can accept new compression parameters during compression 345api : implemented all advanced dictionary decompression prototypes 346build: improved meson recipe, by Shawn Landden (@shawnl) 347build: VS2017 scripts, by @HaydnTrigg 348misc: all /contrib projects fixed 349misc: added /contrib/docker script by @gyscos 350 351v1.3.3 (Dec 21, 2017) 352perf: faster zstd_opt strategy (levels 16-19) 353fix : bug #944 : multithreading with shared ditionary and large data, reported by @gsliepen 354cli : fix : content size written in header by default 355cli : fix : improved LZ4 format support, by @felixhandte 356cli : new : hidden command `-S`, to benchmark multiple files while generating one result per file 357api : fix : support large skippable frames, by @terrelln 358api : fix : streaming interface was adding a useless 3-bytes null block to small frames 359api : change : when setting `pledgedSrcSize`, use `ZSTD_CONTENTSIZE_UNKNOWN` macro value to mean "unknown" 360build: fix : compilation under rhel6 and centos6, reported by @pixelb 361build: added `check` target 362 363v1.3.2 (Oct 10, 2017) 364new : long range mode, using --long command, by Stella Lau (@stellamplau) 365new : ability to generate and decode magicless frames (#591) 366changed : maximum nb of threads reduced to 200, to avoid address space exhaustion in 32-bits mode 367fix : multi-threading compression works with custom allocators 368fix : ZSTD_sizeof_CStream() was over-evaluating memory usage 369fix : a rare compression bug when compression generates very large distances and bunch of other conditions (only possible at --ultra -22) 370fix : 32-bits build can now decode large offsets (levels 21+) 371cli : added LZ4 frame support by default, by Felix Handte (@felixhandte) 372cli : improved --list output 373cli : new : can split input file for dictionary training, using command -B# 374cli : new : clean operation artefact on Ctrl-C interruption 375cli : fix : do not change /dev/null permissions when using command -t with root access, reported by @mike155 (#851) 376cli : fix : write file size in header in multiple-files mode 377api : added macro ZSTD_COMPRESSBOUND() for static allocation 378api : experimental : new advanced decompression API 379api : fix : sizeof_CCtx() used to over-estimate 380build: fix : no-multithread variant compiles without pool.c dependency, reported by Mitchell Blank Jr (@mitchblank) (#819) 381build: better compatibility with reproducible builds, by Bernhard M. Wiedemann (@bmwiedemann) (#818) 382example : added streaming_memory_usage 383license : changed /examples license to BSD + GPLv2 384license : fix a few header files to reflect new license (#825) 385 386v1.3.1 (Aug 21, 2017) 387New license : BSD + GPLv2 388perf: substantially decreased memory usage in Multi-threading mode, thanks to reports by Tino Reichardt (@mcmilk) 389perf: Multi-threading supports up to 256 threads. Cap at 256 when more are requested (#760) 390cli : improved and fixed --list command, by @ib (#772) 391cli : command -vV to list supported formats, by @ib (#771) 392build : fixed binary variants, reported by @svenha (#788) 393build : fix Visual compilation for non x86/x64 targets, reported by Greg Slazinski (@GregSlazinski) (#718) 394API exp : breaking change : ZSTD_getframeHeader() provides more information 395API exp : breaking change : pinned down values of error codes 396doc : fixed huffman example, by Ulrich Kunitz (@ulikunitz) 397new : contrib/adaptive-compression, I/O driven compression strength, by Paul Cruz (@paulcruz74) 398new : contrib/long_distance_matching, statistics by Stella Lau (@stellamplau) 399updated : contrib/linux-kernel, by Nick Terrell (@terrelln) 400 401v1.3.0 (Jul 6, 2017) 402cli : new : `--list` command, by Paul Cruz 403cli : changed : xz/lzma support enabled by default 404cli : changed : `-t *` continue processing list after a decompression error 405API : added : ZSTD_versionString() 406API : promoted to stable status : ZSTD_getFrameContentSize(), by Sean Purcell 407API exp : new advanced API : ZSTD_compress_generic(), ZSTD_CCtx_setParameter() 408API exp : new : API for static or external allocation : ZSTD_initStatic?Ctx() 409API exp : added : ZSTD_decompressBegin_usingDDict(), requested by Guy Riddle (#700) 410API exp : clarified memory estimation / measurement functions. 411API exp : changed : strongest strategy renamed ZSTD_btultra, fastest strategy ZSTD_fast set to 1 412tools : decodecorpus can generate random dictionary-compressed samples, by Paul Cruz 413new : contrib/seekable_format, demo and API, by Sean Purcell 414changed : contrib/linux-kernel, updated version and license, by Nick Terrell 415 416v1.2.0 (May 5, 2017) 417cli : changed : Multithreading enabled by default (use target zstd-nomt or HAVE_THREAD=0 to disable) 418cli : new : command -T0 means "detect and use nb of cores", by Sean Purcell 419cli : new : zstdmt symlink hardwired to `zstd -T0` 420cli : new : command --threads=# (#671) 421cli : changed : cover dictionary builder by default, for improved quality, by Nick Terrell 422cli : new : commands --train-cover and --train-legacy, to select dictionary algorithm and parameters 423cli : experimental targets `zstd4` and `xzstd4`, with support for lz4 format, by Sean Purcell 424cli : fix : does not output compressed data on console 425cli : fix : ignore symbolic links unless --force specified, 426API : breaking change : ZSTD_createCDict_advanced(), only use compressionParameters as argument 427API : added : prototypes ZSTD_*_usingCDict_advanced(), for direct control over frameParameters. 428API : improved: ZSTDMT_compressCCtx() reduced memory usage 429API : fix : ZSTDMT_compressCCtx() now provides srcSize in header (#634) 430API : fix : src size stored in frame header is controlled at end of frame 431API : fix : enforced consistent rules for pledgedSrcSize==0 (#641) 432API : fix : error code "GENERIC" replaced by "dstSizeTooSmall" when appropriate 433build: improved cmake script, by @Majlen 434build: enabled Multi-threading support for *BSD, by Baptiste Daroussin 435tools: updated Paramgrill. Command -O# provides best parameters for sample and speed target. 436new : contrib/linux-kernel version, by Nick Terrell 437 438v1.1.4 (Mar 18, 2017) 439cli : new : can compress in *.gz format, using --format=gzip command, by Przemyslaw Skibinski 440cli : new : advanced benchmark command --priority=rt 441cli : fix : write on sparse-enabled file systems in 32-bits mode, by @ds77 442cli : fix : --rm remains silent when input is stdin 443cli : experimental : xzstd, with support for xz/lzma decoding, by Przemyslaw Skibinski 444speed : improved decompression speed in streaming mode for single shot scenarios (+5%) 445memory: DDict (decompression dictionary) memory usage down from 150 KB to 20 KB 446arch: 32-bits variant able to generate and decode very long matches (>32 MB), by Sean Purcell 447API : new : ZSTD_findFrameCompressedSize(), ZSTD_getFrameContentSize(), ZSTD_findDecompressedSize() 448API : changed : dropped support of legacy versions <= v0.3 (can be changed by modifying ZSTD_LEGACY_SUPPORT value) 449build : new: meson build system in contrib/meson, by Dima Krasner 450build : improved cmake script, by @Majlen 451build : added -Wformat-security flag, as recommended by Padraig Brady 452doc : new : educational decoder, by Sean Purcell 453 454v1.1.3 (Feb 7, 2017) 455cli : zstd can decompress .gz files (can be disabled with `make zstd-nogz` or `make HAVE_ZLIB=0`) 456cli : new : experimental target `make zstdmt`, with multi-threading support 457cli : new : improved dictionary builder "cover" (experimental), by Nick Terrell, based on prior work by Giuseppe Ottaviano. 458cli : new : advanced commands for detailed parameters, by Przemyslaw Skibinski 459cli : fix zstdless on Mac OS-X, by Andrew Janke 460cli : fix #232 "compress non-files" 461dictBuilder : improved dictionary generation quality, thanks to Nick Terrell 462API : new : lib/compress/ZSTDMT_compress.h multithreading API (experimental) 463API : new : ZSTD_create?Dict_byReference(), requested by Bartosz Taudul 464API : new : ZDICT_finalizeDictionary() 465API : fix : ZSTD_initCStream_usingCDict() properly writes dictID into frame header, by Gregory Szorc (#511) 466API : fix : all symbols properly exposed in libzstd, by Nick Terrell 467build : support for Solaris target, by Przemyslaw Skibinski 468doc : clarified specification, by Sean Purcell 469 470v1.1.2 (Dec 15, 2016) 471API : streaming : decompression : changed : automatic implicit reset when chain-decoding new frames without init 472API : experimental : added : dictID retrieval functions, and ZSTD_initCStream_srcSize() 473API : zbuff : changed : prototypes now generate deprecation warnings 474lib : improved : faster decompression speed at ultra compression settings and 32-bits mode 475lib : changed : only public ZSTD_ symbols are now exposed 476lib : changed : reduced usage of stack memory 477lib : fixed : several corner case bugs, by Nick Terrell 478cli : new : gzstd, experimental version able to decode .gz files, by Przemyslaw Skibinski 479cli : new : preserve file attributes 480cli : new : added zstdless and zstdgrep tools 481cli : fixed : status displays total amount decoded, even for file consisting of multiple frames (like pzstd) 482cli : fixed : zstdcat 483zlib_wrapper : added support for gz* functions, by Przemyslaw Skibinski 484install : better compatibility with FreeBSD, by Dimitry Andric 485source tree : changed : zbuff source files moved to lib/deprecated 486 487v1.1.1 (Nov 2, 2016) 488New : command -M#, --memory=, --memlimit=, --memlimit-decompress= to limit allowed memory consumption 489New : doc/zstd_manual.html, by Przemyslaw Skibinski 490Improved : slightly better compression ratio at --ultra levels (>= 20) 491Improved : better memory usage when using streaming compression API, thanks to @Rogier-5 report 492Added : API : ZSTD_initCStream_usingCDict(), ZSTD_initDStream_usingDDict() (experimental section) 493Added : example/multiple_streaming_compression.c 494Changed : zstd_errors.h is now installed within /include (and replaces errors_public.h) 495Updated man page 496Fixed : zstd-small, zstd-compress and zstd-decompress compilation targets 497 498v1.1.0 (Sep 28, 2016) 499New : contrib/pzstd, parallel version of zstd, by Nick Terrell 500added : NetBSD install target (#338) 501Improved : speed for batches of small files 502Improved : speed of zlib wrapper, by Przemyslaw Skibinski 503Changed : libzstd on Windows supports legacy formats, by Christophe Chevalier 504Fixed : CLI -d output to stdout by default when input is stdin (#322) 505Fixed : CLI correctly detects console on Mac OS-X 506Fixed : CLI supports recursive mode `-r` on Mac OS-X 507Fixed : Legacy decoders use unified error codes, reported by benrg (#341), fixed by Przemyslaw Skibinski 508Fixed : compatibility with OpenBSD, reported by Juan Francisco Cantero Hurtado (#319) 509Fixed : compatibility with Hurd, by Przemyslaw Skibinski (#365) 510Fixed : zstd-pgo, reported by octoploid (#329) 511 512v1.0.0 (Sep 1, 2016) 513Change Licensing, all project is now BSD, Copyright Facebook 514Small decompression speed improvement 515API : Streaming API supports legacy format 516API : ZDICT_getDictID(), ZSTD_sizeof_{CCtx, DCtx, CStream, DStream}(), ZSTD_setDStreamParameter() 517CLI supports legacy formats v0.4+ 518Fixed : compression fails on certain huge files, reported by Jesse McGrew 519Enhanced documentation, by Przemyslaw Skibinski 520 521v0.8.1 (Aug 18, 2016) 522New streaming API 523Changed : --ultra now enables levels beyond 19 524Changed : -i# now selects benchmark time in second 525Fixed : ZSTD_compress* can now compress > 4 GB in a single pass, reported by Nick Terrell 526Fixed : speed regression on specific patterns (#272) 527Fixed : support for Z_SYNC_FLUSH, by Dmitry Krot (#291) 528Fixed : ICC compilation, by Przemyslaw Skibinski 529 530v0.8.0 (Aug 2, 2016) 531Improved : better speed on clang and gcc -O2, thanks to Eric Biggers 532New : Build on FreeBSD and DragonFly, thanks to JrMarino 533Changed : modified API : ZSTD_compressEnd() 534Fixed : legacy mode with ZSTD_HEAPMODE=0, by Christopher Bergqvist 535Fixed : premature end of frame when zero-sized raw block, reported by Eric Biggers 536Fixed : large dictionaries (> 384 KB), reported by Ilona Papava 537Fixed : checksum correctly checked in single-pass mode 538Fixed : combined --test amd --rm, reported by Andreas M. Nilsson 539Modified : minor compression level adaptations 540Updated : compression format specification to v0.2.0 541changed : zstd.h moved to /lib directory 542 543v0.7.5 (Aug 1, 2016) 544Transition version, supporting decoding of v0.8.x 545 546v0.7.4 (Jul 17, 2016) 547Added : homebrew for Mac, by Daniel Cade 548Added : more examples 549Fixed : segfault when using small dictionaries, reported by Felix Handte 550Modified : default compression level for CLI is now 3 551Updated : specification, to v0.1.1 552 553v0.7.3 (Jul 9, 2016) 554New : compression format specification 555New : `--` separator, stating that all following arguments are file names. Suggested by Chip Turner. 556New : `ZSTD_getDecompressedSize()` 557New : OpenBSD target, by Juan Francisco Cantero Hurtado 558New : `examples` directory 559fixed : dictBuilder using HC levels, reported by Bartosz Taudul 560fixed : legacy support from ZSTD_decompress_usingDDict(), reported by Felix Handte 561fixed : multi-blocks decoding with intermediate uncompressed blocks, reported by Greg Slazinski 562modified : removed "mem.h" and "error_public.h" dependencies from "zstd.h" (experimental section) 563modified : legacy functions no longer need magic number 564 565v0.7.2 (Jul 4, 2016) 566fixed : ZSTD_decompressBlock() using multiple consecutive blocks. Reported by Greg Slazinski. 567fixed : potential segfault on very large files (many gigabytes). Reported by Chip Turner. 568fixed : CLI displays system error message when destination file cannot be created (#231). Reported by Chip Turner. 569 570v0.7.1 (Jun 23, 2016) 571fixed : ZBUFF_compressEnd() called multiple times with too small `dst` buffer, reported by Christophe Chevalier 572fixed : dictBuilder fails if first sample is too small, reported by Руслан Ковалёв 573fixed : corruption issue, reported by cj 574modified : checksum enabled by default in command line mode 575 576v0.7.0 (Jun 17, 2016) 577New : Support for directory compression, using `-r`, thanks to Przemyslaw Skibinski 578New : Command `--rm`, to remove source file after successful de/compression 579New : Visual build scripts, by Christophe Chevalier 580New : Support for Sparse File-systems (do not use space for zero-filled sectors) 581New : Frame checksum support 582New : Support pass-through mode (when using `-df`) 583API : more efficient Dictionary API : `ZSTD_compress_usingCDict()`, `ZSTD_decompress_usingDDict()` 584API : create dictionary files from custom content, by Giuseppe Ottaviano 585API : support for custom malloc/free functions 586New : controllable Dictionary ID 587New : Support for skippable frames 588 589v0.6.1 (May 13, 2016) 590New : zlib wrapper API, thanks to Przemyslaw Skibinski 591New : Ability to compile compressor / decompressor separately 592Changed : new lib directory structure 593Fixed : Legacy codec v0.5 compatible with dictionary decompression 594Fixed : Decoder corruption error (#173) 595Fixed : null-string roundtrip (#176) 596New : benchmark mode can select directory as input 597Experimental : midipix support, VMS support 598 599v0.6.0 (Apr 13, 2016) 600Stronger high compression modes, thanks to Przemyslaw Skibinski 601API : ZSTD_getFrameParams() provides size of decompressed content 602New : highest compression modes require `--ultra` command to fully unleash their capacity 603Fixed : zstd cli return error code > 0 and removes dst file artifact when decompression fails, thanks to Chip Turner 604 605v0.5.1 (Feb 18, 2016) 606New : Optimal parsing => Very high compression modes, thanks to Przemyslaw Skibinski 607Changed : Dictionary builder integrated into libzstd and zstd cli 608Changed (!) : zstd cli now uses "multiple input files" as default mode. See `zstd -h`. 609Fix : high compression modes for big-endian platforms 610New : zstd cli : `-t` | `--test` command 611 612v0.5.0 (Feb 5, 2016) 613New : dictionary builder utility 614Changed : streaming & dictionary API 615Improved : better compression of small data 616 617v0.4.7 (Jan 22, 2016) 618Improved : small compression speed improvement in HC mode 619Changed : `zstd_decompress.c` has ZSTD_LEGACY_SUPPORT to 0 by default 620fix : bt search bug 621 622v0.4.6 (Jan 13, 2016) 623fix : fast compression mode on Windows 624New : cmake configuration file, thanks to Artyom Dymchenko 625Improved : high compression mode on repetitive data 626New : block-level API 627New : ZSTD_duplicateCCtx() 628 629v0.4.5 (Dec 18, 2015) 630new : -m/--multiple : compress/decompress multiple files 631 632v0.4.4 (Dec 14, 2015) 633Fixed : high compression modes for Windows 32 bits 634new : external dictionary API extended to buffered mode and accessible through command line 635new : windows DLL project, thanks to Christophe Chevalier 636 637v0.4.3 (Dec 7, 2015) 638new : external dictionary API 639new : zstd-frugal 640 641v0.4.2 (Dec 2, 2015) 642Generic minor improvements for small blocks 643Fixed : big-endian compatibility, by Peter Harris (#85) 644 645v0.4.1 (Dec 1, 2015) 646Fixed : ZSTD_LEGACY_SUPPORT=0 build mode (reported by Luben) 647removed `zstd.c` 648 649v0.4.0 (Nov 29, 2015) 650Command line utility compatible with high compression levels 651Removed zstdhc => merged into zstd 652Added : ZBUFF API (see zstd_buffered.h) 653Rolling buffer support 654 655v0.3.6 (Nov 10, 2015) 656small blocks params 657 658v0.3.5 (Nov 9, 2015) 659minor generic compression improvements 660 661v0.3.4 (Nov 6, 2015) 662Faster fast cLevels 663 664v0.3.3 (Nov 5, 2015) 665Small compression ratio improvement 666 667v0.3.2 (Nov 2, 2015) 668Fixed Visual Studio 669 670v0.3.1 (Nov 2, 2015) 671Small compression ratio improvement 672 673v0.3 (Oct 30, 2015) 674HC mode : compression levels 2-26 675 676v0.2.2 (Oct 28, 2015) 677Fix : Visual Studio 2013 & 2015 release compilation, by Christophe Chevalier 678 679v0.2.1 (Oct 24, 2015) 680Fix : Read errors, advanced fuzzer tests, by Hanno Böck 681 682v0.2.0 (Oct 22, 2015) 683**Breaking format change** 684Faster decompression speed 685Can still decode v0.1 format 686 687v0.1.3 (Oct 15, 2015) 688fix uninitialization warning, reported by Evan Nemerson 689 690v0.1.2 (Sep 11, 2015) 691frame concatenation support 692 693v0.1.1 (Aug 27, 2015) 694fix compression bug 695detects write-flush errors 696 697v0.1.0 (Aug 25, 2015) 698first release 699