denuvo-ref/zstd
1
0
Fork 0
mirror of https://github.com/facebook/zstd synced 2026-08-22 22:32:07 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
11482 commits 41 branches 77 tags 57 MiB
Commit graph

2323 commits

Author SHA1 Message Date
Joy G. Majumdar
abab95f8e0
Merge 82f8898a03 into 82d322c497 2026-08-04 18:11:55 +08:00
Yann Collet
c84c8fb47f
Merge pull request #4606 from jlee303/update_manual 
Update manual/error message
 2026-03-13 10:37:36 -07:00
Yann Collet
ff25783fcb
Merge pull request #4619 from jlee303/display_option_c 
Promote -c flag
 2026-03-13 10:34:03 -07:00
Yann Collet
155046f3ac
Merge pull request #4620 from jlee303/defineable_cflags 
Make DISPLAY_LEVEL_DEFAULT configurable at compile time
 2026-03-13 10:33:46 -07:00
Jennifer Lee
e374fc76fe fix display format 2026-03-12 11:34:43 -07:00
Jennifer Lee
3f565b731e rever -q 2026-03-12 11:32:48 -07:00
Jennifer Lee
3041c8e539 Update #define format 2026-03-11 08:29:06 -07:00
Jennifer Lee
2293e9601f init commit 2026-03-09 17:17:13 -07:00
Jennifer Lee
043426b3e2 Promote flag 2026-03-09 16:30:41 -07:00
Integral
f1e77ab2ba
Accept G, GB and GiB suffixes for options 2026-03-07 14:49:39 +08:00
jlee303
1bd8e55363
Update programs/zstd.1.md 
Co-authored-by: Nick Terrell <nickrterrell@gmail.com>
 2026-03-05 15:12:33 -08:00
Jennifer Lee
6a8715f8d4 update man 2026-03-04 13:29:20 -08:00
richardsonnick
bb1eedcf86 correct mmap error check 
Update mmap error validation to check for MAP_FAILED instead of NULL.
POSIX specifies that mmap returns MAP_FAILED (-1) on failure.
 2026-02-27 17:40:26 -05:00
Briar Campbell
117b0edfae Fix formatting of lz4 option in zstdcli.c 2026-02-27 16:10:41 -05:00
Briar Campbell
a90d7e7689 Fix formatting of lz4 option in README 2026-02-27 16:10:41 -05:00
Joy Majumdar
82f8898a03 Add configurable input buffer size for decompression (--ibuf-size) 
This feature addresses performance issues when decompressing large files
on mechanical hard drives with excessive disk seek operations.

Changes:
- Add 'inputBufferSize' field to FIO_prefs_t in fileio_types.h
- Implement FIO_setInputBufferSize() setter function
- Use configured buffer size in FIO_createDResources()
- Add --ibuf-size command-line option with help text

The option allows users to specify input buffer size (default: 0 for
automatic). For large files on slow drives, using --ibuf-size=1024M
to --ibuf-size=5120M can significantly improve throughput by reducing
disk seek operations.

Backward compatible: defaults to ZSTD_DStreamInSize when not specified.
 2025-12-07 06:31:26 +00:00
黄尚诚10330306
71146f5b6d Add RISC-V 64-bit architecture detection 2025-11-03 16:37:05 +08:00
Yann Collet
7a3c940e7f syncio interface only enabled when compression is enabled 2025-10-26 09:48:45 -07:00
Yann Collet
41f2673acd changed name to syncIO for clarity 2025-10-25 11:23:16 -07:00
Yann Collet
ccadc33a59 minor: use init/destroy pair naming convention 2025-10-25 11:11:48 -07:00
Yann Collet
d1dd7e1481 removed asyncio completely for compression path 
this does not provide speed benefits,
since most of the leverage happens internally within the library,
and can even become detrimental in certain scenario, due to complex and wasteful memory management.
At a minimum, it makes the logic simpler, easier to debug, at essentially the same performance.
 2025-10-25 11:02:51 -07:00
Yann Collet
44cd3c8451 disable asyncio during compression 
it's not helpful for performance, and can in some times be detrimental.
the synchronous mode is also much easier to follow and debug.
 2025-10-25 00:50:55 -07:00
Yann Collet
e6e5a95c15
Merge pull request #4487 from neiljohari/adhoc/dictionary-file-counting 
make DiB_fileStats skip invalid files (fileSize <= 0) to prevent negative totals and bogus allocation
 2025-09-19 21:42:06 -08:00
Neil Johari
236e44f00f
Remove debug logging 2025-09-16 00:03:08 -07:00
Neil Johari
85f4a7e84e
Fix bug 2025-09-16 00:02:04 -07:00
Neil Johari
96fdb9bd16
Add debug logging and simple repro 2025-09-15 23:58:45 -07:00
Yann Collet
249e4a07d5 fixed minor unused variable warning 
in certain compilation modes
 2025-09-02 16:36:44 -07:00
Yann Collet
725a152c7b benchmark uses 1 thread by default 2025-09-02 16:29:14 -07:00
Yann Collet
c41fc1aa01 only display nbThread Msg in nbThreads > 1 2025-09-02 16:05:35 -07:00
Yann Collet
6551db3459 specify nb of threads used during benchmarking 
used to require `-v` (verbose) modifier
 2025-09-02 15:53:45 -07:00
Yann Collet
1c5d45fc11 fixed -T# documentation in zstd -H 
provide the local value for default nbThreads
which is dynamic and depends on local nb of cores.
 2025-09-02 15:46:51 -07:00
Jamie Lokier
64c4288e92 Update manual about the default value of -T#/--threads=# 
The section about `ZSTD_NBTHREADS` already explains the default number of
threads, since it changed from 1 (commit 17beeb5).  But the option description
for `-T#`/`--threads=#` incorrectly said the default was still 1.

I noticed this when I found compression slower with `-T1` than without it.
 2025-09-02 16:44:39 +01:00
Yann Collet
ae64545c6b fixed a potential division by 0 in the cli trace unit 2025-08-19 17:13:15 -07:00
Yann Collet
8bca04ba9f regroup list of OSes for install inside common variable 
within lib/install_oses.mk.

fixes #4445
 2025-07-28 11:33:22 -07:00
Yann Collet
39c091bc9e
Merge pull request #4397 from xiaoge1001/free 
Fix several locations with potential memory leak
 2025-06-09 10:06:36 -07:00
shixuantong
de8d9e8914 Fix several locations with potential memory leak 2025-06-09 21:23:23 +08:00
shixuantong
4bd5654e72 update --rm cmd help info 
Starting from cee6bec9fa, --rm is ignored when the output is `stdout`.
 2025-05-30 06:49:52 +08:00
Li-Yu Yu
2a12bbaf90 Update cli-tests/file-stat tests 2025-03-28 22:46:26 +00:00
Li-Yu Yu
3bd5aa3404 Check regular file for sparse support after opening 
A regular file may be created by the open call.
Checking after opening allows sparseFileSupport even
if dstFileName does not already exist.
 2025-03-28 21:23:10 +00:00
Yann Collet
2f9627863f update error message 2025-03-28 10:02:37 -07:00
Yann Collet
8626da73b6 add error message clarification for inputs as process substitution 2025-03-28 09:18:17 -07:00
Yann Collet
0bde39a9b3 visual studio fix 2025-03-28 09:18:17 -07:00
Yann Collet
94cfa0b5a0 minor: restore some code comment 2025-03-28 09:18:17 -07:00
Yann Collet
76c2fdc7b7 better naming 
and more narrow scope of local variables
 2025-03-28 09:18:17 -07:00
Yann Collet
7630870b47 second implementation, better structured for improved maintenance 2025-03-28 09:18:17 -07:00
Yann Collet
165e52ce62 first implementation supporting Process Substitution 2025-03-28 09:18:17 -07:00
Yann Collet
7f0519dcfd
Merge pull request #4346 from Cyan4973/wintime 
fix a risk of overflow on a time counter on Windows
 2025-03-27 21:07:57 -07:00
Yann Collet
eb168a0afc add --patch-apply command 
as an equivalent for `-d --patch-from`.
Requested by @sergeevabc in #2173.
 2025-03-25 14:50:39 -07:00
Yann Collet
33f4d40d1e fix a risk of overflow on a time counter on Windows 
closes #4126
 2025-03-23 11:42:41 -07:00
Yann Collet
19541b4d1a fix minor unused variable warning 2025-03-11 00:17:45 -07:00