krak/zstd
1
0
Fork 0
mirror of https://github.com/facebook/zstd.git synced 2025-12-25 23:47:50 +02:00
Code Issues Releases 1 Activity
11,418 Commits 41 Branches 77 Tags
dev
Commit Graph

2307 Commits

Author SHA1 Message Date
黄尚诚10330306
71146f5b6d Add RISC-V 64-bit architecture detection 2025-11-03 16:37:05 +08:00
Yann Collet
7a3c940e7f syncio interface only enabled when compression is enabled 2025-10-26 09:48:45 -07:00
Yann Collet
41f2673acd changed name to syncIO for clarity 2025-10-25 11:23:16 -07:00
Yann Collet
ccadc33a59 minor: use init/destroy pair naming convention 2025-10-25 11:11:48 -07:00
Yann Collet
d1dd7e1481 removed asyncio completely for compression path 
this does not provide speed benefits,
since most of the leverage happens internally within the library,
and can even become detrimental in certain scenario, due to complex and wasteful memory management.
At a minimum, it makes the logic simpler, easier to debug, at essentially the same performance.
 2025-10-25 11:02:51 -07:00
Yann Collet
44cd3c8451 disable asyncio during compression 
it's not helpful for performance, and can in some times be detrimental.
the synchronous mode is also much easier to follow and debug.
 2025-10-25 00:50:55 -07:00
Yann Collet
e6e5a95c15 Merge pull request #4487 from neiljohari/adhoc/dictionary-file-counting 
make DiB_fileStats skip invalid files (fileSize <= 0) to prevent negative totals and bogus allocation
 2025-09-19 21:42:06 -08:00
Neil Johari
236e44f00f Remove debug logging 2025-09-16 00:03:08 -07:00
Neil Johari
85f4a7e84e Fix bug 2025-09-16 00:02:04 -07:00
Neil Johari
96fdb9bd16 Add debug logging and simple repro 2025-09-15 23:58:45 -07:00
Yann Collet
249e4a07d5 fixed minor unused variable warning 
in certain compilation modes
 2025-09-02 16:36:44 -07:00
Yann Collet
725a152c7b benchmark uses 1 thread by default 2025-09-02 16:29:14 -07:00
Yann Collet
c41fc1aa01 only display nbThread Msg in nbThreads > 1 2025-09-02 16:05:35 -07:00
Yann Collet
6551db3459 specify nb of threads used during benchmarking 
used to require `-v` (verbose) modifier
 2025-09-02 15:53:45 -07:00
Yann Collet
1c5d45fc11 fixed -T# documentation in zstd -H 
provide the local value for default nbThreads
which is dynamic and depends on local nb of cores.
 2025-09-02 15:46:51 -07:00
Jamie Lokier
64c4288e92 Update manual about the default value of -T#/--threads=# 
The section about `ZSTD_NBTHREADS` already explains the default number of
threads, since it changed from 1 (commit 17beeb5).  But the option description
for `-T#`/`--threads=#` incorrectly said the default was still 1.

I noticed this when I found compression slower with `-T1` than without it.
 2025-09-02 16:44:39 +01:00
Yann Collet
ae64545c6b fixed a potential division by 0 in the cli trace unit 2025-08-19 17:13:15 -07:00
Yann Collet
8bca04ba9f regroup list of OSes for install inside common variable 
within lib/install_oses.mk.

fixes #4445
 2025-07-28 11:33:22 -07:00
Yann Collet
39c091bc9e Merge pull request #4397 from xiaoge1001/free 
Fix several locations with potential memory leak
 2025-06-09 10:06:36 -07:00
shixuantong
de8d9e8914 Fix several locations with potential memory leak 2025-06-09 21:23:23 +08:00
shixuantong
4bd5654e72 update --rm cmd help info 
Starting from cee6bec9fa, --rm is ignored when the output is `stdout`.
 2025-05-30 06:49:52 +08:00
Li-Yu Yu
2a12bbaf90 Update cli-tests/file-stat tests 2025-03-28 22:46:26 +00:00
Li-Yu Yu
3bd5aa3404 Check regular file for sparse support after opening 
A regular file may be created by the open call.
Checking after opening allows sparseFileSupport even
if dstFileName does not already exist.
 2025-03-28 21:23:10 +00:00
Yann Collet
2f9627863f update error message 2025-03-28 10:02:37 -07:00
Yann Collet
8626da73b6 add error message clarification for inputs as process substitution 2025-03-28 09:18:17 -07:00
Yann Collet
0bde39a9b3 visual studio fix 2025-03-28 09:18:17 -07:00
Yann Collet
94cfa0b5a0 minor: restore some code comment 2025-03-28 09:18:17 -07:00
Yann Collet
76c2fdc7b7 better naming 
and more narrow scope of local variables
 2025-03-28 09:18:17 -07:00
Yann Collet
7630870b47 second implementation, better structured for improved maintenance 2025-03-28 09:18:17 -07:00
Yann Collet
165e52ce62 first implementation supporting Process Substitution 2025-03-28 09:18:17 -07:00
Yann Collet
7f0519dcfd Merge pull request #4346 from Cyan4973/wintime 
fix a risk of overflow on a time counter on Windows
 2025-03-27 21:07:57 -07:00
Yann Collet
eb168a0afc add --patch-apply command 
as an equivalent for `-d --patch-from`.
Requested by @sergeevabc in #2173.
 2025-03-25 14:50:39 -07:00
Yann Collet
33f4d40d1e fix a risk of overflow on a time counter on Windows 
closes #4126
 2025-03-23 11:42:41 -07:00
Yann Collet
19541b4d1a fix minor unused variable warning 2025-03-11 00:17:45 -07:00
Yann Collet
c583c2c39e warn when requesting decompression with multiple threads 
restore #2918 fix
 2025-03-10 22:50:00 -07:00
Yann Collet
2ff87aefac fix FreeBSD 
use an alias instead of a function

also: added more traces and updated version nb to v1.5.8
 2025-03-10 19:04:41 -07:00
Yann Collet
56e2ebf5c3 removed useless assert() 2025-03-10 09:54:06 -07:00
Yann Collet
d5986f235f fix #4332: setting ZSTD_NBTHREADS=0 via environment variables 2025-03-10 00:12:34 -07:00
Nick Terrell
0de4991942 Add a method for checking if ZSTD was compiled with flags that impact determinism 2025-03-07 10:31:19 -05:00
Yann Collet
f5a0e047cb fix typo 2025-03-04 15:12:35 -08:00
Yann Collet
0b40c513fd update fileio to employ jobSize 2025-03-04 14:55:25 -08:00
Yann Collet
0298df50f9 update cli-tests 2025-03-04 14:43:06 -08:00
Yann Collet
19ffcf81b8 changed -B# command into --jobsize 
to reduce confusion with the term "block".

-B# remains supported for existing scripts,
but it's no longer documented, so it's effectively a hidden shortcut.
 2025-03-04 13:17:10 -08:00
Yann Collet
fcfb3160dc convert benchmark unit to use the new naming scheme 
chunks instead of blocks
 2025-03-04 13:04:59 -08:00
Yann Collet
d5dbdd6ece changed command --blocksize into --split 
to reduce confusion with the concept of "blocks" inside a Zstandard frame.

We are now talking about "independent chunks" being produced by a `split` operation.

updated documentation accordingly.

Note: old commands "-B#` and `--blocksize=#` remain supported,
to maintain compatibility with existing scripts.
 2025-03-04 12:53:23 -08:00
Yann Collet
6af3842118 updated man pages and manual 
fixes #4301
 2025-02-19 16:25:00 -08:00
Yann Collet
339bca6606 update ldm compression results 2025-02-10 10:46:37 -08:00
Yann Collet
72406b71c3 update hrlog rule to favor compression ratio a bit more at low levels 2025-02-10 10:46:37 -08:00
Yann Collet
bf218c142a updated LDM documentation 2025-02-10 10:46:37 -08:00
Yann Collet
5b8575adaa Merge pull request #4289 from facebook/autoultra 
--ultra automatically triggered with --long and --patch-from
 2025-02-10 10:38:28 -08:00