1
0
mirror of https://github.com/facebook/zstd.git synced 2025-07-16 12:14:18 +02:00
Commit Graph

6952 Commits

Author SHA1 Message Date
58b69ab15c Only the CCtx Itself Needs to be Cleared during Static CCtx Init 2019-09-09 13:34:08 -04:00
88c2fcd0ee Align Alloc Pointer When Transitioning from Buffers to Aligned Allocs 2019-09-09 13:34:08 -04:00
e936b73889 Remove Overly-Restrictive Assert 2019-09-09 13:34:08 -04:00
75d574368b When Loading Dict By Copy, Always Put it in the Workspace 2019-09-09 13:34:08 -04:00
e69b67e33a Alloc Tables Separately 2019-09-09 13:34:08 -04:00
6177354b36 Begin Introducing Phases 2019-09-09 13:34:08 -04:00
786f2266bb TMP 2019-09-09 13:34:08 -04:00
c25283cf00 Disambiguate 'workspace' and 'entropyWorkspace' 2019-09-09 13:34:08 -04:00
ccaac852e8 Normalize Case 'workSpace' -> 'workspace' 2019-09-09 13:27:18 -04:00
a71bbba7be [Fuzz] Improve data generation #1723 2019-09-09 08:43:22 -07:00
cd5fdcf6f9 Merge pull request #1771 from vnair81/dev
Passing ZSTD_CCtx_params by const pointer
2019-09-06 17:02:53 -07:00
a3815d233c fix minor compilation condition
harness.c is not designed to pass  -Wdeclaration-after-statement
2019-09-06 16:51:16 -07:00
44e122053b Mentioning cli only in the comment as suggested 2019-09-06 14:48:41 -07:00
2b0a271ed2 fix eductional decoder
fix #1774
also :
- fix minor compilation warnings
- make sure the `test` is run during CI tests
2019-09-06 14:30:13 -07:00
a917cd597d Put back omission for first rle block and updated comment as suggested 2019-09-06 13:44:25 -07:00
62616c4d90 fixes for windows compilation 2019-09-06 13:20:50 -07:00
30bff50e06 fixes for tests and segfault 2019-09-06 11:10:53 -07:00
d687d603e4 Removing redundant condition in decompression, making first block rles valid to deocmpress 2019-09-06 10:46:19 -07:00
a9c807a948 kill memory leaks, cleanup, fix some dumb bugs 2019-09-06 10:17:04 -07:00
6beb3c0159 added decompression support 2019-09-05 17:56:24 -07:00
7f98b46876 adding support for -O flag: multiple files into one directory for compressions (decompression to come) 2019-09-05 16:03:35 -07:00
9816560649 Fixing assert and DEBUGLOG due to ZSTD_CCtx_params parameter change to const pointer 2019-09-05 15:47:17 +05:30
771645471f Passing ZSTD_CCtx_params by const pointer 2019-09-05 15:28:30 +05:30
b8327ac4c6 Merge pull request #1770 from cwoffenden/amalgamate-correctness
Single file decoder correctness and tidy
2019-09-04 14:51:23 -07:00
25878b2de9 [programs] don’t do chmod when coming from stdin or multiple files
Fixes #1729
2019-09-02 18:02:32 -07:00
88975e8c25 Minor: documented sizes smaller 2019-09-02 18:15:31 +02:00
8ac29cc825 Correctness and tidy
Test compilation performed with warnings. Author and license added. Test for failing grep on ancient OSX versions. Replaced the test image with something less noisy (which compresses better).
2019-09-02 18:02:50 +02:00
b199bb3e0a Merge pull request #1769 from cybojanek/update_streaming_examples
Fix streaming compression/decompression examples
2019-09-01 18:11:54 -07:00
a8219903cf Fix streaming compression/decompression examples
* Handle compression of empty file
* Error in decompression in case of trailing data
2019-09-01 17:22:42 -04:00
c9381c16be Merge pull request #1761 from terrelln/regression
[regression] small improvement from RLE blocks
2019-08-30 10:48:02 -07:00
5f8b0f6890 Changing api to get sequences across all blocks 2019-08-30 09:18:44 -07:00
8ce9c1917e [regression] small improvement from RLE blocks 2019-08-29 18:05:58 -07:00
5198347382 Merge pull request #1744 from bimbashrestha/dev
Generate RLE blocks in the encoder
2019-08-29 15:19:10 -07:00
623b90f85d Fixing ci-circle test complaints 2019-08-29 13:09:42 -07:00
5d89771529 fix warning: always_inline function might not be inlinable 2019-08-29 12:32:15 -07:00
ece465644b Adding api for extracting sequences from seqstore 2019-08-29 12:29:39 -07:00
b830599582 Improvements in zstd decode performance
Summary: The idea behind wildcopy is that it can be cheaper to copy more bytes (say 8) than it is to copy less (say, 3).  This change takes that further by exploiting some properties:
1. it's almost always OK to copy 16 bytes instead of 8, which means fewer copy instructions, and fewer branches
2. A 16 byte chunk size means that ~90% of wildcopy invocations will have a trip count of 1, so branch prediction will be improved.

Speedup on Xeon E5-2680v4 is in the range of 3-5%.

Measured wildcopy length distributions on silesia.tar:

level	<=8	<=16	<=24	>24
1	78.05%	11.49%	3.52%	6.94%
3	82.14%	8.99%	2.44%	6.43%
6	85.81%	6.51%	2.92%	4.76%
8	83.02%	7.31%	3.64%	6.03%
10	84.13%	6.67%	3.29%	5.91%
15	77.58%	7.55%	5.21%	9.66%
16	80.07%	7.20%	3.98%	8.75%

Test Plan: benchmark silesia, make check
2019-08-29 12:25:56 -07:00
d944197e79 Merge pull request #1754 from facebook/decTest
Tests for single-file decompressor
2019-08-29 12:09:09 -07:00
c3e3c8bf32 Undoing the last commit (that was an accident) 2019-08-29 12:05:47 -07:00
4a1ca5e0a8 Adding method for extracting sequences. 2019-08-29 11:55:12 -07:00
64102f08da Merge branch 'dev' into decTest 2019-08-29 09:48:12 -07:00
ccb7c8e903 Merge pull request #1755 from cwoffenden/amalgamate-c99-fixes
C99 and older GCC fixes
2019-08-29 09:47:28 -07:00
72e51ac246 C99 and older GCC fixes 2019-08-29 11:16:57 +02:00
e7ad20c9dc update test script 2019-08-28 13:46:18 -07:00
4b3a8fe1c4 fix create_ script for sh 2019-08-28 13:23:48 -07:00
9589e8e4bb Merge pull request #1749 from facebook/rmadapt
removed adaptive-compression
2019-08-28 12:26:29 -07:00
8af941d2d7 Merge branch 'dev' into decTest 2019-08-28 12:17:29 -07:00
979ddc1271 Merge pull request #1750 from cwoffenden/amalgamate-bash2sh
Rewrote the scripts to use sh instead of bash
2019-08-28 12:14:29 -07:00
cdf73e915e Rewrote the scripts to sh instead of bash 2019-08-28 19:20:42 +02:00
e5704bbfdf Added test for multiple blocks of zeros and fixed nit about comments 2019-08-28 08:32:34 -07:00