mirror of
https://github.com/facebook/zstd
synced 2026-08-22 22:32:07 -04:00
395a2c5462
The block splitter confuses sequences with literal length == 65536 that use a repeat offset code. It interprets this as literal length == 0 when deciding the meaning of the repeat offset, and corrupts the repeat offset history. This is benign, merely causing suboptimal compression performance, if the confused history is flushed before the end of the block, e.g. if there are 3 consecutive non-repeat code sequences after the mistake. It also is only triggered if the block splitter decided to split the block. All that to say: This is a rare bug, and requires quite a few conditions to trigger. However, the good news is that if you have a way to validate that the decompressed data is correct, e.g. you've enabled zstd's checksum or have a checksum elsewhere, the original data is very likely recoverable. So if you were affected by this bug please reach out. The fix is to remind the block splitter that the literal length is actually 64K. The test case is a bit tricky to set up, but I've managed to reproduce the issue. Thanks to @danlark1 for alerting us to the issue and providing us a reproducer! |
||
|---|---|---|
| .. | ||
| adapt.sh | ||
| basic.sh | ||
| compress-literals.sh | ||
| format.sh | ||
| golden.sh | ||
| gzip-compat.sh | ||
| levels.sh | ||
| levels.sh.stderr.exact | ||
| long-distance-matcher.sh | ||
| multi-threaded.sh | ||
| multi-threaded.sh.stderr.exact | ||
| multiple-files.sh | ||
| multiple-files.sh.stdout.exact | ||
| row-match-finder.sh | ||
| setup | ||
| stream-size.sh | ||
| verbose-wlog.sh | ||
| verbose-wlog.sh.stderr.glob | ||
| verbose-wlog.sh.stdout.glob | ||
| window-resize.sh | ||
| window-resize.sh.stderr.ignore | ||
| window-resize.sh.stdout.glob | ||