mirror of
https://github.com/facebook/zstd
synced 2026-08-22 22:32:07 -04:00
Previously, parallel_compression would only handle each job's results after ALL jobs were successfully queued. This caused all src/dst buffers to remain in memory until then! It also polled to check whether a job completed, which is racy without any memory barrier. Now, we flush results as a side effect of completing a job. Completed frames are placed in an ordered linked-list, and any eligible frames are flushed. This may be zero or multiple frames, depending on the order in which jobs finish. This design also makes it simple to support streaming input, so that is now available. Just pass `-` as the filename, and stdin/stdout will be used for I/O. |
||
|---|---|---|
| .. | ||
| diagnose_corruption | ||
| docker | ||
| externalSequenceProducer | ||
| freestanding_lib | ||
| gen_html | ||
| largeNbDicts | ||
| linux-kernel | ||
| match_finders | ||
| premake | ||
| pzstd | ||
| recovery | ||
| seekable_format | ||
| seqBench | ||
| snap | ||
| VS2005 | ||
| cleanTabs | ||