zstd/contrib
Dave Vasilevsky 2d4cff69c4 seekable_format: Make parallel_compression use memory properly
Previously, parallel_compression would only handle each job's results
after ALL jobs were successfully queued. This caused all src/dst
buffers to remain in memory until then!

It also polled to check whether a job completed, which is racy without
any memory barrier.

Now, we flush results as a side effect of completing a job. Completed
frames are placed in an ordered linked-list, and any eligible frames
are flushed. This may be zero or multiple frames, depending on the
order in which jobs finish.

This design also makes it simple to support streaming input, so that
is now available. Just pass `-` as the filename, and stdin/stdout will
be used for I/O.
2025-05-07 22:01:49 -07:00
..
diagnose_corruption Coalesce Almost All Copyright Notices to Standard Phrasing 2022-12-20 12:52:34 -05:00
docker Also Pin Dockerfile Dependency Hashes 2023-03-09 17:01:22 -05:00
externalSequenceProducer Rename "External Matchfinder" to "Block-Level Sequence Producer" (#3484) 2023-02-09 17:01:17 -05:00
freestanding_lib Coalesce Almost All Copyright Notices to Standard Phrasing 2022-12-20 12:52:34 -05:00
gen_html inform manual users that it's automatically generated 2024-10-31 15:06:48 -07:00
largeNbDicts codemod: ZSTD_paramSwitch_e -> ZSTD_ParamSwitch_e 2024-12-20 10:36:58 -08:00
linux-kernel lib: zstd: export API needed for dictionary support 2025-02-28 17:09:46 -05:00
match_finders Coalesce Almost All Copyright Notices to Standard Phrasing 2022-12-20 12:52:34 -05:00
premake Fix wrong conditions 2018-07-14 12:34:03 +02:00
pzstd try to fix the meson windows build 2025-02-27 15:45:59 -08:00
recovery Coalesce Almost All Copyright Notices to Standard Phrasing 2022-12-20 12:52:34 -05:00
seekable_format seekable_format: Make parallel_compression use memory properly 2025-05-07 22:01:49 -07:00
seqBench Coalesce Almost All Copyright Notices to Standard Phrasing 2022-12-20 12:52:34 -05:00
snap moved snap to /contrib 2018-03-19 16:15:06 -07:00
VS2005 AsyncIO compression part 1 - refactor of existing asyncio code (#3021) 2022-01-24 14:43:02 -08:00
cleanTabs created contrib/cleanTabs 2017-03-30 12:42:44 -07:00