akadmin/headroom
1
0
Fork 0
mirror of https://github.com/headroomlabs-ai/headroom.git synced 2026-08-27 14:17:10 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
headroom/benchmarks
History
Exact
chopratejas 0161cdb386 chore(transforms): retire dead text_compressor module (Phase 3e.3) 
`headroom/transforms/text_compressor.py` was a regex-line-sampling
fallback that nothing in the runtime called. ContentRouter routes
`CompressionStrategy.TEXT` straight to the Kompress ML compressor at
`content_router.py:1046` — the comment there literally says 'Prefer
Kompress ML compressor for text'. The Python file was orphaned but
still imported by its own test class, making it look live in the 3e
queue.

Drops the 3e.3 port from the queue: there's nothing to port.

# Removed
* `headroom/transforms/text_compressor.py` (255 LOC, unused)
* `tests/test_text_compressors.py::TestTextCompressor` (3 tests)
* `text_compressor` mention in `error_detection.py` shim docstring
* `text_compressor` mention in `test_signals_keyword_parity.py` docstring
* `TextCompressor` mention in `bench_latency.py` scenario comment

# Kept (defensive)
The legacy marker regex in `ccr/tool_injection.py:213` stays — it
parses an even older TextCompressor output format (pre-2026), is
purely defensive, and removal buys nothing. Test references to that
format in `test_ccr_tool_injection.py` document the regex contract
and stay too.

# Test plan
* `make ci-precheck` clean
* `tests/test_text_compressors.py` 19 passes (was 22, dropped 3)
2026-04-29 21:14:36 -07:00
..
scenarios Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
__init__.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
adversarial_ccr_tests.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
agent_cost_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
bench_latency.py chore(transforms): retire dead text_compressor module (Phase 3e.3) 2026-04-29 21:14:36 -07:00
bench_relevance.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
bench_transforms.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
cache_bust_trace_report.py test: align anthropic cache stability fixtures 2026-04-06 23:26:51 -05:00
cache_validation_bundle.py test: align anthropic cache stability fixtures 2026-04-06 23:26:51 -05:00
ccr_regression_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
claude_session_branch_compare.py test: align anthropic cache stability fixtures 2026-04-06 23:26:51 -05:00
claude_session_mode_benchmark.py test: align anthropic cache stability fixtures 2026-04-06 23:26:51 -05:00
comprehensive_eval.py Add quality retention eval and fix linting for Python 3.12 2026-01-19 21:52:18 -08:00
compression_benchmark.py chore: add nosec B324 annotations to non-cryptographic MD5 usages and update temporary database path to use system temp directory 2026-04-07 13:07:26 +06:00
conftest.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
dynamic_detector_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
headroom_adversarial_benchmark.py chore: add nosec B324 annotations to non-cryptographic MD5 usages and update temporary database path to use system temp directory 2026-04-07 13:07:26 +06:00
headroom_worst_case_benchmark.py chore: add nosec B324 annotations to non-cryptographic MD5 usages and update temporary database path to use system temp directory 2026-04-07 13:07:26 +06:00
prefix_cache_benchmark.py Format prefix_cache_benchmark.py for ruff 0.15 compatibility 2026-03-12 22:03:38 -07:00
proxy_mode_benchmark.py Fix CI lint/format failures after proxy mode hardening 2026-04-04 14:42:32 -05:00
real_world_agent_benchmark.py chore: add nosec B324 annotations to non-cryptographic MD5 usages and update temporary database path to use system temp directory 2026-04-07 13:07:26 +06:00
run_benchmarks.py Add OSS evaluation suite, universal JSON crush, latency benchmarks 2026-02-23 19:08:54 -08:00
synthetic_long_cache_suite_report.py test: align anthropic cache stability fixtures 2026-04-06 23:26:51 -05:00
synthetic_token_cache_bust_report.py test: align anthropic cache stability fixtures 2026-04-06 23:26:51 -05:00