akadmin/headroom
1
0
Fork 0
mirror of https://github.com/headroomlabs-ai/headroom.git synced 2026-08-27 14:17:10 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
headroom/benchmarks
History
chopratejas 3290a3d582 Remove LLMLingua: Kompress is the sole text compressor 
LLMLingua was the original ML text compressor (BERT-based). Kompress
(ModernBERT, trained on 330K structured tool outputs) replaced it with
better compression quality and simpler architecture.

Removed across 35 files:
- Deleted headroom/transforms/llmlingua_compressor.py
- Deleted tests/test_transforms/test_llmlingua_compressor.py
- Deleted tests/test_proxy_llmlingua.py
- Removed all enable_llmlingua config, _get_llmlingua methods,
  LLMLingua fallback paths, LLMLINGUA strategy enum values
- Removed CLI flags, model configs, compression handler references
- Simplified ContentRouter: Kompress is primary and only text compressor
2026-03-26 11:11:00 -07:00
..
scenarios Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
__init__.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
adversarial_ccr_tests.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
agent_cost_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
bench_latency.py Add OSS evaluation suite, universal JSON crush, latency benchmarks 2026-02-23 19:08:54 -08:00
bench_relevance.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
bench_transforms.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
ccr_regression_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
comprehensive_eval.py Add quality retention eval and fix linting for Python 3.12 2026-01-19 21:52:18 -08:00
compression_benchmark.py Remove LLMLingua: Kompress is the sole text compressor 2026-03-26 11:11:00 -07:00
conftest.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
dynamic_detector_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
headroom_adversarial_benchmark.py Enhance /stats endpoint and add comprehensive benchmarks 2026-01-17 22:49:04 -08:00
headroom_worst_case_benchmark.py Enhance /stats endpoint and add comprehensive benchmarks 2026-01-17 22:49:04 -08:00
prefix_cache_benchmark.py Format prefix_cache_benchmark.py for ruff 0.15 compatibility 2026-03-12 22:03:38 -07:00
real_world_agent_benchmark.py Enhance /stats endpoint and add comprehensive benchmarks 2026-01-17 22:49:04 -08:00
run_benchmarks.py Add OSS evaluation suite, universal JSON crush, latency benchmarks 2026-02-23 19:08:54 -08:00