headroom/benchmarks
chopratejas bd2d447c26 Add quality retention eval and fix linting for Python 3.12
- Add quality_retention_eval.py for needle-in-haystack testing to verify
  intelligent compression retains critical information (100% retention achieved)
- Add intelligent_context_integration_test.py for comprehensive pipeline testing
- Add test_progressive_summarizer.py with 36 tests for ProgressiveSummarizer
- Add HeadroomConfig parameter to HeadroomClient for direct config injection
- Update pipeline.py with IntelligentContextManager wiring and logging
- Fix all ruff linting issues and format for Python 3.12 compatibility
- Add comprehensive_eval.py benchmark for multi-scenario evaluation
- Add real_data_demo.py for production-scale volume testing
- Add reasoning agent test examples (groq, debug)
2026-01-19 21:52:18 -08:00
..
scenarios Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
__init__.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
adversarial_ccr_tests.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
agent_cost_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
bench_relevance.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
bench_transforms.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
ccr_regression_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
comprehensive_eval.py Add quality retention eval and fix linting for Python 3.12 2026-01-19 21:52:18 -08:00
compression_benchmark.py Enhance /stats endpoint and add comprehensive benchmarks 2026-01-17 22:49:04 -08:00
conftest.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
dynamic_detector_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
headroom_adversarial_benchmark.py Enhance /stats endpoint and add comprehensive benchmarks 2026-01-17 22:49:04 -08:00
headroom_worst_case_benchmark.py Enhance /stats endpoint and add comprehensive benchmarks 2026-01-17 22:49:04 -08:00
real_world_agent_benchmark.py Enhance /stats endpoint and add comprehensive benchmarks 2026-01-17 22:49:04 -08:00
run_benchmarks.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00