akadmin/headroom
1
0
Fork 0
mirror of https://github.com/headroomlabs-ai/headroom.git synced 2026-08-27 14:17:10 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
headroom/benchmarks
History
chopratejas 77248cd1a3 Enhance /stats endpoint and add comprehensive benchmarks 
- Add detailed breakdowns by provider and model to /stats
- Include compression, telemetry, and feedback loop statistics
- Add latency.average_ms metric
- Add real-world agent benchmark with MCP tool patterns
- Add worst-case and adversarial benchmarks for edge cases
- Bump version to 0.2.12
2026-01-17 22:49:04 -08:00
..
scenarios Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
__init__.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
adversarial_ccr_tests.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
agent_cost_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
bench_relevance.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
bench_transforms.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
ccr_regression_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
compression_benchmark.py Enhance /stats endpoint and add comprehensive benchmarks 2026-01-17 22:49:04 -08:00
conftest.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
dynamic_detector_benchmark.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00
headroom_adversarial_benchmark.py Enhance /stats endpoint and add comprehensive benchmarks 2026-01-17 22:49:04 -08:00
headroom_worst_case_benchmark.py Enhance /stats endpoint and add comprehensive benchmarks 2026-01-17 22:49:04 -08:00
real_world_agent_benchmark.py Enhance /stats endpoint and add comprehensive benchmarks 2026-01-17 22:49:04 -08:00
run_benchmarks.py Fix all ruff lint and format errors for CI 2026-01-10 15:33:44 -08:00