- Format feature_extractor.py to pass ruff format check
- Skip uvicorn tests when uvicorn not installed in CI environment
- Exclude experiments/ from pre-commit ruff checks
Improve proxy scalability for high-concurrency scenarios with multiple agents:
- Add connection pool configuration (max_connections=500, max_keepalive=100)
- Enable HTTP/2 multiplexing by default for better throughput
- Add multi-worker support via --workers flag for multi-core scaling
- Add --limit-concurrency flag for backpressure control
- Reuse httpx client for CCR continuations instead of creating new clients
- Add httpx[http2] dependency for HTTP/2 support
- Add comprehensive test suite for scalability features
New CLI flags:
--max-connections Max connections to upstream APIs (default: 500)
--max-keepalive Max keepalive connections (default: 100)
--no-http2 Disable HTTP/2 (enabled by default)
--workers Number of worker processes (default: 1)
--limit-concurrency Max concurrent connections before 503 (default: 1000)