Commit graph

2 commits

Author SHA1 Message Date
chopratejas
a187d80d7c fix: resolve CI failures
- Format feature_extractor.py to pass ruff format check
- Skip uvicorn tests when uvicorn not installed in CI environment
- Exclude experiments/ from pre-commit ruff checks
2026-01-27 16:17:24 -08:00
chopratejas
7c6d713ae0 feat(proxy): add connection pooling, HTTP/2, and multi-worker support
Improve proxy scalability for high-concurrency scenarios with multiple agents:

- Add connection pool configuration (max_connections=500, max_keepalive=100)
- Enable HTTP/2 multiplexing by default for better throughput
- Add multi-worker support via --workers flag for multi-core scaling
- Add --limit-concurrency flag for backpressure control
- Reuse httpx client for CCR continuations instead of creating new clients
- Add httpx[http2] dependency for HTTP/2 support
- Add comprehensive test suite for scalability features

New CLI flags:
  --max-connections    Max connections to upstream APIs (default: 500)
  --max-keepalive      Max keepalive connections (default: 100)
  --no-http2           Disable HTTP/2 (enabled by default)
  --workers            Number of worker processes (default: 1)
  --limit-concurrency  Max concurrent connections before 503 (default: 1000)
2026-01-27 16:08:36 -08:00