akadmin/headroom
1
0
Fork 0
mirror of https://github.com/headroomlabs-ai/headroom.git synced 2026-08-27 14:17:10 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
headroom/tests/test_integrations
History
Exact
chopratejas f78d24d988 test(langchain): seed random per-test to fix flaky first/last anchor eval 
The 12 langchain integration evals generate fixture data via
`random.choice`/`random.randint` without seeding. SmartCrusher's
anchor selection consumes the same global random state, so a handful
of unseeded inputs (~1% of seed values) skip the first/last anchor
preservation and the eval flakes — surfaced on PR #319 CI even though
this PR doesn't touch SmartCrusher.

Confirmed pre-existing: identical 5/500 seed failures on `main`
@ `cf3877d`. The fix is the smallest one that doesn't paper over the
underlying selector behavior — seed `random` per-test via an autouse
fixture so dataset generation is reproducible.
2026-04-29 19:20:34 -07:00
..
agno Add reasoning capability forwarding to HeadroomAgnoModel 2026-01-21 20:32:02 -08:00
langchain test(langchain): seed random per-test to fix flaky first/last anchor eval 2026-04-29 19:20:34 -07:00
mcp fix(integrations): filter CCR-dropped sentinel in test iteration 2026-04-27 20:53:29 -07:00
__init__.py Initial commit: Headroom SDK - LLM context optimization toolkit 2026-01-06 23:16:58 -08:00