headroom/tests/test_copilot_subscription_smoke.py
Joel Belanger 0b4a4bd483
fix: support Copilot Business subscription auth (#641)
## Description

Adds a first-party `headroom copilot-auth login` flow for Copilot
subscription
mode and uses the resulting Copilot OAuth token to perform GitHub's
Copilot
token exchange before launching the wrapped Copilot CLI.

This fixes Business/Enterprise Cloud accounts where a generic
GitHub/Copilot
token can read Copilot account metadata but is rejected by the Copilot
token
exchange endpoint. It also avoids treating GitHub.com Enterprise Cloud
account
URLs such as `github.com/enterprises/acme` as API hostnames.

Fixes #635
Related: #488, #610
Builds on #576

## Type of Change

- [x] Bug fix (non-breaking change that fixes an issue)
- [x] New feature (non-breaking change that adds functionality)
- [x] Documentation update
- [ ] Breaking change (fix or feature that would cause existing
functionality to change)
- [ ] Performance improvement
- [ ] Code refactoring (no functional changes)

## Changes Made

- Adds `headroom copilot-auth login` and `headroom copilot-auth status`.
- Stores a Headroom-specific Copilot OAuth token under Headroom's state
dir.
- Exchanges reusable Copilot OAuth tokens with Copilot Chat-compatible
headers before subscription-mode launch.
- Carries the resolved Copilot API endpoint into `headroom wrap copilot
--subscription`.
- Handles GitHub.com Enterprise Cloud URLs without synthesizing invalid
`api.github.com/enterprises/...` hosts.
- Adds focused unit tests and README guidance for subscription login.

## Testing

- [x] Unit tests pass (`pytest`)
- [x] Linting passes (`ruff check .`)
- [ ] Type checking passes (`mypy headroom`)
- [x] New tests added for new functionality
- [x] Manual testing performed

### Test Output

```console
ruff check headroom/copilot_auth.py headroom/cli/copilot_auth.py headroom/cli/main.py headroom/cli/__init__.py headroom/cli/wrap.py tests/test_copilot_auth.py tests/test_cli/test_copilot_auth.py tests/test_cli/test_wrap_copilot.py tests/test_copilot_subscription_smoke.py
# All checks passed!

ruff format --check headroom/copilot_auth.py headroom/cli/copilot_auth.py headroom/cli/main.py headroom/cli/__init__.py headroom/cli/wrap.py tests/test_copilot_auth.py tests/test_cli/test_copilot_auth.py tests/test_cli/test_wrap_copilot.py tests/test_copilot_subscription_smoke.py
# 9 files already formatted

python -m py_compile headroom/copilot_auth.py headroom/cli/copilot_auth.py headroom/cli/main.py headroom/cli/__init__.py headroom/cli/wrap.py tests/test_copilot_auth.py tests/test_cli/test_copilot_auth.py tests/test_cli/test_wrap_copilot.py tests/test_copilot_subscription_smoke.py

uv run --no-project --with pytest --with pytest-asyncio --with click --with rich --with opentelemetry-api --with pydantic --with tiktoken --with 'litellm==1.82.3' --with fastapi --with uvicorn --with 'httpx[http2]' --with openai --with mcp --with magika --with zstandard --with websockets --with onnxruntime --with transformers --with watchdog --with sqlite-vec pytest tests/test_copilot_auth.py tests/test_cli/test_copilot_auth.py tests/test_cli/test_wrap_copilot.py tests/test_cli_proxy_env.py tests/test_copilot_subscription_smoke.py
# 127 passed
```

Local note: `uv run pytest ...` against the project currently fails
before
running tests because `uv.lock` has an unrelated `gitpython`
wheel/version
mismatch.

## Manual Validation

I tested this with an existing GitHub Copilot Business subscription
associated with a GitHub.com Enterprise Cloud account.

The Enterprise Cloud value I tested was in the form:

```text
github.com/enterprises/<enterprise>
```

The tested flow was:

```text
headroom copilot-auth login
headroom wrap copilot --subscription -- --model gpt-5.4
```

This validated that Headroom does not treat
github.com/enterprises/<enterprise> as a Copilot API hostname. Instead,
token exchange uses GitHub.com and Headroom routes subscription-mode
traffic to the Copilot API endpoint returned by GitHub for the signed-in
account.

I did not test this with GitHub Enterprise Server or a custom enterprise
domain such as ghe.example.com.

No tokens, request IDs, or organization-specific identifiers are
included in this PR.

## Real Behavior Proof

- Environment: macOS Darwin, Python 3.12.7, local checkout on
`codex/copilot-business-auth`.
- Exact command / steps: Ran `headroom copilot-auth login`, then
launched `headroom wrap copilot --subscription -- --model gpt-5.4` with
a GitHub Copilot Business subscription tied to a GitHub.com Enterprise
Cloud account.
- Observed result: Headroom did not treat
`github.com/enterprises/<enterprise>` as a Copilot API hostname; token
exchange used GitHub.com and subscription traffic was routed to the
Copilot API endpoint returned for the signed-in account. The latest
focused Copilot auth/proxy tests pass locally (`127 passed`).
- Not tested: GitHub Enterprise Server or custom enterprise domains such
as `ghe.example.com`; Windows Credential Manager integration still needs
confirmation from someone on Windows.

## Review Readiness

- [x] I have performed a self-review
- [x] This PR is ready for human review

## Checklist

- [x] My code follows the project's style guidelines
- [x] I have performed a self-review of my code
- [x] I have commented my code, particularly in hard-to-understand areas
- [x] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [x] I have added tests that prove my fix is effective or that my
feature works
- [x] New and existing targeted unit tests pass locally with my changes
- [ ] I have updated the CHANGELOG.md if applicable

## Screenshots (if applicable)

N/A

## Additional Notes

Acknowledgement: the OAuth/token-exchange behavior was informed by
`anomalyco/opencode-copilot-auth` by Aiden Cline.

No tokens are printed by the new login/status commands; only a short
SHA-256
fingerprint is displayed for troubleshooting.

The interactive login is included because the missing piece is not just
an
Enterprise URL or routing hint. For GitHub.com Enterprise Cloud
accounts,
URLs like `github.com/enterprises/acme` identify the enterprise account
but
are not Copilot API hostnames; token exchange still happens through
GitHub.com
and then returns the account-specific Copilot API endpoint. A
command-line
enterprise argument can help for true GitHub Enterprise
Server/custom-domain
deployments, but it cannot produce the Copilot OAuth token class that
the
token-exchange endpoint accepts.

Ideally, Headroom would avoid an extra interactive login and reuse an
existing
GitHub/Copilot CLI session everywhere. In practice, some
reusable-looking
tokens can read Copilot account metadata but are rejected by Copilot
token
exchange, which leaves Business/Enterprise Cloud users with missing
model
catalogs. The explicit login command is the smallest independent way to
obtain
and persist the token needed for that exchange without asking users to
pass a
secret on the command line.

---------

Co-authored-by: jbelanger <your-username@users.noreply.github.com>
2026-06-12 20:46:38 -05:00

228 lines
10 KiB
Python

"""Cross-platform smoke test for GitHub Copilot subscription routing.
The subscription flow has to behave identically on macOS, Linux, and Windows
(and in headless Docker/CI), but the only OS-specific part — reading the
Copilot CLI token from the platform secret store — is impossible to exercise
portably. This suite proves the *portable* contract instead:
1. With an explicit Copilot API token in the environment, resolution + API-URL
discovery succeed on every platform without touching any secret store. This
is the deterministic escape hatch (``GITHUB_COPILOT_API_TOKEN``) for
headless CI. OAuth tokens still need successful token exchange before
subscription mode can use them.
2. Each OS-specific secret reader is inert on a foreign platform — so on any
given OS only that OS's reader can fire, and a missing/foreign secret store
degrades to ``None`` rather than crashing.
3. The proxy injects exactly the token the wrapper validated (the
deterministic-handoff fix), never a different discoverable one.
4. The full wrapper→proxy chain carries one consistent token end to end.
Everything here is hermetic: no Keychain, no ``secret-tool``, no Credential
Manager, no network. It runs the same on every OS.
"""
from __future__ import annotations
import asyncio
import pytest
from headroom import copilot_auth, copilot_linux_secret, copilot_macos_keychain
BUSINESS_API = "https://api.business.githubcopilot.com"
def _stub_all_secret_stores(monkeypatch: pytest.MonkeyPatch) -> None:
"""Simulate 'no OS secret store / not logged in' on every platform."""
monkeypatch.setattr(copilot_auth, "read_headroom_copilot_oauth_token", lambda: None)
monkeypatch.setattr(copilot_auth, "_read_windows_copilot_cli_oauth_token", lambda: None)
monkeypatch.setattr(copilot_auth, "_read_macos_keychain_oauth_token", lambda: None)
monkeypatch.setattr(copilot_auth, "_read_linux_secret_oauth_token", lambda: None)
monkeypatch.setattr(copilot_auth, "_read_file_oauth_token_candidates", lambda: [])
monkeypatch.setattr(copilot_auth, "_read_gh_cli_oauth_token", lambda: None)
def _clear_token_env(monkeypatch: pytest.MonkeyPatch) -> None:
for var in (
*copilot_auth._COPILOT_OAUTH_TOKEN_ENV_VARS,
*copilot_auth._GENERIC_GITHUB_TOKEN_ENV_VARS,
*copilot_auth._API_TOKEN_ENV_VARS,
):
monkeypatch.delenv(var, raising=False)
# ---------------------------------------------------------------------------
# 1. The explicit API-token env path resolves on any platform with no secret store.
# ---------------------------------------------------------------------------
def test_api_token_env_resolves_subscription_without_secret_store(
monkeypatch: pytest.MonkeyPatch,
) -> None:
_stub_all_secret_stores(monkeypatch)
_clear_token_env(monkeypatch)
monkeypatch.setenv("GITHUB_COPILOT_API_TOKEN", "tid_env_universal")
monkeypatch.setattr(
copilot_auth, "_subscription_resolution_from_token_exchange", lambda _: None
)
monkeypatch.setattr(
copilot_auth,
"_fetch_copilot_user_info",
lambda token: (
{"endpoints": {"api": BUSINESS_API}} if token == "tid_env_universal" else None
),
)
assert copilot_auth.resolve_subscription_bearer_token() == "tid_env_universal"
# Routing is override -> generic; the account host advertised by user-info is
# NOT used (it regressed newer models on the responses API, #610). With no
# GITHUB_COPILOT_API_URL pin set, the generic public host is returned.
monkeypatch.delenv("GITHUB_COPILOT_API_URL", raising=False)
assert copilot_auth.resolve_copilot_api_url("tid_env_universal") == copilot_auth.DEFAULT_API_URL
def test_api_url_falls_back_to_default_when_user_info_unavailable(
monkeypatch: pytest.MonkeyPatch,
) -> None:
_clear_token_env(monkeypatch)
monkeypatch.delenv("GITHUB_COPILOT_API_URL", raising=False)
monkeypatch.setattr(copilot_auth, "_fetch_copilot_user_info", lambda token: None)
# No network / no endpoints advertised → safe default, never a crash.
assert copilot_auth.resolve_copilot_api_url("gho-anything") == copilot_auth.DEFAULT_API_URL
def test_subscription_rejects_generic_token_and_accepts_api_token(
monkeypatch: pytest.MonkeyPatch,
) -> None:
_stub_all_secret_stores(monkeypatch)
_clear_token_env(monkeypatch)
monkeypatch.setattr(
copilot_auth, "_subscription_resolution_from_token_exchange", lambda _: None
)
# A generic GitHub token is present but cannot be exchanged for a Copilot
# API token; a valid Copilot API token is discoverable behind it.
monkeypatch.setattr(
copilot_auth,
"iter_oauth_token_candidates",
lambda: [
copilot_auth.CopilotTokenCandidate(
token="ghp-generic-pat", source="env:GITHUB_TOKEN", confidence="generic-github"
),
copilot_auth.CopilotTokenCandidate(
token="tid_real_copilot",
source="macos-keychain:copilot-cli",
confidence="high",
),
],
)
monkeypatch.setattr(
copilot_auth,
"_fetch_copilot_user_info",
lambda token: {"endpoints": {"api": BUSINESS_API}} if token == "tid_real_copilot" else None,
)
assert copilot_auth.resolve_subscription_bearer_token() == "tid_real_copilot"
# ---------------------------------------------------------------------------
# 2. Each OS reader is inert on a foreign platform.
# ---------------------------------------------------------------------------
@pytest.mark.parametrize("foreign_platform", ["linux", "win32"])
def test_macos_reader_noop_off_darwin(
monkeypatch: pytest.MonkeyPatch, foreign_platform: str
) -> None:
monkeypatch.setattr(copilot_macos_keychain.sys, "platform", foreign_platform)
assert copilot_macos_keychain.read_copilot_oauth_token(host="github.com") is None
@pytest.mark.parametrize("foreign_platform", ["darwin", "win32"])
def test_linux_reader_noop_off_linux(
monkeypatch: pytest.MonkeyPatch, foreign_platform: str
) -> None:
monkeypatch.setattr(copilot_linux_secret.sys, "platform", foreign_platform)
assert copilot_linux_secret.read_copilot_oauth_token(host="github.com") is None
def test_windows_reader_noop_off_windows(monkeypatch: pytest.MonkeyPatch) -> None:
monkeypatch.setattr(copilot_auth.os, "name", "posix")
assert copilot_auth._read_windows_copilot_cli_oauth_token() is None
# ---------------------------------------------------------------------------
# 3. The proxy injects exactly the wrapper-validated token (determinism).
# ---------------------------------------------------------------------------
def test_proxy_injects_explicit_token_over_discovered_one(
monkeypatch: pytest.MonkeyPatch,
) -> None:
# Reset the cached module-level provider so this test is self-contained.
monkeypatch.setattr(copilot_auth, "_provider", None)
# What `wrap copilot --subscription` exports for the proxy:
monkeypatch.setenv("GITHUB_COPILOT_API_TOKEN", "gho-validated")
monkeypatch.setenv("GITHUB_COPILOT_API_URL", BUSINESS_API)
monkeypatch.setenv("GITHUB_COPILOT_USE_TOKEN_EXCHANGE", "false")
# A *different* token is discoverable — it must be ignored entirely.
monkeypatch.setattr(
copilot_auth, "read_cached_oauth_token", lambda: "gho-WRONG-should-not-be-used"
)
headers = asyncio.run(
copilot_auth.apply_copilot_api_auth(
{"authorization": "Bearer placeholder"},
url=f"{BUSINESS_API}/v1/chat/completions",
)
)
assert headers["Authorization"] == "Bearer gho-validated"
assert "authorization" not in headers
# ---------------------------------------------------------------------------
# 4. Full wrapper→proxy chain carries one consistent token to a pinned host.
# ---------------------------------------------------------------------------
def test_end_to_end_subscription_chain(monkeypatch: pytest.MonkeyPatch) -> None:
monkeypatch.setattr(copilot_auth, "_provider", None)
# (a) wrapper side: resolve + validate the subscription token. The API host
# comes from the GITHUB_COPILOT_API_URL pin — the supported way to target
# a dedicated enterprise / data-residency host. user-info is NOT used to
# route (#610), so it advertises a *different* host here to prove it is
# ignored when picking the upstream.
_stub_all_secret_stores(monkeypatch)
_clear_token_env(monkeypatch)
monkeypatch.setenv("GITHUB_COPILOT_TOKEN", "gho-seat-token")
monkeypatch.setenv("GITHUB_COPILOT_API_URL", BUSINESS_API)
monkeypatch.setattr(
copilot_auth,
"_subscription_resolution_from_token_exchange",
lambda _candidate: copilot_auth._subscription_resolution(
token="tid-seat-token",
source="env:GITHUB_COPILOT_TOKEN:token-exchange",
confidence="copilot-token-exchange",
api_url=BUSINESS_API,
),
)
monkeypatch.setattr(
copilot_auth,
"_fetch_copilot_user_info",
lambda token: (
{"endpoints": {"api": "https://api.individual.githubcopilot.com"}}
if token == "gho-seat-token"
else None
),
)
resolved_token = copilot_auth.resolve_subscription_bearer_token()
resolved_url = copilot_auth.resolve_copilot_api_url(resolved_token)
assert resolved_token == "tid-seat-token"
assert resolved_url == BUSINESS_API # the pin wins; the user-info host is ignored
# (b) hand-off: the wrapper exports exactly these for the proxy.
monkeypatch.setenv("GITHUB_COPILOT_API_TOKEN", resolved_token)
# (c) proxy side: build the upstream URL (Copilot has no /v1 prefix) and
# inject the same token onto the outbound request.
upstream = copilot_auth.build_copilot_upstream_url(resolved_url, "/v1/chat/completions")
assert upstream == "https://api.business.githubcopilot.com/chat/completions"
headers = asyncio.run(
copilot_auth.apply_copilot_api_auth({"authorization": "Bearer placeholder"}, url=upstream)
)
assert headers["Authorization"] == f"Bearer {resolved_token}"