tinymux/tests/comsys_conformance
Stephen Dennis 297e8f42f8 test(smoke): absent features skip instead of failing — Windows is green (#1641)
Fixes #1641, and with it the last non-JIT red on Windows.  Three separate
defects stood between this platform and a green run; the issue only knew
about the first.

1. Five cases failed on builds without OpenSSL or reality levels.
   hmac_fn TC001-003 gain a tr.has_ssl probe (same shape as tr.has_jit),
   keyed on the one specific refusal -- #-1 HMAC REQUIRES SSL -- so a build
   WITH OpenSSL that returns a wrong hash or a different error still fails.
   digest_fn TC005 skips only when the sha-1 EVP alias is refused while the
   built-in sha1 name still hashes correctly; emitconn_fn TC004 skips only
   when listrlevels() comes back as literal text, i.e. the function is not
   registered at all.  Every skip is conditional on the feature being
   absent, never on the assertion failing.

2. One case reported no verdict at all, which VERDICT LOSS (#1396) counted
   and INCOMPLETE turned red -- so fixing the five failures alone left the
   run exactly as red as before.  digest_fn TC004's md5-absent branch
   logged "MD5 is not supported in this version. Okay.", and "Okay" is not
   a verdict word: the case dispatched, ran, and was counted neither as
   passed nor failed.  The corpus holds 32 branches of that exact shape
   across 11 files -- all latent verdict losses on whichever build first
   loses the feature they probe -- swept with the minimal edit: the token
   "Okay." becomes "Skipped.", keeping every explanatory sentence intact.
   The vacuous-case guard still counts 1562 cases, all able to fail.

3. tests/comsys_conformance failed on Windows with a delta that was
   line-for-line identical on screen: core.autocrlf=true checks the
   baseline out with CRLF while the harness generates LF, so the byte
   comparison failed on every line.  .gitattributes now pins the baseline
   to LF, and run.sh compares CR-blind so clones that predate the pin keep
   working.

Verified on Windows Server 2022, MSVC 14.51, Release x64, all for the
first time on this platform:

  smoke (compiled route):     ALL 1555 TESTS PASSED
  smoke (jit_eval_brackets 0): ALL 1555 TESTS PASSED
  smoke (built-in comsys/mail): ALL 1555 TESTS PASSED
  comsys handoff 13/13, mogrify 5/5, conformance PASSED (19 known lines),
  cmdparity 3/3, vacuous guard 1562/1562.

On Linux nothing changes shape: OpenSSL and reality levels are present, so
every probe takes the normal path and the cases assert exactly what they
asserted before.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-28 20:48:16 -06:00
..
known-divergences.diff fix(nls): split the folder summary so each count can be pluralised (#1717) 2026-07-28 16:09:40 -06:00
run.sh test(smoke): absent features skip instead of failing — Windows is green (#1641) 2026-07-28 20:48:16 -06:00