Skip to content

test: add chassis shootout runner contract - #104

Merged
oigorbrito merged 4 commits into
mainfrom
test/chassis-shootout-g1
Oct 7, 2026
Merged

oigorbrito merged 4 commits into
mainfrom
test/chassis-shootout-g1

Conversation

@oigorbrito

Copy link
Copy Markdown
Owner

Closes the implementation portion of #99.

Adds a dependency-free comparative runner contract and hosted Actions validation for the Nano-vs-Agentless shootout.

Key invariants:

  • candidate process exit is observation, not task success;
  • verifier is independent and owns PASS/FAIL;
  • infrastructure failures remain UNKNOWN;
  • shell interpretation and silent fallback are disabled;
  • deterministic fixture lanes for nano/agentless validate identical plumbing;
  • a deliberate broken control must fail closed while preserving evidence artifacts.

This PR does not execute either upstream candidate and does not claim real-model comparability. Hosted execution is required before #99 can close.

@oigorbrito
oigorbrito merged commit 5c4d8d7 into main Oct 7, 2026
3 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant