Skip to content

feat(verify): attest that every declared capability had a check that ran #626

Description

@ian-flores

Skip classification catches a check that ran and gave up. It cannot catch a capability that had no check at all — which is #602 exactly: test_workbench_login skips under SSO and no other lane verifies a Workbench login, so nothing is even present to classify.

Derive the expected checks from what vip.toml declares. If Connect is configured with SSO, the run must name a check that actually exercised SSO login; if none executed, report the capability as unproven rather than staying silent. This is what turns the report into "31 of your 47 declared capabilities were verified" instead of a pass/fail count over whatever happened to run.

Depends on the unproven outcome from #617, which already supplies the reporting and exit-code machinery.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions