Skip to content

oracle: the nine llm cells the mock answers are recorded as <old id>@fixture; golden/1.5.5 retires their bare-id SKIP rows (conformance-gaps D (a)); pin busbar-release #372 - #999

Merged
MattJackson merged 4 commits into
predevfrom
lane-gaps-oracle-pin
Oct 15, 2026

Conversation

@MattJackson

@MattJackson MattJackson commented Oct 14, 2026 •

Copy link
Copy Markdown
Collaborator

DRAFT. Owner rule 22 (named conformance gaps = 0); coordinator ruling 2026-10-14, conformance-gaps D, option (a). Stacked on #926 (rule 19), and it also waits on #861 and #893: the generator at the new pin emits their 7 cells too, so cells --check needs them.

Why the ids change. busbar's golden/1.5.5/ledger.tsv held each of the nine ids as a needs_fixture SKIP row, which is a recorded fact:

  • golden::add never fills such a row. oracle-rerecord run 38521235302 added 0 cells.
  • golden::guard refuses a changed input for such an id.

busbar-release #372 therefore emits the recordable cells as NEW ids <old id>@fixture. This follows the @hooks-webrequest and @1.5-line precedents.

This branch

  • cells.json: the nine definitions as oidf rig: FAPI 2.0 subject, provisioned PS256 clients, IdP stub, plan overrides (depends on #153) #369 wrote them, under the @fixture ids (2566 cells).
    • stream_upstream_error x6: fresh.
    • ok_citation and ok_cachepoint_document: no needs_fixture.
    • ok_tool_use_tokens: mock_control tool-use-tokens.
  • golden/1.5.5: the nine bare-id SKIP rows leave ledger.tsv, each through a cited, add-only retired.tsv row that names its replacement. They carried no bytes and no PASS, so meta recorded stays 1066. No other golden file changes.
  • owed-baseline.txt owes the nine @fixture ids.
  • accepted-gaps.json drops stream-upstream-error, gemini-tool-use-token-term, bedrock-cachepoint-before-document and responses-url-citation.
  • testing/llm-conformance/named-gaps.json strikes its three accepted entries, and expected goes from 16 to 0.
  • accepted-differences.json S-15 and S-16: the cells regexes rename the ids only. Counts, classes, premises and signoffs are unchanged.

Pin and goldens (done).

Money. The one ledger x rate card divergence is ok_tool_use_tokens@fixture: 1.5.5 billed 250 cents, and the right figure is 290. It is registered in the separate $ draft #1023, stacked on this PR. The other eight equal ledger x rate card.

…e mock answers are recorded and owed; their accepted-gaps and named-gaps entries are struck (owner rule 22)

cells.json takes #369's nine edits (stream_upstream_error x6 needs_fixture -> fresh; ok_citation and
ok_cachepoint_document drop needs_fixture; ok_tool_use_tokens drops it and gains mock_control
tool-use-tokens), byte-equal to the generator at the new pin. owed-baseline.txt owes the nine.
accepted-gaps.json drops stream-upstream-error, gemini-tool-use-token-term,
bedrock-cachepoint-before-document and responses-url-citation. llm-conformance named-gaps.json
strikes its three `accepted` entries (16 rows) and `expected` goes 16 -> 0.

oracle-rust.pin: 3365ddbc591e -> 99470fba7c96 (busbar-release main after #370/#371). Digests are
dev-bin's busbar-oracle-linux-{x86_64,aarch64}-99470fba7c96.sha256; each asset's .sig verifies
(Ed25519 over "<asset>\n<sha256>\n") against .github/release-key.pub.pem.
…re`; golden/1.5.5 retires the nine bare-id SKIP rows whole through cited retired.tsv rows (coordinator ruling 2026-10-14, conformance-gaps D, option (a))

The golden ledger held each bare id as a needs_fixture SKIP row, a recorded fact: golden-add never
fills it and golden-guard refuses a changed input for it (oracle-rerecord run 38521235302 added 0).
busbar-release #372 emits the recordable cells as `<old id>@fixture` (builders::FIXTURE_VARIANT),
as the hooks cells moved to `@hooks-webrequest` and ABI-o1 to `@1.5-line`.

- cells.json: the nine ids renamed (definitions as #369 wrote them; 2566 cells, order unchanged).
- golden/1.5.5: the nine SKIP rows leave ledger.tsv with nine cited, add-only retired.tsv rows
  naming each replacement. They carried no bytes and no PASS, so meta recorded stays 1066. No other
  golden file, ledger row or retire row changes.
- owed-baseline.txt owes the nine `@fixture` ids in place of the bare ones.
- accepted-differences.json S-15 and S-16: ID RENAME ONLY in their `cells` regexes; expected_cells,
  classes, premise, signoff and expiry unchanged.
- named-gaps.json / accepted-gaps.json notes name the new ids.

The pin moves to the busbar-release main carrying #372 and the nine goldens are golden-added from
the published 1.5.5 in the following commits.
@MattJackson MattJackson changed the title oracle: pin busbar-release 99470fba7c96 (#369); the nine llm cells the mock answers are owed (BLOCKED: the 1.5.5 golden holds them as SKIP rows) oracle: the nine llm cells the mock answers are recorded as <old id>@fixture; golden/1.5.5 retires their bare-id SKIP rows (conformance-gaps D (a)); pin busbar-release #372 Oct 14, 2026
…372: the nine fixture-backed llm cells as <old id>@fixture)

Digests are dev-bin's busbar-oracle-linux-{x86_64,aarch64}-4c47cad0385d .sha256 assets; each asset's
.sig (and the macos-aarch64 one) verifies, Ed25519 over "<asset>\n<sha256>\n", against
.github/release-key.pub.pem. cells --check with that engine: the nine @fixture cells are byte-equal to
the generator; the only drift is the 7 cells #861 and #893 add.
…he published 1.5.5 (add-only; conformance-gaps D)

From busbar-release oracle-rerecord run https://github.com/GetBusbar/busbar-release/actions/runs/38549469444
(engine 4c47cad0385d, busbar ref lane-gaps-oracle-pin): golden-check reproduced every committed cell,
golden-add added 9 new cells, 0 changed, 0 removed. ledger.tsv +9/-0, meta recorded 1066 -> 1075,
retired.tsv unchanged; files copied from the artifact unchanged.

What 1.5.5 recorded: stream_upstream_error@fixture x6 answer 200 with the relayed partial stream and
bill nothing (usage requests 1, no tokens, no spend); ok_cachepoint_document@fixture and
ok_citation@fixture bill 11 in / 7 out = 250 cents; ok_tool_use_tokens@fixture bills 11 in / 7 out =
250 cents, dropping usageMetadata.toolUsePromptTokenCount 4 (ledger x rate card is 15 in / 7 out =
290 cents: the separate $ draft registers that difference).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant