Skip to content

Import runner image evidence into CI history offline - #27

Merged
ndizazzo merged 1 commit into
mainfrom
codex/runner-image-metrics
Sep 8, 2026
Merged

Import runner image evidence into CI history offline#27
ndizazzo merged 1 commit into
mainfrom
codex/runner-image-metrics

Conversation

@ndizazzo

@ndizazzo ndizazzo commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

CI history currently has Actions timings and artifact metadata but cannot retain source-bound runner-image measurements. This adds an explicit offline receipt import that matches the exact repository, workflow, run, attempt, family, platform, and role step. It validates identity/cache sidecars, preserves validated enrichment on refresh, and reports producer evidence separately from Actions timing.

The automatic collector still downloads no artifact contents. Unknown measurements remain null; skipped and partial invocations are retained without inventing timing or cache hit rates. Exact new retained-cohort transfer/publication phase labels are included.

Rebased onto merged #26 at 3663402; range-diff confirms the supplemental metrics patch is unchanged. This PR now targets main. Validation: complete local TypeScript suite, 166 passed and one opt-in Docker test skipped; producer golden and real retained 39-layer identity imports; 13 Python/TypeScript parser comparisons; matrix validation and syntax checks. The producer implementation is in Mesh-LLM/mesh-llm-runner-images on codex/runner-image-improvements.

Hosted CI is green at a99dc1e: run 34188260088. The 32 focused receipt tests also passed locally. CodeRabbit posted no findings on this PR and was rate-limited after retargeting. Root also downloaded and checked the exact artifact ZIP hashes from runner-images PR #23, then successfully imported all 46 receipts from its successful 23-platform validation run. Real failed/skipped receipts imported, survived raw refresh, and reimported without writes. Producer PR: Mesh-LLM/mesh-llm-runner-images#23.

@coderabbitai

coderabbitai Bot commented Sep 8, 2026

Copy link
Copy Markdown

Warning

Review limit reached

Next included review available in 41 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Advanced

Run ID: 7c990661-5c6d-4849-b073-cf8bff2520f7

📥 Commits

Reviewing files that changed from the base of the PR and between 3663402 and a99dc1e.

⛔ Files ignored due to path filters (1)
  • tests/fixtures/runner-metrics/verification/cache.log is excluded by !**/*.log
📒 Files selected for processing (13)
  • TODO.md
  • docs/ci-metrics.md
  • scripts/ci-metrics-enrichment.ts
  • scripts/ci-metrics-model.ts
  • scripts/ci-metrics-report.ts
  • scripts/ci-metrics.ts
  • scripts/runner-receipt.ts
  • tests/ci-metrics-enrichment.test.ts
  • tests/fixtures/runner-metrics/README.md
  • tests/fixtures/runner-metrics/production/receipt.json
  • tests/fixtures/runner-metrics/verification-skipped/receipt.json
  • tests/fixtures/runner-metrics/verification/identity.json
  • tests/fixtures/runner-metrics/verification/receipt.json

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@ndizazzo
ndizazzo marked this pull request as ready for review September 8, 2026 03:46
Base automatically changed from codex/packaging-runner-efficiency to main September 8, 2026 04:42
@ndizazzo
ndizazzo force-pushed the codex/runner-image-metrics branch from 5a99ee5 to a99dc1e Compare September 8, 2026 04:47
@ndizazzo
ndizazzo merged commit 306f8e0 into main Sep 8, 2026
3 checks passed
@ndizazzo
ndizazzo deleted the codex/runner-image-metrics branch September 8, 2026 04:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant