Skip to content

ci(repo): move the AI review pipeline to gpt-6-sol - #6731

Merged
Coly010 merged 2 commits into
developfrom
chore/ai-review-gpt-6-sol
Sep 23, 2026
Merged

Coly010 merged 2 commits into
developfrom
chore/ai-review-gpt-6-sol

Conversation

@Coly010

@Coly010 Coly010 commented Sep 23, 2026

Copy link
Copy Markdown
Contributor

Summary

Points the AI review pipeline's Codex side at gpt-6-sol, which shipped on
2026-09-22 and supersedes gpt-5.6-sol for complex coding and agentic work. It
is also cheaper — $2/$10 per million input/output tokens against 5.6-sol's
$4/$20 — with a 1.05M context window, so both the independent-review and
adjudication passes get more diff headroom per run at lower cost.

The model only entered the Codex CLI's model catalog in 0.156.1 (a hotfix on
0.156.0, released 2026-09-23), so the codex-version input moves with it. Three
things worth stating explicitly, since the pinning here is deliberate:

effort: high is unchanged and still valid; gpt-6-sol additionally supports
xhigh and max, which we can revisit separately if review depth turns out to
matter more than runtime.

It is a six-minor jump on the CLI against a release that is hours old, so this
wants a workflow_dispatch run against a real PR before it is trusted on the
automatic path.

Linked issue

No linked issue — maintainer change.

Checklist

  • The PR title follows Conventional Commits (e.g. fix(cli): …).
  • Tests added or updated for the change. — n/a, workflow configuration only. The gpt-5.6-sol strings in post-review.test.ts are fixture inputs to the footer builder, not assertions about the live model (they already pair it with claude-fable-5), so they are left alone.
  • From the repository root, pnpm check:all passes; relevant package tests pass for every touched workspace, and pnpm types:check passes for each touched TypeScript workspace (or workspace declaring it).

🤖 Generated with Claude Code

gpt-6-sol supersedes gpt-5.6-sol for complex coding and agentic work, at
half the token price ($2/$10 per M vs $4/$20) and a 1.05M context window.

The model only entered the Codex CLI's model catalog in 0.156.1, so the
`codex-version` pin moves with it. The action itself stays pinned to the
v1.11 commit, since openai/codex-action#151 and #160 are both still open
and `codex-version` is an independent input. `codex exec`'s flag surface
is unchanged between 0.150.1 and 0.156.1, so everything the pinned action
passes still parses, and 0.156's new background daemon is TUI-only.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@Coly010
Coly010 requested a review from a team as a code owner September 23, 2026 11:32

@github-actions github-actions Bot left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Superseded by a newer AI review

🤖 AI Review

Both independent reviews completed. The PR consistently changes the Codex model to gpt-6-sol and pins both Codex steps to CLI 0.156.1; the code shows no current mismatch. Claude’s four findings are supported by the checked-out workflow, though they concern maintenance, documentation, and a conditional failure path rather than a demonstrated failure of the new version. Codex reported no findings.

Findings

Severity Location Category Sources Claim
🟡 MINOR .github/workflows/ai-review.yml:311 maintainability claude The CLI version is repeated in two Codex steps, so a future update could change one pin without changing the other.
🟡 MINOR .github/workflows/ai-review.yml:462 ci-resilience claude If the shared Codex model or CLI pin fails, adjudication cannot complete and the workflow posts no review or failure comment to the PR.
⚪ NIT .github/workflows/ai-review.yml:462 documentation claude The second CLI version pin has no rationale comment or cross-reference to the first pin.
⚪ NIT .github/workflows/ai-review.yml:311 dependency-management claude The pinned Codex CLI version is manually maintained and has no automated update tracking in this repository.

Stats

Claude findings: 4 · Codex findings: 0 · Confirmed: 4 · Refuted: 0 · Uncertain: 0


Models: claude-opus-5 + gpt-6-sol · Trigger: auto · Workflow run

This review runs once per PR. A maintainer can request another with a /ai-review comment.

Comment thread .github/workflows/ai-review.yml Resolved
Comment thread .github/workflows/ai-review.yml Resolved
Comment thread .github/workflows/ai-review.yml Resolved
Comment thread .github/workflows/ai-review.yml Resolved

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤖 AI Review

The model and both CLI pins were updated consistently, with no current workflow mismatch. Claude’s single maintainability finding is confirmed as a nit; Codex reported no findings.

Findings

Severity Location Category Sources Claim
⚪ NIT .github/workflows/ai-review.yml:311 maintainability claude The Codex CLI version remains duplicated across the independent-review and adjudication steps, while the new version rationale appears only beside the first pin. A later update could change one step without changing the other.

Stats

Claude findings: 1 · Codex findings: 0 · Confirmed: 1 · Refuted: 0 · Uncertain: 0


Models: claude-opus-5 + gpt-6-sol · Trigger: manual · Workflow run

This review runs once per PR. A maintainer can request another with a /ai-review comment.

Comment thread .github/workflows/ai-review.yml Resolved
Anchors `codex-version` in codex-review and aliases it from adjudicate,
matching how the action pin is already shared, so a future bump can't
update one job and miss the other.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@Coly010 Coly010 self-assigned this Sep 23, 2026

@jgoux jgoux left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed head 9267ef4. Both Codex jobs resolve to the same model and CLI version. A branch-scoped workflow_dispatch run succeeded with the new model and version; the subsequent change shares the version through a valid YAML alias. No actionable findings.

@Coly010
Coly010 added this pull request to the merge queue Sep 23, 2026
Merged via the queue into develop with commit 1d1ce4f Sep 23, 2026
30 checks passed
@Coly010
Coly010 deleted the chore/ai-review-gpt-6-sol branch September 23, 2026 12:22
pull Bot pushed a commit to oogalieboogalie/cli that referenced this pull request Sep 23, 2026
supabase#6740)

## Summary

Moves the AI review pipeline's Claude pass (`claude-review`) from
`claude-opus-5`
to `claude-opus-5-5`. The Codex side stays on `gpt-6-sol` from supabase#6731.

The repo's `ANTHROPIC_API_KEY` doesn't have access to every model (it
returned 404
for `claude-fable-5` when the pipeline was first set up), so the key was
checked before making this change. A throwaway push-triggered workflow
on a
now-deleted branch called `GET /v1/models/{id}` with the secret and got
HTTP 200
for both `claude-opus-5` and `claude-opus-5-5`
([run
35860464428](https://github.com/supabase/cli/actions/runs/35860464428)).

The pinned Claude Code also has to move. The first automatic review on
this PR
failed in `claude-review` because the API rejects `2.1.247` for this
model
("version 2.1.280 or newer is required"), so the pin goes to `2.1.280`.
That is
npm's current `latest`, published 2026-09-22. The `stable` tag is still
on
`2.1.267`, which is too old for this model.

## Linked issue

No linked issue — maintainer change.

## Checklist

- [x] The PR title follows [Conventional
Commits](https://www.conventionalcommits.org/) (e.g. `fix(cli): …`).
- [ ] Tests added or updated for the change. — n/a, workflow
configuration only.
- [x] From the repository root, `pnpm check:all` passes; relevant
package tests pass for every touched workspace, and `pnpm types:check`
passes for each touched TypeScript workspace (or workspace declaring
it).

🤖 Generated with [Claude Code](https://claude.com/claude-code)

---------

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants