Repository navigation
ci(repo): move the AI review pipeline to gpt-6-sol - #6731
Conversation
gpt-6-sol supersedes gpt-5.6-sol for complex coding and agentic work, at half the token price ($2/$10 per M vs $4/$20) and a 1.05M context window. The model only entered the Codex CLI's model catalog in 0.156.1, so the `codex-version` pin moves with it. The action itself stays pinned to the v1.11 commit, since openai/codex-action#151 and #160 are both still open and `codex-version` is an independent input. `codex exec`'s flag surface is unchanged between 0.150.1 and 0.156.1, so everything the pinned action passes still parses, and 0.156's new background daemon is TUI-only. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
There was a problem hiding this comment.
Superseded by a newer AI review
🤖 AI Review
Both independent reviews completed. The PR consistently changes the Codex model to gpt-6-sol and pins both Codex steps to CLI 0.156.1; the code shows no current mismatch. Claude’s four findings are supported by the checked-out workflow, though they concern maintenance, documentation, and a conditional failure path rather than a demonstrated failure of the new version. Codex reported no findings.
Findings
| Severity | Location | Category | Sources | Claim |
|---|---|---|---|---|
| 🟡 MINOR | .github/workflows/ai-review.yml:311 |
maintainability |
claude | The CLI version is repeated in two Codex steps, so a future update could change one pin without changing the other. |
| 🟡 MINOR | .github/workflows/ai-review.yml:462 |
ci-resilience |
claude | If the shared Codex model or CLI pin fails, adjudication cannot complete and the workflow posts no review or failure comment to the PR. |
| ⚪ NIT | .github/workflows/ai-review.yml:462 |
documentation |
claude | The second CLI version pin has no rationale comment or cross-reference to the first pin. |
| ⚪ NIT | .github/workflows/ai-review.yml:311 |
dependency-management |
claude | The pinned Codex CLI version is manually maintained and has no automated update tracking in this repository. |
Stats
Claude findings: 4 · Codex findings: 0 · Confirmed: 4 · Refuted: 0 · Uncertain: 0
Models: claude-opus-5 + gpt-6-sol · Trigger: auto · Workflow run
This review runs once per PR. A maintainer can request another with a /ai-review comment.
There was a problem hiding this comment.
🤖 AI Review
The model and both CLI pins were updated consistently, with no current workflow mismatch. Claude’s single maintainability finding is confirmed as a nit; Codex reported no findings.
Findings
| Severity | Location | Category | Sources | Claim |
|---|---|---|---|---|
| ⚪ NIT | .github/workflows/ai-review.yml:311 |
maintainability |
claude | The Codex CLI version remains duplicated across the independent-review and adjudication steps, while the new version rationale appears only beside the first pin. A later update could change one step without changing the other. |
Stats
Claude findings: 1 · Codex findings: 0 · Confirmed: 1 · Refuted: 0 · Uncertain: 0
Models: claude-opus-5 + gpt-6-sol · Trigger: manual · Workflow run
This review runs once per PR. A maintainer can request another with a /ai-review comment.
Anchors `codex-version` in codex-review and aliases it from adjudicate, matching how the action pin is already shared, so a future bump can't update one job and miss the other. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
jgoux
left a comment
There was a problem hiding this comment.
Reviewed head 9267ef4. Both Codex jobs resolve to the same model and CLI version. A branch-scoped workflow_dispatch run succeeded with the new model and version; the subsequent change shares the version through a valid YAML alias. No actionable findings.
supabase#6740) ## Summary Moves the AI review pipeline's Claude pass (`claude-review`) from `claude-opus-5` to `claude-opus-5-5`. The Codex side stays on `gpt-6-sol` from supabase#6731. The repo's `ANTHROPIC_API_KEY` doesn't have access to every model (it returned 404 for `claude-fable-5` when the pipeline was first set up), so the key was checked before making this change. A throwaway push-triggered workflow on a now-deleted branch called `GET /v1/models/{id}` with the secret and got HTTP 200 for both `claude-opus-5` and `claude-opus-5-5` ([run 35860464428](https://github.com/supabase/cli/actions/runs/35860464428)). The pinned Claude Code also has to move. The first automatic review on this PR failed in `claude-review` because the API rejects `2.1.247` for this model ("version 2.1.280 or newer is required"), so the pin goes to `2.1.280`. That is npm's current `latest`, published 2026-09-22. The `stable` tag is still on `2.1.267`, which is too old for this model. ## Linked issue No linked issue — maintainer change. ## Checklist - [x] The PR title follows [Conventional Commits](https://www.conventionalcommits.org/) (e.g. `fix(cli): …`). - [ ] Tests added or updated for the change. — n/a, workflow configuration only. - [x] From the repository root, `pnpm check:all` passes; relevant package tests pass for every touched workspace, and `pnpm types:check` passes for each touched TypeScript workspace (or workspace declaring it). 🤖 Generated with [Claude Code](https://claude.com/claude-code) --------- Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Summary
Points the AI review pipeline's Codex side at
gpt-6-sol, which shipped on2026-09-22 and supersedes
gpt-5.6-solfor complex coding and agentic work. Itis also cheaper — $2/$10 per million input/output tokens against 5.6-sol's
$4/$20 — with a 1.05M context window, so both the independent-review and
adjudication passes get more diff headroom per run at lower cost.
The model only entered the Codex CLI's model catalog in 0.156.1 (a hotfix on
0.156.0, released 2026-09-23), so the
codex-versioninput moves with it. Threethings worth stating explicitly, since the pinning here is deliberate:
openai/codex-actionstays on the v1.11commit: Fix action hang when descendants keep stdio open openai/codex-action#151 (descendant process keeps the step alive) and
drop-sudo (default safety-strategy) chmods /run service sockets to 0700, breaking D-Bus and systemd-resolved — GitHub-hosted runners die mid-job at ~55 minutes openai/codex-action#160 (drop-sudo chmods
/runsockets) are both still open,and
codex-versionis an independent input to the action, so the CLI can bebumped without touching the action SHA or the
dependabot.ymlignore entry.codex execflag surface is unchanged between 0.150.1 and 0.156.1.codex-rs/exec/src/cli.rsis identical across the two tags, so everything thepinned action passes —
--skip-git-repo-check,--cd,--output-last-message,--output-schema,--model,--config model_reasoning_effort=…,--sandbox— still parses.--no-daemonand the daemonstartup path live under
codex-rs/tui/andcodex-rs/cli/src/main.rsonly, socodex execwill not spawn one and this cannot reintroduce thelingering-descendant hang class that forced the v1.11 downgrade.
effort: highis unchanged and still valid;gpt-6-soladditionally supportsxhighandmax, which we can revisit separately if review depth turns out tomatter more than runtime.
It is a six-minor jump on the CLI against a release that is hours old, so this
wants a
workflow_dispatchrun against a real PR before it is trusted on theautomatic path.
Linked issue
No linked issue — maintainer change.
Checklist
fix(cli): …).gpt-5.6-solstrings inpost-review.test.tsare fixture inputs to the footer builder, not assertions about the live model (they already pair it withclaude-fable-5), so they are left alone.pnpm check:allpasses; relevant package tests pass for every touched workspace, andpnpm types:checkpasses for each touched TypeScript workspace (or workspace declaring it).🤖 Generated with Claude Code