Skip to content

ci(gemini): pin model to gemini-2.5-flash for routine review duty#81

Closed
heskew wants to merge 1 commit into
mainfrom
ci/gemini-model-flash
Closed

ci(gemini): pin model to gemini-2.5-flash for routine review duty#81
heskew wants to merge 1 commit into
mainfrom
ci/gemini-model-flash

Conversation

@heskew
Copy link
Copy Markdown
Member

@heskew heskew commented May 12, 2026

Summary

The Gemini reusable defaults to gemini-2.5-pro (flagship tier) which is a tier mismatch for routine PR review. Claude's reviewer uses Sonnet 4.6 (mid-tier); the apples-to-apples Gemini peer is Flash, not Pro.

This also resolves the quota failure observed on PR #80's first run — gemini-2.5-pro has no free-tier allocation on the project behind this repo's GEMINI_API_KEY (HTTP 429 with limit: 0, model: gemini-2.5-pro). gemini-2.5-flash typically has free-tier capacity.

Once the reusable's default flips to Flash this override becomes redundant; we can drop it then.

Why Flash, not Pro

Claude tier Gemini tier Used for
Haiku Flash-Lite Small/cheap
Sonnet Flash Routine review
Opus Pro Deep / thorough

Pro should be reserved for thorough review modes (mirroring how Opus is reserved on the Claude side via the deep-review flow), not routine per-PR work.

Test plan

  • Merge
  • Push something on the open release PR (release: 2.0.0-alpha.2 #80) to retrigger the reviewers
  • Confirm Gemini run succeeds and posts a marker'd comment

🤖 Generated with Claude Code

The Gemini reusable defaults to `gemini-2.5-pro`, which is Gemini's
flagship tier and the wrong cost/quality match for routine PR
review. Claude's reviewer uses Sonnet 4.6 (mid-tier); the
apples-to-apples Gemini peer is Flash, not Pro.

This also resolves the quota failure on the first dual-reviewer
run — `gemini-2.5-pro` has no free-tier allocation on the project
behind this repo's `GEMINI_API_KEY` (HTTP 429 with
`limit: 0, model: gemini-2.5-pro`), while `gemini-2.5-flash`
typically has free-tier capacity.

When the reusable's default flips to Flash this override becomes
redundant.
@claude
Copy link
Copy Markdown

claude Bot commented May 12, 2026

Reviewed; no blockers found.

@heskew
Copy link
Copy Markdown
Member Author

heskew commented May 12, 2026

Superseded by the new default in ai-review-prompts@d9274252 (post-#23). The reusable's model default is now gemini-3-flash-preview — the current-gen mid-tier peer to Claude Sonnet 4.6. Pinning oauth to override to gemini-2.5-flash would be a step backwards from what the upcoming pin bump delivers by default.

Closing in favor of a single pin-bump PR that lands both claude-review.yml and gemini-review.yml on d9274252 and inherits the new default.

@heskew heskew closed this May 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant