Repository navigation
feat: refresh model selections and use the google genai sdk for vertex - #153
Merged
Merged
Conversation
Co-Authored-By: Claude <svc-devxp-claude@slack-corp.com>
zimeg
added
the
update
zimeg
commented
Oct 14, 2026
zimeg
left a comment
zimeg
left a comment
Member
Author
There was a problem hiding this comment.
🦠 Comments on specifics for readers and reviewers alike!
| from typing import ClassVar | ||
|
|
||
| import google.api_core.exceptions | ||
| import vertexai.generative_models |
Member
Author
There was a problem hiding this comment.
📰 note: This is the deprecated package we're moving from
The Generative AI module in the Vertex AI SDK is deprecated and will no longer be available after June 24, 2026. The Google Gen AI SDK contains all the capabilities of the Vertex AI SDK, and supports many additional capabilities.
🔗 https://docs.cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk
| if self.enabled: | ||
| vertexai.init( | ||
| self.client = genai.Client( | ||
| enterprise=True, |
Member
Author
There was a problem hiding this comment.
😻 note: This lets us remain compatible with the Vertex API I understand
Comment on lines
+57
to
+59
| return "".join( | ||
| block.text for block in response.content if block.type == "text" | ||
| ) |
Member
Author
There was a problem hiding this comment.
👁️🗨️ note: Here we account for thinking in responses
zimeg
marked this pull request as ready for review
October 14, 2026 00:16
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This pull request refreshes the model selections for each provider and moves the Vertex AI provider to the
google-genaiSDK. Anthropic now lists Claude Haiku 5.5, Opus 5.5, and Sonnet 5.5 (models overview), OpenAI lists GPT-6 Astra, GPT-6 Luna, and GPT-6.1 Sol (models), and Vertex AI lists Gemini 3.5 Flash-Lite, 3.8 Flash, and 4 Argon (models), with retired, preview, and experimental models removed. The deprecatedvertexai.generative_modelsmodule fromgoogle-cloud-aiplatformis replaced withgoogle-genaiusing the sameVERTEX_AI_PROJECT_IDandVERTEX_AI_LOCATIONvariables, and the README now suggests thegloballocation these models are served from. Claude responses now join text blocks since adaptive thinking can return a thinking block before the text.Testing
requirements.txtin a fresh virtual environment and confirmgoogle-cloud-aiplatformis no longer installedANTHROPIC_API_KEYset, select each Claude model in App Home and confirm a reply in a DM and with/ask-boltyOPENAI_API_KEYset, select each GPT model and confirm a replyVERTEX_AI_PROJECT_IDandVERTEX_AI_LOCATION=globalset alongside Application Default Credentials, select each Gemini model and confirm a replyrufflinting and formatting, so maintainers should smoke-test each provider with real keys before merging🤖 Generated with Claude Code