Skip to content

Gemini 3 is not supported via LiteLLM #2109

Closed

Description

@Nifury

Please read this first

  • Have you read the custom model provider docs, including the 'Common issues' section? Model provider docs
  • Have you searched for related issues? Others may have faced similar issues.

Describe the question

Can not use Gemini 3 model (gemini/gemini-3-pro-preview) via LiteLLM when there is a tool call, with or without model_settings=ModelSettings(reasoning=Reasoning(effort="low")).

Debug information

  • Agents SDK version: v0.6.1
  • Python version: 3.13

Repro steps

from agents import Agent, ModelSettings, Runner, function_tool
from agents.extensions.models.litellm_model import LitellmModel
from openai.types.shared import Reasoning


@function_tool
def echo_tool(input: str) -> str:
    return input


model = LitellmModel(
    model="gemini/gemini-3-pro-preview",
    api_key="[API_KEY]",
)
agent = Agent(
    name="Assistant",
    instructions="You are a helpful assistant",
    model=model,
    tools=[echo_tool],
    # model_settings=ModelSettings(reasoning=Reasoning(effort="low")),
)
result = Runner.run_sync(
    agent, "Can you use the echo_tool to echo the message 'Hello, world!'?"
)
print(result.final_output)

It prints

Function call is missing a thought_signature in functionCall parts. This is required for tools to work correctly, and missing thought_signature may lead to degraded model performance. Additional data, function call `default_api:echo_tool` , position 2. please refer to https://ai.google.dev/gemini-api/docs/thought-signatures for more details.

Activity

  1. ihower commented on Nov 20, 2025

    @ihower
    Contributor

    This will need a proper LiteLLM release that supports Gemini 3 Pro first.
    LiteLLM has an early implementation here: BerriAI/litellm#16719 but there is no PyPI release for it yet.

    Once LiteLLM ships a release with this support, I can provide a hotfix PR as soon as possible.

  2. kkwhale7 commented on Nov 24, 2025

    @kkwhale7

    BerriAI/litellm#16780
    I noticed that LiteLLM already appears to support Gemini 3

  3. lawalkeyd commented on Nov 24, 2025

    @lawalkeyd

    Released in 1.80.5

  4. ihower commented on Nov 24, 2025

    @ihower
    Contributor

    @kkwhale7 @lawalkeyd @Nifury Quick update on the progress: I’ve finished the first implementation on my fork branch ihower#2, and it works on my side.

    If you want to try it early, you can install it with:

    uv add "openai-agents@git+ssh://git@github.com/ihower/openai-agents-python.git@add-gemini-reasoning-support-v3"
    

    And please make sure your LiteLLM version is upgraded to 1.80.5.

    I’m now preparing the formal pull request and expect to submit it later this week.

  5. ralliesai commented on Dec 4, 2025

    @ralliesai

    @ihower thanks so much for working on this. Any updates here?

  6. ZILECAO commented on Jan 7, 2026

    @ZILECAO

    goat @ihower , thank you

  7. seratch commented on Jan 7, 2026

    @seratch
    Member

    resolved by #2158

  8. added this to the 0.6.x milestone on Jan 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions