Skip to content

[Feature Request] local network LLM connection #53

Open

Description

@SeveranExp

Please add option to point stack Chan to a locally running model, e.g.: ollama, or other cloud models (OpenAI, Gemini, etc) as per the decision of the user.

Activity

  1. Nodeswitch commented on May 12, 2026

    @Nodeswitch

    I second this. Having the ability to use locally hosted models, exposing a compatible API to StackChan would be a great feature.

  2. thezolon commented on May 14, 2026

    @thezolon

    This is actually something that was promised during the kickstarter.

  3. SeveranExp commented on May 14, 2026

    @SeveranExp
    Author

    This is actually something that was promised during the kickstarter.

    Not doubting you, but to have it as supporting information, can you share the link? I haven’t found it.

  4. SeveranExp commented on Oct 31, 2026

    @SeveranExp
    Author

    @Forairaaaaa sorry to bug you on this one, but it matters for my intended use case of stack-chan.

  5. Forairaaaaa commented on Nov 4, 2026

    @Forairaaaaa
    Contributor

    Hi, the current official firmware uses Xiaozhi for the voice conversation pipeline. Supporting Ollama or other model APIs directly would require changes to how speech recognition, model requests, and speech synthesis are handled.

    For an alternative approach, you may want to look at the community project AI_StackChan_Ex . Its custom endpoint guide documents connecting to Ollama, llama.cpp, and LM Studio through an OpenAI-compatible API. Speech recognition and synthesis are configured separately.

    This replaces the official firmware, but it may be a useful starting point for your setup.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions