Skip to content

Run on local Ollama models by default - #142

Closed
dmater01 wants to merge 1 commit into
CopilotKit:mainfrom
dmater01:feat/ollama-models
Closed

dmater01 wants to merge 1 commit into
CopilotKit:mainfrom
dmater01:feat/ollama-models

Conversation

@dmater01

Copy link
Copy Markdown

Default the answer model to beam:cloud and the visualization router to clef-flash:latest, both through Ollama's OpenAI-compatible API, so the app runs without OpenAI or TypeSafe keys. Hosted providers and visitor BYOK keys keep working; the chat asks for keys only when the server's own models are unconfigured (GET /credentials/status).

  • Split Ollama's whole tool calls into name and argument chunks, and emit inner model events once, so AG-UI receives tool arguments.
  • Reorder generateSandboxedUi arguments and default initialHeight so CopilotKit creates the widget before css/html arrive.
  • Patch @ag-ui/client 0.0.52 to default-import fast-json-patch (fixed upstream in 0.0.59); under Node ESM applyPatch was undefined.
  • Allow a local router 60s for its cold model load; hosted Jev keeps 15s.
  • Update README and docs for the new defaults.

Default the answer model to beam:cloud and the visualization router to
clef-flash:latest, both through Ollama's OpenAI-compatible API, so the
app runs without OpenAI or TypeSafe keys. Hosted providers and visitor
BYOK keys keep working; the chat asks for keys only when the server's
own models are unconfigured (GET /credentials/status).

- Split Ollama's whole tool calls into name and argument chunks, and
  emit inner model events once, so AG-UI receives tool arguments.
- Reorder generateSandboxedUi arguments and default initialHeight so
  CopilotKit creates the widget before css/html arrive.
- Patch @ag-ui/client 0.0.52 to default-import fast-json-patch (fixed
  upstream in 0.0.59); under Node ESM applyPatch was undefined.
- Allow a local router 60s for its cold model load; hosted Jev keeps 15s.
- Update README and docs for the new defaults.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@dmater01 dmater01 closed this Oct 17, 2026
@dmater01
dmater01 deleted the feat/ollama-models branch October 17, 2026 21:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant