From 120c0cc2fbf6e99465ba56317ef8d7152dc0166c Mon Sep 17 00:00:00 2001 From: knowhy <194148385+knowhycodata@users.noreply.github.com> Date: Wed, 4 Nov 2026 12:08:09 +0000 Subject: [PATCH] docs: document LLMTR OpenAI-compatible gateway setup --- docs/local-openai-compatible-providers.md | 21 +++++++++++++++++++++ 1 file changed, 21 insertions(+) diff --git a/docs/local-openai-compatible-providers.md b/docs/local-openai-compatible-providers.md index 15794236bd..e421f40fae 100644 --- a/docs/local-openai-compatible-providers.md +++ b/docs/local-openai-compatible-providers.md @@ -149,6 +149,27 @@ curl -sS "$OPENAI_BASE_URL/models" \ For local configuration, see your gateway's documentation for the correct base URL, API key format, and available model IDs. The same OPENAI_BASE_URL + OPENAI_API_KEY pattern applies to any OpenAI-compatible remote gateway. +## LLMTR + +[LLMTR](https://llmtr.com) is an OpenAI-compatible gateway. Use the same client: set `OPENAI_BASE_URL` to `https://llmtr.com/v1` and `OPENAI_API_KEY` to a bearer key (`llmtr-...`). + +```bash +export OPENAI_BASE_URL="https://llmtr.com/v1" +export OPENAI_API_KEY="llmtr-..." +claw --model "local/llmtr/qwen3-8-27b" prompt "Reply exactly HELLO_WORLD_123" +``` + +Send the catalog id unchanged. `llmtr/qwen3-8-27b` already starts with the gateway name, so that prefix stays on the wire. The `local/` hatch only selects the OpenAI-compatible transport and is removed before the request. A bare `qwen/` or `qwen-` name is a DashScope route and will not reach LLMTR, so vendor-prefixed ids need the same hatch: `local//`. + +Claw asks for up to 64,000 output tokens on these routes. LLMTR rejects a request whose `max_tokens` is above the model's output limit, so pick a model that allows at least that much. `llmtr/qwen3-8-27b` allows 262,144. Each model's limit is listed as `top_provider.max_completion_tokens` in the catalog below. + +The public model list does not need a key: + +```bash +curl -sS "https://llmtr.com/v1/models" \ + | jq -r '.data[] | "\(.id)\t\(.top_provider.max_completion_tokens)"' +``` + ## Local skills install from disk Skills are discovered from Claw skill roots such as `.claw/skills/` in a workspace and `~/.claw/skills/` for user-level installs. Legacy `.codex/skills/` roots may also be scanned for compatibility, but new local Claw projects should prefer `.claw/skills/`.