Skip to content

docs: add docs/riteway-ai.md with temperature/model configuration for OpenCode#432

Draft
Copilot wants to merge 3 commits intomasterfrom
copilot/document-temperature-experiments
Draft

docs: add docs/riteway-ai.md with temperature/model configuration for OpenCode#432
Copilot wants to merge 3 commits intomasterfrom
copilot/document-temperature-experiments

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Apr 4, 2026

  • Create docs/riteway-ai.md with complete Riteway AI documentation
  • Fix temperature description: clarify it shapes the next-token probability distribution, not determinism; note no current LLM guarantees deterministic outputs even at temperature 0

…ncluding temperature/model config

Agent-Logs-Url: https://github.com/paralleldrive/riteway/sessions/ec479bc6-b9af-46a2-be4e-74350664a1d8

Co-authored-by: ericelliott <364727+ericelliott@users.noreply.github.com>
Copilot AI changed the title [WIP] Document temperature experiments using Riteway AI docs: add docs/riteway-ai.md with temperature/model configuration for OpenCode Apr 4, 2026
Copilot AI requested a review from ericelliott April 4, 2026 14:46
@ericelliott
Copy link
Copy Markdown
Collaborator

#431 (comment)

Copy link
Copy Markdown
Collaborator

@ericelliott ericelliott left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See comments.

Comment thread docs/riteway-ai.md Outdated
riteway ai path/to/test.sudo --agent opencode
```

This gives you precise control over both the model and sampling temperature used during evaluations, which is useful for experiments that require deterministic or creative outputs.
Copy link
Copy Markdown
Collaborator

@ericelliott ericelliott Apr 4, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is no such thing as guaranteed determinism in any current major LLM. Temperature controls next token probability distribution shape, not determinism. You could say "more deterministic vs more creative" as a layman proxy, but don't make it sound like there is a determinism guarantee. In fact, we should call it that there isn't.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 43ef6b6. The sentence now explains that temperature shapes the next-token probability distribution, distinguishes lower (less creative/more repetitive) from higher (more creative/less predictable), and explicitly notes that no current LLM guarantees deterministic outputs even at temperature 0.

Copilot AI requested a review from ericelliott April 4, 2026 14:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Document temperature experiments using Riteway ai

2 participants