Skip to content

fix(llm): double max_tokens on finish_reason=length before retrying JSON - #2321

Open
smoryan wants to merge 2 commits into
MemTensor:mainfrom
smoryan:fix/llm-length-retry-budget
Open

fix(llm): double max_tokens on finish_reason=length before retrying JSON#2321
smoryan wants to merge 2 commits into
MemTensor:mainfrom
smoryan:fix/llm-length-retry-budget

Commits

Commits on Sep 2, 2026