Skip to content

Bump llama.cpp to b10665 (ca3d5a3e1) - #88

Merged
nyo16 merged 1 commit into
masterfrom
bump-llama-b10665
Aug 28, 2026
Merged

Bump llama.cpp to b10665 (ca3d5a3e1)#88
nyo16 merged 1 commit into
masterfrom
bump-llama-b10665

Conversation

@nyo16

@nyo16 nyo16 commented Aug 28, 2026

Copy link
Copy Markdown
Owner

Summary

Bumps vendored llama.cpp b10582 (e85caa81e) → b10665 (ca3d5a3e1), 83 builds. Submodule and LLAMA_COMMIT in the Makefile
move together, per docs/release-guide.md.

Binding changes

One real API break: upstream replaced nlohmann::ordered_json with its own pimpl wrapper common_json (common/json.h) across
common/chat.h and common/json-schema-to-grammar.h.

  • json_schema_to_grammar_nif now parses with common_json::parse; the direct <nlohmann/json.hpp> include is gone.
  • nlohmann is still the backing parser behind the wrapper, so the NIF's size/depth bounds on untrusted schema text
    (recursive-descent stack-overflow guard) are unchanged.

Everything else in the range is additive, no NIF edits needed:

  • include/llama.h: new llama_tensor_read_lazy field in llama_model_params — the NIF builds params from
    llama_model_default_params(), unaffected. Session/state-seq versions bump 9→10 / 2→3.
  • common/speculative.h: only gained functions (common_speculative_n_max, synthetic-acceptance helpers); every
    common_speculative_* callsite is signature-identical.

Verification

macOS (Metal, M1 Max), rebuilt with LLAMA_BACKEND=metal:

Run Result
Default suite (no model) 428 passed, 149 excluded, 0 failures
--include mtp_sidecar (Qwen3.8-27B-Q4_K_M + mtp-Qwen3.8-27B-Q4_0 sidecar head) 434 passed, 0 failures

mix compile --warnings-as-errors and mix format --check-formatted clean.

83 builds past b10582. One binding edit: upstream replaced
nlohmann::ordered_json with its pimpl wrapper common_json in
json-schema-to-grammar.h/chat.h, so json_schema_to_grammar_nif parses
with common_json::parse and the direct <nlohmann/json.hpp> include is
gone. llama.h changes are additive (llama_tensor_read_lazy,
session/state-seq version bumps); every common_speculative_* callsite
is signature-identical.

Verified on Metal: default 428 passed / 149 excluded, and
--include mtp_sidecar 434 passed (Qwen3.8-27B-Q4_K_M + mtp-*-Q4_0).
@nyo16
nyo16 merged commit 63545f0 into master Aug 28, 2026
9 checks passed
@nyo16
nyo16 deleted the bump-llama-b10665 branch August 28, 2026 13:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant