All pull requests

Pull requests

• End a stop-sequence match with a Stop frame and send done at the match

  #654·airiclenz opened Nov 2, 2026·

  ·

• Use storage-safe M16 for one-lane 4.5-bit decode on 20-core Apple10 GPUs

  #653·linson007 opened Nov 2, 2026Contributor·

  ·

• App: stability, smoother streaming, a terminal and log drawer, and the Server in the toolbar

  #651·jianc99 opened Oct 31, 2026Collaborator·

  ·

• Spill a Resident lane before the expert store gives memory back

  #650·jianc99 opened Oct 31, 2026Collaborator·

  ·

• Render PDFs in a sandbox, with no environment

  #649·jianc99 opened Oct 31, 2026Collaborator·

  ·

• Match the thinking end to the chat template, and leave the answer room in the thinking budget

  #648·jianc99 opened Oct 31, 2026Collaborator·

  ·

• Answer llama.cpp's /slots and /props and pin requests to slots with --llama-cpp-compat

  #638·pcvelz opened Oct 30, 2026Contributor·

  ·

• Run a supervisor's check before each engine spawn with --spawn-guard

  #637·pcvelz opened Oct 30, 2026Contributor·

  ·

• Serve video input for Qwen3-VL family models

  #636·Marian2110 opened Oct 30, 2026·

  ·
  1

  1

• Add lossless ZBF16 KV pages (--kv-format zbf16)

  #630·coco-alen opened Oct 30, 2026Contributor·

  ·

• Add prompt-lookup (copyspec) drafting for speculative decode

  #628·botinate opened Oct 29, 2026·

  ·
  4

• Support DeepSeek-V4.1-Flash, with its DSpark drafter

  #619·Thomas-Zenkel opened Oct 28, 2026·

  ·
  6

• Read per-request sampling from X-Temperature, X-Presence-Penalty and X-Repetition-Penalty with --sampling-headers

  #618·pcvelz opened Oct 28, 2026Contributor·

  ·

• Exit instead of relaunching a failed engine with --engine-failure exit

  #617·pcvelz opened Oct 28, 2026Contributor·

  ·

• Turn reasoning off for every request with --reasoning off

  #615·pcvelz opened Oct 28, 2026Contributor·

  ·
  1

• Set the sampling defaults of requests that set none with --sampling-default

  #614·pcvelz opened Oct 28, 2026Contributor·

  ·
  3

• Support Flash-Next MLX checkpoints

  #608·linson007 opened Oct 27, 2026Contributor·

  ·
  1

• Add a native macOS desktop chat app

  #605·linson007 opened Oct 27, 2026Contributor·

  ·

• Local classifier for Claude Code auto mode: POST /v1/safeguards and --safeguards

  #591·sambengtson opened Oct 25, 2026·

  ·
  1

• Publish Qwen architecture ablations and DFlash2 deployment audit

  #590·linson007 opened Oct 25, 2026Contributor·

  ·

• Use smaller SIMD-group rows for short affine FFN prefills on M5 Pro

  #585·linson007 opened Oct 24, 2026Contributor·

  ·
  1

• Use M16 for measured one-lane AF4G64 decode on M5 Pro

  #584·linson007 opened Oct 24, 2026Contributor·

  ·

• Report complete decode cycles and publish Qwen M5 Pro evidence

  #583·linson007 opened Oct 24, 2026Contributor·

  ·
  1

• Add Qwen3.5-4B target and DFlash2 draft support

  #559·Qiqi723 opened Oct 23, 2026·

  ·

• Add matched-prefix DFlash state restore probes and native evidence

  #556·linson007 opened Oct 22, 2026Contributor·

  ·
  1