Skip to content

[suggestion] Support Dflash #4770

Open
Open

Description

@kiron111

according to this post:
https://www.reddit.com/r/LocalLLaMA/comments/1xjlgm4/psa_upgrade_flash_next_to_dflash2_if_you_havent/

Speed:

  | MTP (acceptance) | DFlash2 (acceptance) | delta -- | -- | -- | --

Q4_K_XL (code) | 80.5 tps (94%) | 95.1 tps (84%) | +18%
Q4_K_XL (list) | 91.4 tps (98%) | 127 tps (98%) | +39%
Q4_K_XL (prose) | 53.8 tps (78%) | 51.9 tps (64%) | -3%
Q4_K_XL (6k ctx) | 80.2 tps (97%) | 95.3% (90%) | +19%
Geometric mean | 75.1 tps | 87.9 tps | +17%

Runs were conducted after an extensive sweep of parameters for MTP and DFlash2 to find optimal settings for both drafters on Apple Silicon (M5 Max). Your settings will likely be different, but mine were n-max = 3, p-min = 0.75 for MTP and n-max = 5, p-min = 0.75 for DFlash2. At longer context (25K), DFlash2 roughly equals MTP, so there is some drop-off whereas MTP stays nearly flat.

the dflash gguf repo: https://huggingface.co/nazeshinjite/Qwen3.8-Flash-Next-DFlash2-GGUF/

It's great if this project could support Dflash for qwen3.8 fn!!!

Activity

  1. github-actions commented on Oct 31, 2026

    @github-actions

    Thanks for the issue. To keep the tracker readable, every item needs an area prefix in the title and the parts of the issue form filled in. This one is missing:

    • Start the title with its area: [Engine], [GUI], [TUI], [Benchmark], [Docs] or [Other], then a short description. Example: "[Engine] decode stops after 2 minutes".

    Edit the issue (title and description) and this note goes away on its own. If it is still missing parts in 5 days it will be closed, which is not a rejection: fix it and comment /reopen.

    Details: CONTRIBUTING.md

  2. Joe11221 commented on Oct 31, 2026

    @Joe11221

    Hey, I believe Strata already has DFlash2 as an opt-in drafter in the Terminal: strata launch --drafting dflash2, for Qwen3.8-Flash-Next only. The default (auto) still uses MTP, and the app doesn't offer DFlash2 yet. The release notes for 0.2.3 cover it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    needs-formatTitle or template does not follow CONTRIBUTING.md yet

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions