Skip to content

feat(kv): store INT4/NVFP4 KV pages in the cache manager and read them with Triton - #174

Draft
HowardYangAI wants to merge 15 commits into
InferMatrixLab:mainfrom
HowardYangAI:feat/kv-quant-integration
Draft

HowardYangAI wants to merge 15 commits into
InferMatrixLab:mainfrom
HowardYangAI:feat/kv-quant-integration

Commits

  1. Commits on Nov 6, 2026

  2. Commits on Nov 7, 2026

  3. Commits on Nov 9, 2026

  4. Commits on Nov 11, 2026

  5. Commits on Nov 13, 2026

  6. Commits on Nov 14, 2026

  7. Commits on Nov 15, 2026