Skip to content

Add Triton MXFP8 quantization and weight rounding - #19

Open
nxphi47 wants to merge 2 commits into
mainfrom
feat/mxfp8-qat-rounding
Open

nxphi47 wants to merge 2 commits into
mainfrom
feat/mxfp8-qat-rounding

Conversation

@nxphi47

@nxphi47 nxphi47 commented Oct 14, 2026 •

Copy link
Copy Markdown

Add registered Triton per-32 MXFP8 quantization and BF16 dequantization, with E4M3 payloads and UE8M0 RCEIL scales. Support strided dense/expert weights, signed zeros, empty tensors, and deterministic stochastic rounding keyed by seed, tensor stream, and global element offset.

Validation: 14 GPU component tests passed, covering all finite BF16 magnitudes against the native vLLM cast, an independent exact scale reference, Philox/neighbor-reference SR bytes, shard invariance, changing streams, on-grid invariance, and unbiased midpoint rounding.

The serving compatibility layer and QAT integration are tracked separately in PrimeIntellect-ai/prime-rl#4095.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant