You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
acceptance: MiniMax-H3 T2VA lossless latency on four L20X GPUs #438
Reference parent #416. Measure MiniMax-H3 T2VA serving on four NVIDIA L20X cards using the InferenceX h3-v2 release-v1 workload. The task scope is the same BF16 checkpoint, 49 denoising evaluations, dense lossless generation, and concurrency 1. Candidate search is bounded to one declared SIAS plane per iteration.
Baseline and acceptance
vLLM-Omni baseline: 4284c226cbae60fa339877db4c36cef1bad3fb34. Candidate revision to be recorded after selection.
Frozen InferenceX source: 00ba3887be718a0431a674b0f29ed140ca50fa2e. Model revision: 42ed227ee7df40d41602854ae760620d6eb651fe.
L4: all 20 measured requests valid after independent warmup, with at least 10% lower arithmetic mean submit-to-downloaded-MP4 latency under matched execution and storage conditions.
L3: decoded video and audio byte identity for all 20 matching prompt/seed pairs. The validator SHA-256 is 673a1fd17e52c8ac90d2f588bdb4192b54d52afd75665633f72865214678a5b6.
Thanks for opening this. Before a candidate is charged against it, here are a few points I think the acceptance contract should pin down:
Owner and roadmap row. Sibling campaigns, e.g. evidence/h3-ref2va-910c-4logical-20261101-297/README.md, record an accountable owner, a claim/plan receipt and who makes the final acceptance decision. Please add those here. As far as I can see, the [Roadmap] vLLM-Omni Model Optimization #416 tables don't have an H3 T2VA × L20X row yet, so this task should be linked there too.
L3 feasibility first. Byte identity of decoded video and audio for all 20 prompt/seed pairs assumes the baseline itself is bit-reproducible on L20X. Please record a baseline-vs-baseline run with two independent server starts before any candidate is judged. Otherwise a no-op candidate could already fail L3. The decoder and its version, the pixel and sample formats, and the stream selection should be fixed by the pinned validator (673a1fd1…), not left to the environment.
L4 measurement protocol. "≥10% lower arithmetic mean over 20 valid requests" needs:
the warmup count;
whether baseline and candidate are interleaved or A/B/A on the same node and session;
how many repeat rounds are run;
whether a confidence bound or a noise floor from repeated baseline runs is required beyond the point estimate.
Please also define exactly where "submit" and "downloaded MP4" are timestamped (client clock, including transfer and write), and what "matched storage conditions" means (same mount or tmpfs, same output path).
Execution identity. Please record the GPU topology (PCIe or NVLink), the driver, CUDA and PyTorch versions, and the baseline's parallel layout across the four cards (TP/SP/CFG split). One-plane-per-iteration changes are only comparable if that layout is fixed, or is itself the declared plane.
Workload pinning. Please state the resolution, duration, FPS and frame count that h3-v2 release-v1 implies for this task, and list the 20 prompt/seed pairs or their digest in plan/, so that L3 and L4 use the same set.
Agreed that the initial verdict is INCONCLUSIVE, since there is no qualified candidate or gain yet.
Classification:kind:acceptance + area:harness + status:proposed. This is a campaign acceptance Issue under parent #416 (MiniMax-H3 T2VA × four L20X), not yet accepted for candidate search.
What is already clear: BF16 checkpoint / 49 denoise / dense lossless / C1; pinned baseline, InferenceX and model revisions; L4 mean-latency ≥10% bar; L3 decoded A/V byte identity with named validator SHA-256; evidence path evidence/h3-t2va-l20x-lossless/; initial verdict INCONCLUSIVE.
Before accept / charge a candidate (agreeing with Amy’s open pins):
Confirm L3 byte-identity feasibility against the frozen baseline before treating it as a hard gate.
Add the three-line status block (Current state / Decision needed / Next action).
Next action: Author (or campaign owner) answer Amy’s contract pins and add the status block. Steward will re-read for status:accepted only after those are pinned; no candidate charged against this Issue until then.
Activity
amy-why-3459 commentedon Nov 14, 2026
Thanks for opening this. Before a candidate is charged against it, here are a few points I think the acceptance contract should pin down:
Owner and roadmap row. Sibling campaigns, e.g.
evidence/h3-ref2va-910c-4logical-20261101-297/README.md, record an accountable owner, a claim/plan receipt and who makes the final acceptance decision. Please add those here. As far as I can see, the [Roadmap] vLLM-Omni Model Optimization #416 tables don't have an H3 T2VA × L20X row yet, so this task should be linked there too.L3 feasibility first. Byte identity of decoded video and audio for all 20 prompt/seed pairs assumes the baseline itself is bit-reproducible on L20X. Please record a baseline-vs-baseline run with two independent server starts before any candidate is judged. Otherwise a no-op candidate could already fail L3. The decoder and its version, the pixel and sample formats, and the stream selection should be fixed by the pinned validator (
673a1fd1…), not left to the environment.L4 measurement protocol. "≥10% lower arithmetic mean over 20 valid requests" needs:
Please also define exactly where "submit" and "downloaded MP4" are timestamped (client clock, including transfer and write), and what "matched storage conditions" means (same mount or tmpfs, same output path).
Execution identity. Please record the GPU topology (PCIe or NVLink), the driver, CUDA and PyTorch versions, and the baseline's parallel layout across the four cards (TP/SP/CFG split). One-plane-per-iteration changes are only comparable if that layout is fixed, or is itself the declared plane.
Workload pinning. Please state the resolution, duration, FPS and frame count that h3-v2 release-v1 implies for this task, and list the 20 prompt/seed pairs or their digest in
plan/, so that L3 and L4 use the same set.Agreed that the initial verdict is INCONCLUSIVE, since there is no qualified candidate or gain yet.
Dong1017 commentedon Nov 15, 2026
Dong-bot first triage (steward).
Classification:
kind:acceptance+area:harness+status:proposed. This is a campaign acceptance Issue under parent #416 (MiniMax-H3 T2VA × four L20X), not yet accepted for candidate search.What is already clear: BF16 checkpoint / 49 denoise / dense lossless / C1; pinned baseline, InferenceX and model revisions; L4 mean-latency ≥10% bar; L3 decoded A/V byte identity with named validator SHA-256; evidence path
evidence/h3-t2va-l20x-lossless/; initial verdict INCONCLUSIVE.Before accept / charge a candidate (agreeing with Amy’s open pins):
Next action: Author (or campaign owner) answer Amy’s contract pins and add the status block. Steward will re-read for
status:acceptedonly after those are pinned; no candidate charged against this Issue until then.