You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Step 6 of the sync cycle, owed against the NEW pin e126687a9a828d513c01a07cd69f025f27d63280, which #2817 advanced to.
This is post-hoc by developer ruling, and that is the whole point of the issue
.agents/upstream-sync.md §"The sync cycle" puts step 6 before step 7. Wave
STEP6 (#2771, landed as #2783) measured that the committed harness cannot run
step 6 at a revision that is not the pin, because online_gate.py reads the ```parity-pin block and refuses on the distribution version, the runtime
version, the commit and the FlashInfer version before it reaches anything else.
The developer ruled that the pin advances first. So the baselines below were
measured against the PREVIOUS pin and are now validated after the fact.
A red here requires reverting the pin, not holding it. There is no version of
this in which a failing re-measurement leaves the pin where it is: the advance was
taken on the expectation that these numbers survive it.
READ THIS BEFORE YOU SPEND THE LEASE: the build mode decides whether the harness will run at all
The ```parity-pin block records vllm_distribution_version = 0.28.1rc1.dev132+ge126687a9.precompiled. That
string was measured under VLLM_USE_PRECOMPILED=1. The SOURCE build at the
same revision produced a wheel with no.precompiled suffix: vllm-0.28.1rc1.dev132+ge126687a9-cp312-cp312-linux_aarch64.whl
(.agents/sync/2026-09-03-e126687-runhalf.md §2).
tools/bench/online_gate.py:3529-3540 compares that field for equality, and
it does so BEFORE it reaches the commit assertion or the FlashInfer gate. So a
source-built oracle at this pin — which is what step 1 of the shared setup below
asks for — is refused on the distribution version, after the 94-minute build,
on a contended GB10.
Three things follow, and none of them is "edit the block until it passes":
Read importlib.metadata.version("vllm") from cd / as soon as the install
finishes, before starting any measurement, and record it literally.
Full context: .agents/upstream-sync.md §"The .precompiled suffix is a
BUILD-MODE property" and .agents/sync/2026-09-03-e126687-advance.md §2.1.
What is owed
.agents/sync/2026-09-03-e126687-step6.md §7 is the recipe. All of it needs dgx:gpu0 (GB10, sm_121a), which is the device every affected number was taken
on, claimed with rc run under setsid nohup with ppid == 1 verified and read
back with rc logs. FlashInfer moves 0.6.15.post1 to 0.6.18, and our own arm
must be rebuilt with VLLM_CPP_CUTLASS_DIR pointing at that wheel's data/cutlass, because it is the same input on both sides of the ratio.
C1a, vllm-online-serving, three throughput rows plus the startup row. nvidia/Qwen3.6-27B-NVFP4@0893e160 and Qwen3.6-35B-A3B NVFP4 at c1 and c4
against docs/benchmarks/vllm-online-serving.md:66-67 and :106-107; Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0 bf16 at c4 against :21; and the cold-to-/health startup row at :73.
C1b, speculative-decoding, two rows. The MTP row
(docs/benchmarks/speculative-decoding.md:5) at c1 through c8, and the DFlash
D14 row (:6) on the D14 recipe, recording the oracle's selected backend
explicitly rather than assuming it at 0.6.18.
C1c, nvidia-cutlass-dsl4.6.0 to 4.6.2. STEP6 withdrew its discharge: vllm/model_executor/warmup/kernel_warmup.py:125-126 gates on has_device_capability(90), which is >= and therefore admits sm_121, and the compile(...) it reaches is unguarded. Two questions: whether the 4.6.2 warmup
compile succeeds on GB10 at all, and what fraction of the oracle's 182.41 s
startup it is. cutedsl_warmup() and fa4_cutedsl_warmup() were never examined
and are owed with it.
The two discharges, and whether they still hold
Both were argued at the OLD pin and both are re-stated as still holding at the
new one, because neither argument depends on which revision is pinned:
The transformers floor moved >= 5.5.3 to >= 5.10.4 and the resolved
version is 5.14.1, above both. Still a lower bound, still satisfied.
VLLM_ALLREDUCE_USE_FLASHINFER flipped False to True and is inert at tensor_parallel_size == 1, which every committed gate runs.
A rebuild of the oracle environment at the target resolves transformers to
whatever is newest that day (5.16.1 was measured), which belongs to golden-drift
re-validation, not to this denominator.
Not owed here
The declared token-exact gate at the target is #2794. docs/benchmarks/memory.md's
four unmarked PASS rows are STEP6 C7 and belong to whoever re-takes that grid.
Row:
UPSTREAM-SYNC-HEADPINStep 6 of the sync cycle, owed against the NEW pin
e126687a9a828d513c01a07cd69f025f27d63280, which #2817 advanced to.This is post-hoc by developer ruling, and that is the whole point of the issue
.agents/upstream-sync.md§"The sync cycle" puts step 6 before step 7. WaveSTEP6 (#2771, landed as #2783) measured that the committed harness cannot run
step 6 at a revision that is not the pin, because
online_gate.pyreads the```parity-pinblock and refuses on the distribution version, the runtimeversion, the commit and the FlashInfer version before it reaches anything else.
The developer ruled that the pin advances first. So the baselines below were
measured against the PREVIOUS pin and are now validated after the fact.
A red here requires reverting the pin, not holding it. There is no version of
this in which a failing re-measurement leaves the pin where it is: the advance was
taken on the expectation that these numbers survive it.
READ THIS BEFORE YOU SPEND THE LEASE: the build mode decides whether the harness will run at all
The
```parity-pinblock recordsvllm_distribution_version = 0.28.1rc1.dev132+ge126687a9.precompiled. Thatstring was measured under
VLLM_USE_PRECOMPILED=1. The SOURCE build at thesame revision produced a wheel with no
.precompiledsuffix:vllm-0.28.1rc1.dev132+ge126687a9-cp312-cp312-linux_aarch64.whl(
.agents/sync/2026-09-03-e126687-runhalf.md§2).tools/bench/online_gate.py:3529-3540compares that field for equality, andit does so BEFORE it reaches the commit assertion or the FlashInfer gate. So a
source-built oracle at this pin — which is what step 1 of the shared setup below
asks for — is refused on the distribution version, after the 94-minute build,
on a contended GB10.
Three things follow, and none of them is "edit the block until it passes":
importlib.metadata.version("vllm")fromcd /as soon as the installfinishes, before starting any measurement, and record it literally.
corrected from YOUR measurement, in its own change, with the build mode named
beside it. Editing a fail-closed assertion to make a run pass is the The benchmark harness ENFORCES the 0.25.0 rollback oracle and would REJECT the recorded pin — nobody could have measured correctly even deliberately #520
failure — the harness spent 17 days refusing the oracle the record required,
and it was right to.
run half recorded
SHALLOW=false REVCOUNT=20591; a shallow clone silentlyrewrites the version prefix (The pinned vLLM oracle BUILDS, installs and imports inside an
rclease ondgx:gpu0, and a model run is still UNTESTED #1185), so a deep fetch is part of the recipe,not an optimisation.
Full context:
.agents/upstream-sync.md§"The.precompiledsuffix is aBUILD-MODE property" and
.agents/sync/2026-09-03-e126687-advance.md§2.1.What is owed
.agents/sync/2026-09-03-e126687-step6.md§7 is the recipe. All of it needsdgx:gpu0(GB10,sm_121a), which is the device every affected number was takenon, claimed with
rc runundersetsid nohupwithppid == 1verified and readback with
rc logs. FlashInfer moves0.6.15.post1to0.6.18, and our own armmust be rebuilt with
VLLM_CPP_CUTLASS_DIRpointing at that wheel'sdata/cutlass, because it is the same input on both sides of the ratio.C1a,
vllm-online-serving, three throughput rows plus the startup row.nvidia/Qwen3.6-27B-NVFP4@0893e160and Qwen3.6-35B-A3B NVFP4 at c1 and c4against
docs/benchmarks/vllm-online-serving.md:66-67and:106-107;Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0bf16 at c4 against:21; and the cold-to-/healthstartup row at:73.C1b,
speculative-decoding, two rows. The MTP row(
docs/benchmarks/speculative-decoding.md:5) at c1 through c8, and the DFlashD14 row (
:6) on the D14 recipe, recording the oracle's selected backendexplicitly rather than assuming it at
0.6.18.C1c,
nvidia-cutlass-dsl4.6.0to4.6.2. STEP6 withdrew its discharge:vllm/model_executor/warmup/kernel_warmup.py:125-126gates onhas_device_capability(90), which is>=and therefore admitssm_121, and thecompile(...)it reaches is unguarded. Two questions: whether the4.6.2warmupcompile succeeds on GB10 at all, and what fraction of the oracle's 182.41 s
startup it is.
cutedsl_warmup()andfa4_cutedsl_warmup()were never examinedand are owed with it.
The two discharges, and whether they still hold
Both were argued at the OLD pin and both are re-stated as still holding at the
new one, because neither argument depends on which revision is pinned:
transformersfloor moved>= 5.5.3to>= 5.10.4and the resolvedversion is
5.14.1, above both. Still a lower bound, still satisfied.VLLM_ALLREDUCE_USE_FLASHINFERflippedFalsetoTrueand is inert attensor_parallel_size == 1, which every committed gate runs.A rebuild of the oracle environment at the target resolves
transformerstowhatever is newest that day (
5.16.1was measured), which belongs to golden-driftre-validation, not to this denominator.
Not owed here
The declared token-exact gate at the target is #2794.
docs/benchmarks/memory.md'sfour unmarked PASS rows are STEP6 C7 and belong to whoever re-takes that grid.
FOLLOWING_AGENTS_PROTOCOL