[Klaud Cold] Update dsr1-fp4-b200-sglang SGLang image to v0.5.19-cu130 / 将 dsr1-fp4-b200-sglang 的 SGLang 镜像更新至 v0.5.19-cu130 - #2989
Conversation
|
Thanks for the contribution! Please reach out to respective companies' CODEOWNER to fill in the latest PR_REVIEW_CHECKLIST.md before pinging core maintainer on Slack for review. In order for the signoff PR check bot to trigger, you must follow the PR_REVIEW_CHECKLIST.md template correctly, including the phrase For PR verification, add the PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. See GitHub's docs on re-running failed jobs 感谢你的贡献!请联系相应公司的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,然后再在 Slack 上联系核心维护者进行审阅。为了触发 signoff PR 检查机器人,你必须正确遵循 PR_REVIEW_CHECKLIST.md 模板,包括保留英文语句 如需进行 PR 验证,请为此 PR 添加 PR 作者有责任确保合并后所有 GitHub Action 任务完全通过。 很多时候失败只是偶发抖动(flake),重新运行失败的任务即可解决。参见 GitHub 关于重新运行失败任务的文档 |
Initial attempt
初始尝试
|
Move the B200 DeepSeek-R1-0528 NVFP4 single-node SGLang recipe from lmsysorg/sglang:v0.5.16-cu130 (build commit sgl-project/sglang@fdebc93, CUDA 13.0.1, FlashInfer 0.6.14, sgl-kernel 0.4.5) to the v0.5.19 release image lmsysorg/sglang:v0.5.19-cu130 (Docker Hub digest sha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9, build commit sgl-project/sglang@0bcd822 = tag v0.5.19, CUDA 13.0.3, FlashInfer 0.6.18, sgl-kernel 0.4.6.post1). Model, TP4/EP1 and TP4/EP4 DP-attention topologies, the 8k1k workload, concurrency ranges and benchmarks/single_node/fixed_seq_len/dsr1_fp4_b200.sh are unchanged; the dsr1-fp4-b200-sglang-mtp sibling is not touched. 将 B200 DeepSeek-R1-0528 NVFP4 单节点 SGLang 配方的镜像从 lmsysorg/sglang:v0.5.16-cu130(构建提交 sgl-project/sglang@fdebc93,CUDA 13.0.1, FlashInfer 0.6.14,sgl-kernel 0.4.5)切换到 v0.5.19 发布版 lmsysorg/sglang:v0.5.19-cu130(Docker Hub 摘要 sha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9, 构建提交 sgl-project/sglang@0bcd822 = 标签 v0.5.19,CUDA 13.0.3,FlashInfer 0.6.18,sgl-kernel 0.4.6.post1)。 模型、TP4/EP1 与 TP4/EP4 DP-attention 拓扑、8k1k 工作负载、并发范围以及 benchmarks/single_node/fixed_seq_len/dsr1_fp4_b200.sh 均保持不变; 未改动 dsr1-fp4-b200-sglang-mtp 同族配方。 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Append the perf-changelog entry for moving the B200 DeepSeek-R1-0528 NVFP4 single-node SGLang recipe to lmsysorg/sglang:v0.5.19-cu130 (PR #2989). The entry selects the whole family without scenario, eval-selection or append-only modifiers; all prior bytes are preserved. 为将 B200 DeepSeek-R1-0528 NVFP4 单节点 SGLang 配方切换到 lmsysorg/sglang:v0.5.19-cu130(PR #2989)追加 perf-changelog 条目。 该条目选择整个配方族,不带 scenario、评测选择或 append-only 修饰符; 所有既有字节均保持不变。 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2e86dba to
25f8f98
Compare
Final full sweep
Throughput improves on every point (+1.0% to +6.9%); TPOT and E2EL improve everywhere. The only regressions are median TTFT at TP4/EP1 c1 (+0.1%), c2 (+2.3%) and c4 (+0.8%), all within a few milliseconds.
最终完整扫描
所有点的吞吐均有提升(+1.0% 至 +6.9%);TPOT 与 E2EL 全部改善。仅有的回退是 TP4/EP1 c1(+0.1%)、c2(+2.3%)、c4(+0.8%)的 TTFT 中位数,均在几毫秒以内。
|
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=34557177019 |
|
Klaud Cold: validated. All owned runs are terminal. Repairs: 0. Runs: 34548446011, 34557151441, 34557177019. The full sweep is verified; this PR remains ready for review. Klaud Cold:validated。所有自有运行均已结束。修复次数:0。运行:34548446011, 34557151441, 34557177019。 完整 sweep 已通过验证;PR 保持就绪,等待审查。 |
There was a problem hiding this comment.
Looks good, straightforward image-version bump. Reviewed the config diff (single image field change in the dsr1-fp4-b200-sglang recipe, no other fields touched) and the changelog diff (new entry appended strictly at the tail with no edits to prior bytes, matching the append-only convention).
Extended reasoning...
Overview
The PR touches exactly two files: configs/nvidia-master.yaml, where the dsr1-fp4-b200-sglang recipe's image field is bumped from lmsysorg/sglang:v0.5.16-cu130 to lmsysorg/sglang:v0.5.19-cu130 with no other field changes, and perf-changelog.yaml, which gains one new entry appended at the physical tail of the file describing the bump (old/new build commits, CUDA/FlashInfer/sgl-kernel versions, and a digest for the new image) plus an assertion that the benchmark script's model/backend/dtype/concurrency-grid configuration is unchanged.
Security risks
None identified. This is a data-only YAML change (an image tag string and a changelog text entry) with no code execution, no credentials, no auth/permissions logic, and no injection surface.
Level of scrutiny
Low. This matches the repository's documented "Klaud Cold" automated image-bump pattern: an exact-version image tag bump paired with a changelog entry citing build commits and a digest. I verified via git diff --stat that the config change is a single line and the changelog change is purely additive at the tail (no historical bytes edited), which satisfies the append-only, byte-sensitive requirement documented in AGENTS.md/CONTRIBUTING.md for this changelog file. The recipe is single-node (no multinode/model.container field), so the multi-node model.container == image coupling rule noted in the task context does not apply here.
Other factors
No CODEOWNERS-restricted paths appear to be implicated beyond standard config/changelog ownership, and the PR conversation timeline shows no outstanding CHANGES_REQUESTED or unaddressed third-party objections. No bugs were reported by the bug-hunting system, and my own review of the diff found nothing beyond the mechanical, well-formed change described.
Update the
dsr1-fp4-b200-sglangmaster image fromlmsysorg/sglang:v0.5.16-cu130to the current SGLang releaselmsysorg/sglang:v0.5.19-cu130(Docker Hub digestsha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9, build commit sgl-project/sglang@0bcd822 = tag v0.5.19). Model, TP4/EP1 and TP4/EP4 DP-attention topologies, the 8k1k workload, concurrency ranges andbenchmarks/single_node/fixed_seq_len/dsr1_fp4_b200.share unchanged.Baseline
workflow-info?date=2026-08-06;benchmarks?model=DeepSeek-R1-0528&date=2026-08-06&exact=true&sequence=8k/1k, filtered to hardwareb200, frameworksglang, precisionfp4, specnone, non-disagg, ISL/OSL 8192/1024;evaluations?model=DeepSeek-R1-0528&date=2026-08-06&exact=true)lmsysorg/sglang:v0.5.16-cu130(Docker Hub digestsha256:7b6a35df9839fd593a94a1eaee82d7777f472225d9f3ad1f8a2e0cb2bd1785d0, build commit sgl-project/sglang@fdebc93 = tagv0.5.16, CUDA 13.0.1, FlashInfer 0.6.14, sgl-kernel 0.4.5)cluster:b200-nscale),nvidia/DeepSeek-R1-0528-FP4-V2, SGLang NVFP4, no speculative decoding, fixed-seq-len 8k1k (ISL 8192 / OSL 1024), random dataset; TP4/EP1 at concurrency 1–32 and TP4/EP4 DP-attention at concurrency 64–256 (9 points)d4363bd7fd5bda1391d2d0a46d834cecc363c0d6, changelog PR #2492); benchmark result IDs 438719 … (curve snapshotcurve_workflow_run_id2261 is a logical snapshot, not the producer)将
dsr1-fp4-b200-sglang的主配置镜像从lmsysorg/sglang:v0.5.16-cu130更新至当前 SGLang 发布版lmsysorg/sglang:v0.5.19-cu130(Docker Hub 摘要sha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9,构建提交 sgl-project/sglang@0bcd822 = 标签 v0.5.19)。模型、TP4/EP1 与 TP4/EP4 DP-attention 拓扑、8k1k 工作负载、并发范围以及benchmarks/single_node/fixed_seq_len/dsr1_fp4_b200.sh均保持不变。基线
workflow-info?date=2026-08-06;benchmarks?model=DeepSeek-R1-0528&date=2026-08-06&exact=true&sequence=8k/1k,按硬件b200、框架sglang、精度fp4、无投机解码、非分离式、ISL/OSL 8192/1024 过滤;evaluations?model=DeepSeek-R1-0528&date=2026-08-06&exact=true)lmsysorg/sglang:v0.5.16-cu130(Docker Hub 摘要sha256:7b6a35df9839fd593a94a1eaee82d7777f472225d9f3ad1f8a2e0cb2bd1785d0,构建提交 sgl-project/sglang@fdebc93 = 标签v0.5.16,CUDA 13.0.1,FlashInfer 0.6.14,sgl-kernel 0.4.5)cluster:b200-nscale),nvidia/DeepSeek-R1-0528-FP4-V2,SGLang NVFP4,无投机解码,固定序列长度 8k1k(ISL 8192 / OSL 1024),随机数据集;TP4/EP1 并发 1–32,TP4/EP4 DP-attention 并发 64–256(共 9 个点)d4363bd7fd5bda1391d2d0a46d834cecc363c0d6,changelog PR #2492);曲线快照curve_workflow_run_id2261 仅为逻辑快照,不是生产运行🤖 Generated with Claude Code
Note
Low Risk
Config and changelog-only change; no benchmark script or topology edits, only a pinned container image version update.
Overview
Bumps the
dsr1-fp4-b200-sglangperf config container image fromlmsysorg/sglang:v0.5.16-cu130tolmsysorg/sglang:v0.5.19-cu130inconfigs/nvidia-master.yaml. The new image brings CUDA 13.0.3, FlashInfer 0.6.18, and sgl-kernel 0.4.6.post1 (vs 13.0.1 / 0.6.14 / 0.4.5 on the old tag).A matching
perf-changelog.yamlentry records the digest, build commit, and states that model, B200 topology (TP4/EP1 and TP4/EP4 DP-attention), 8k1k fixed-seq-len grid, andbenchmarks/single_node/fixed_seq_len/dsr1_fp4_b200.share unchanged—so this is a runtime refresh for comparable re-benchmarking only.Reviewed by Cursor Bugbot for commit 25f8f98. Bugbot is set up for automated code reviews on this repo. Configure here.