Repository navigation
[Klaud Cold] Update MiniMax-M3 FP4 GB300 Dynamo vLLM AgentX disagg image to v0.32.0 / [Klaud Cold] 将 MiniMax-M3 FP4 GB300 Dynamo vLLM AgentX 分离式镜像更新至 v0.32.0 - #4616
Conversation
… v0.32.0 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Thanks for the contribution!
中文感谢你的贡献!
|
|
Initial attempt · Failed · Run 40724891253 / attempt 1 · 2026-10-28 16:49 UTC
Note: AgentX c1 PTP4x1/DTP4x1 b6fdfc: failed. Next: Repair 1: switch only the EAGLE3 drafter speculative-config attention_backend from FLASH_ATTN to FLASHINFER (FP8 KV supported, as the sibling MiniMax-M3 vLLM B200 FP4 MTP recipe uses) and rerun the smoke. 中文初次尝试 · 失败 · Run 40724891253 / attempt 1 · 2026-10-28 16:49 UTC |
|
parked · Session 1 is waiting on 40724891253. Recovery reruns preempted runs and starts the next session once they end. 中文parked · 第 1 个会话正在等待 40724891253。恢复流程会重跑被抢占的运行,并在运行结束后启动下一个会话。 |
|
resumed · The session ended before finishing; session 2 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 2 个会话将在其规划运行的新运行中继续。 |
…LLM v0.32.0 vLLM v0.32.0 routes FLASH_ATTN to the FA4 dense kernel on SM100, which rejects the stride-0 FP8 KV descale tensors. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Repair 1/5 · Failed · Run 40729765879 / attempt 1 · 2026-10-28 17:51 UTC
Note: AgentX c1 PTP4x1/DTP4x1 b6fdfc, AgentX c24 PTP1x1/DTP4x3 8d4b12, AgentX c20 PTP2x1/DTP4x1 553930, AgentX c120 PTP2x2/DTP2x5 4463b4: cancelled. Next: Repair 2: bump only the family recipe's Dynamo pin to 1.6.0.dev20261010, which resolves interface names since ai-dynamo/dynamo#11870 and runs green in gb300-nv dsv41flash Dynamo vLLM recipes, then rerun the smoke. 中文修复 1/5 · 失败 · Run 40729765879 / attempt 1 · 2026-10-28 17:51 UTC |
|
parked · Session 2 is waiting on 40729765879. Recovery reruns preempted runs and starts the next session once they end. 中文parked · 第 2 个会话正在等待 40729765879。恢复流程会重跑被抢占的运行,并在运行结束后启动下一个会话。 |
|
resumed · The session ended before finishing; session 3 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 3 个会话将在其规划运行的新运行中继续。 |
…disagg Dynamo 1.4.0.dev20260730 parses DYN_TCP_RPC_HOST as a raw socket address, so the gb300-nv node value enP22s22f0np0 (an interface name) fails with 'Invalid TCP bind address'. Dynamo resolves interface names since ai-dynamo/dynamo#11870 (2026-09-05); 1.6.0.dev20261010 matches the green gb300-nv dsv41flash Dynamo vLLM recipes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Repair 2/5 · Failed · Run 40739495555 / attempt 1 · 2026-10-28 18:12 UTC
Note: AgentX c1 PTP4x1/DTP4x1 b6fdfc, AgentX c20 PTP2x1/DTP4x1 553930, AgentX c48 PTP2x1/DTP2x3 b9ce69, AgentX c120 PTP2x2/DTP2x5 4463b4: cancelled. Next: Repair 3: pin the recipe Dynamo to 1.7.0.dev20261025, the first nightly after ai-dynamo/dynamo#16757 bumped core to vLLM v0.32.0 (wheel requires vllm==0.32.0 and resolves the helper lazily per #16378), then rerun the smoke. 中文修复 2/5 · 失败 · Run 40739495555 / attempt 1 · 2026-10-28 18:12 UTC |
|
parked · Session 3 is waiting on 40739495555. Recovery reruns preempted runs and starts the next session once they end. 中文parked · 第 3 个会话正在等待 40739495555。恢复流程会重跑被抢占的运行,并在运行结束后启动下一个会话。 |
|
resumed · The session ended before finishing; session 4 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 4 个会话将在其规划运行的新运行中继续。 |
…v0.32.0 Dynamo 1.6.0.dev20261010 imports get_engine_zmq_addresses, which vLLM v0.32.0 lacks; 1.7.0.dev20261025 follows ai-dynamo/dynamo#16757 (vLLM v0.32.0 core) and resolves the helper lazily (#16378). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Repair 3/5 · Failed · Run 40742966902 / attempt 1 · 2026-10-28 18:50 UTC
Note: AgentX c1 PTP4x1/DTP4x1 b6fdfc, AgentX c20 PTP2x1/DTP4x1 553930, AgentX c48 PTP2x1/DTP2x3 b9ce69, AgentX c120 PTP2x2/DTP2x5 4463b4: cancelled. Next: Infrastructure retry 1: after a 45-minute back-off, rerun the failed and fail-fast-cancelled jobs of run 40742966902 on the same head with no recipe change; if the 4-rank prefill host OOM repeats on r03 nodes, stop, because avoiding it would require shrinking the frozen Mooncake DRAM offload capacity. 中文修复 3/5 · 失败 · Run 40742966902 / attempt 1 · 2026-10-28 18:50 UTC |
|
parked · Session 4 is waiting on 40742966902. Recovery reruns preempted runs and starts the next session once they end. 中文parked · 第 4 个会话正在等待 40742966902。恢复流程会重跑被抢占的运行,并在运行结束后启动下一个会话。 |
|
resumed · The session ended before finishing; session 5 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 5 个会话将在其规划运行的新运行中继续。 |
|
parked · Session 5 is waiting for recovery to rerun the failed jobs of 40742966902 after 2026-10-28 19:35 UTC. Recovery starts the next session once they end. 中文parked · 第 5 个会话正在等待恢复流程在 2026-10-28 19:35 UTC 后重跑 40742966902 的失败作业。运行结束后,恢复流程将启动下一个会话。 |
Goal: Update vLLM image from
vllm/vllm-openai:nightly-5e35a6f4f9bbc217c599692157ca985c894373f7tovllm/vllm-openai:v0.32.0@sha256:befccf0e7e4089aa23926bb6f887a85c0d46c2a99e6de5c5ffdf5cb7957c5b34.Baseline: 2026-08-21 ·
vllm/vllm-openai:nightly-5e35a6f4f9bbc217c599692157ca985c894373f7Mean latency · Sources: API 1, API 2, API 3, API 4
Stop: Close this PR at any time to stop this candidate now; Klaud cancels its runs and deletes its branch.
中文
**目标:**将 vLLM 镜像从
vllm/vllm-openai:nightly-5e35a6f4f9bbc217c599692157ca985c894373f7更新为vllm/vllm-openai:v0.32.0@sha256:befccf0e7e4089aa23926bb6f887a85c0d46c2a99e6de5c5ffdf5cb7957c5b34。**基线:**2026-08-21 ·
vllm/vllm-openai:nightly-5e35a6f4f9bbc217c599692157ca985c894373f7平均延迟 · 来源: API 1, API 2, API 3, API 4;数值及异常说明见上表。
**停止:**随时关闭此 PR 即可立即停止该候选:Klaud 会取消其运行并删除其分支。