Repository navigation
Update DSV4 Pro MI355X nightly and enable monokernel / 更新 DSV4 Pro MI355X nightly 镜像并启用 monokernel - #4526
Open
Fangzhou-Ai wants to merge 3 commits into
Open
Update DSV4 Pro MI355X nightly and enable monokernel / 更新 DSV4 Pro MI355X nightly 镜像并启用 monokernel#4526Fangzhou-Ai wants to merge 3 commits into
Fangzhou-Ai wants to merge 3 commits into
Conversation
Fangzhou-Ai
requested review from
1am9trash,
billishyahao,
chunfangamd,
seungrokj and
zijiecode
as code owners
October 26, 2026 02:45
Contributor
|
Thanks for the contribution!
中文感谢你的贡献!
|
Contributor
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=40260921924 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=40260921924 |
Collaborator
Collaborator
|
/reuse-sweep-run 40260921924 |
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

Update DeepSeek-V4-Pro-0813 AgentX on MI355X from
nightly-e9757321527ca1ecd514c07c1418dd2c53da3d19tovllm/vllm-openai-rocm:nightly-e4a5b5537344b103ed10de7764378ef09604ef3d, the latest nightly published on October 25, and enable--monokernelfor the nine pure-TP8 points.Explicitly disable monokernel for the three data-parallel variants: the pinned upstream implementation requires TP8 without data or expert parallelism and rejects unsupported deployments at startup. Append one performance changelog entry covering the affected config. GPU serving behavior and performance remain unverified.
Upstream references: nightly image, Pro monokernel deployment requirements.
AI model disclosure
PR checklist and change type
Type of Change
Checklist
python -m infx.matrix.changed --base origin/mainlists affected config keys, I have appended one new entry covering them to the physical end ofinferencex-e2e/perf-changelog.yaml; if it lists none, I have added none. I have not edited historical entriesinferencex-e2e/perf-changelog.yamlentry, it carries exactly one primary sweep label (a maintainer applies it on fork PRs):full-sweep-fail-fast(recommended),full-sweep-enabled, ornon-canary-full-sweep-enabled. Optional modifiersall-evals,evals-only, andagentx-fastrequire a primary label; the last two block reuse while applied.OWNER/MEMBER/COLLABORATOR) has commented/use <run_id>(or the legacy/reuse-sweep-run) on this PR. Do this only once there is a final full sweep that is all green with evals passing, since after this comment the primary sweep label will no longer automatically kick off new sweeps. Remove and re-add the primary sweep label to force a new sweep.中文
将 MI355X 上 DeepSeek-V4-Pro-0813 AgentX 的镜像从
nightly-e9757321527ca1ecd514c07c1418dd2c53da3d19更新为 10 月 25 日发布的最新 nightly:vllm/vllm-openai-rocm:nightly-e4a5b5537344b103ed10de7764378ef09604ef3d,并为九个纯 TP8 测试点启用--monokernel。三个 data-parallel 变体显式禁用 monokernel,因为该版本的上游实现要求 TP8 且不使用 data 或 expert parallelism,否则会在启动时报错。追加一条性能变更记录,覆盖受影响的配置。GPU 上的实际运行行为和性能尚未验证。上游依据见上方链接。
改动类型:配置变更。由 Codex 完成镜像更新、recipe 修改、性能变更记录和 PR;运行环境未提供可核实的精确模型标识,未使用委派 agent。合并前仍需获得包含 evals 的完整绿色 sweep,并由获授权的维护者提交
/use <run_id>。