images/gpu: update test images for Blackwell (sm_100/sm_120) - #14477
Open
copybara-service[bot] wants to merge 1 commit into
Open
images/gpu: update test images for Blackwell (sm_100/sm_120)#14477copybara-service[bot] wants to merge 1 commit into
copybara-service[bot] wants to merge 1 commit into
Conversation
copybara-service
Bot
force-pushed
the
test/cl972731852
branch
from
August 28, 2026 22:11
6d83f61 to
38e48a9
Compare
### AI assistance This change was prepared with AI assistance (Claude Code) and is labelled `Assisted-by: Claude Code` in the commit message, per CONTRIBUTING.md. I have reviewed the change and am able to discuss and justify it. ### Problem Several GPU test images pin CUDA versions that predate Blackwell, so they fail on sm_100/sm_120 with `no kernel image is available for execution on the device` -- under `runc` exactly as much as under `runsc`. These tests therefore cannot pass on Blackwell regardless of nvproxy. ### Changes - **vllm**: pinned v0.4.2, whose torch 2.3.0+cu121 compiles for `sm_50..sm_90`. Bumped to v0.27.1 (torch 2.13.0+cu130, built for `sm_75..sm_90`, `sm_100`, `sm_120`), pinned by digest. - **nccl-tests**: CUDA 12.8 is the first toolkit whose nvcc knows the Blackwell arches, and nccl-tests derives its gencode list from the toolkit. The CUDA sample images (`cuda-tests`, `cuda-tests-12-8`) already work on Blackwell unchanged, because the samples embed PTX and the driver JIT-compiles it forward. `stable-diffusion-xl` is deliberately left alone: it installs torch transitively from the default PyPI index rather than a CUDA-specific one, so it needs an explicit `cu128` index plus a compatible `xformers` pin. `pytorch` is handled in a separate follow-up change. ### Verification On an NVIDIA RTX PRO 6000 Blackwell Server Edition (GB202), the upstream vLLM v0.27.1 image serves `facebook/opt-125m` and answers completion requests under both `runc` and `runsc`. --- 🤖 Generated with [Claude Code](https://claude.com/claude-code) FUTURE_COPYBARA_INTEGRATE_REVIEW=#14215 from alexhuo2020:blackwell-test-images bec8194 PiperOrigin-RevId: 972731852
copybara-service
Bot
force-pushed
the
test/cl972731852
branch
from
August 28, 2026 22:34
38e48a9 to
4ef0520
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
images/gpu: update test images for Blackwell (sm_100/sm_120)
AI assistance
This change was prepared with AI assistance (Claude Code) and is
labelled
Assisted-by: Claude Codein the commit message, perCONTRIBUTING.md. I have reviewed the change and am able to discuss and
justify it.
Problem
Several GPU test images pin CUDA versions that predate Blackwell, so
they fail on sm_100/sm_120 with
no kernel image is available for execution on the device-- underruncexactly as much as underrunsc. These tests therefore cannot pass on Blackwell regardless ofnvproxy.
Changes
sm_50..sm_90. Bumped to v0.27.1 (torch 2.13.0+cu130, built forsm_75..sm_90,sm_100,sm_120), pinned by digest.Blackwell arches, and nccl-tests derives its gencode list from the
toolkit.
The CUDA sample images (
cuda-tests,cuda-tests-12-8) already work onBlackwell unchanged, because the samples embed PTX and the driver
JIT-compiles it forward.
stable-diffusion-xlis deliberately left alone: it installs torchtransitively from the default PyPI index rather than a CUDA-specific one,
so it needs an explicit
cu128index plus a compatiblexformerspin.pytorchis handled in a separate follow-up change.Verification
On an NVIDIA RTX PRO 6000 Blackwell Server Edition (GB202), the upstream
vLLM v0.27.1 image serves
facebook/opt-125mand answers completionrequests under both
runcandrunsc.🤖 Generated with Claude Code
FUTURE_COPYBARA_INTEGRATE_REVIEW=#14215 from alexhuo2020:blackwell-test-images bec8194