Skip to content

scope ssh keypair to pytorch training, move non-base images to efa latest, patch cves #6785

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jinyan-li1 merged 27 commits into from
Oct 5, 2026
Merged

scope ssh keypair to pytorch training, move non-base images to efa latest, patch cves #6785

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
3fddb45
scope ssh keypair to pytorch training image
jinyan-li1 Sep 23, 2026
0fb8d28
Merge remote-tracking branch 'origin/main' into scope-ssh-keypair-pyt…
jinyan-li1 Sep 25, 2026
d12bdef
test: assert ssh keypair present only on mpirun frameworks
jinyan-li1 Sep 26, 2026
b56e0d4
Merge remote-tracking branch 'origin/main' into scope-ssh-keypair-pyt…
jinyan-li1 Sep 28, 2026
9fc4dd2
Merge remote-tracking branch 'origin/main' into scope-ssh-keypair-pyt…
jinyan-li1 Sep 29, 2026
a2e4731
chore: patch openfold3 and ray-llm scan cves
jinyan-li1 Sep 29, 2026
594ec1c
chore: refresh expired allowlist review_by dates
jinyan-li1 Sep 29, 2026
513db53
chore: allowlist ray jackson-databind and ray-llm vllm scan cves
jinyan-li1 Sep 29, 2026
f5aeca3
chore: refresh imminent allowlist review_by dates
jinyan-li1 Sep 29, 2026
69e2d29
Merge remote-tracking branch 'origin/main' into scope-ssh-keypair-pyt…
jinyan-li1 Sep 29, 2026
5083552
Merge remote-tracking branch 'origin/main' into scope-ssh-keypair-pyt…
jinyan-li1 Sep 29, 2026
3dbd3dc
chore: patch base-os cves across base and framework images
jinyan-li1 Sep 30, 2026
f4f8559
fix: cache-refresh os security layer instead of pinning packages
jinyan-li1 Sep 30, 2026
63b2aa6
style: dockerfmt indentation on base cache-refresh edits
jinyan-li1 Sep 30, 2026
60bbb0f
fix: add cache-refreshed os security upgrade to openfold3
jinyan-li1 Sep 30, 2026
ea0217d
fix: split openfold3 security layer; allowlist new xgboost openssl cves
jinyan-li1 Sep 30, 2026
d1e7fe2
feat: accept efa_version "latest" in installers, opt non-base images …
jinyan-li1 Oct 1, 2026
5a29376
fix: bump urllib3 to 2.8.0 in uv locks, default non-base efa_version …
jinyan-li1 Oct 1, 2026
2c09f28
fix: patch urllib3/pyjwt cves fleet-wide, allowlist jackson/vllm/open…
jinyan-li1 Oct 1, 2026
7b9affb
Merge remote-tracking branch 'origin/main' into scope-ssh-keypair-pyt…
jinyan-li1 Oct 1, 2026
184d508
fix: allowlist openssl cve-2026-54873 and sklearn 1.4-2 urllib3, bump…
jinyan-li1 Oct 1, 2026
b316da8
Merge remote-tracking branch 'origin/main' into scope-ssh-keypair-pyt…
jinyan-li1 Oct 1, 2026
e5857af
merge main, restore pytorch cache-refresh reference, drop base-inheri…
jinyan-li1 Oct 3, 2026
4be3404
bump tornado, virtualenv, jupyterlab, notebook; allowlist vendored ja…
jinyan-li1 Oct 3, 2026
227948c
bump virtualenv in openfold3 conda envs
jinyan-li1 Oct 4, 2026
81312a4
extend ray aiohttp allowlist review date
jinyan-li1 Oct 4, 2026
2bb6704
allowlist jackson-core cve vendored in ray_dist.jar
jinyan-li1 Oct 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/config/image/pytorch/2.11-ec2-cuda.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ build:
transformer_engine_version: "2.12.0"
nccl_version: "2.26.2"
nccl_tests_version: "v2.20.0"
efa_version: "1.49.0"
efa_version: "latest"
gdrcopy_version: "2.4.4"
max_jobs: "8"
dlc_major_version: "1"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/pytorch/2.11-sagemaker-cuda.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ build:
transformer_engine_version: "2.12.0"
nccl_version: "2.26.2"
nccl_tests_version: "v2.20.0"
efa_version: "1.49.0"
efa_version: "latest"
gdrcopy_version: "2.4.4"
max_jobs: "8"
dlc_major_version: "1"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/pytorch/2.12-ec2-cuda.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ build:
transformer_engine_version: "2.12.0"
nccl_version: "2.26.2"
nccl_tests_version: "v2.20.0"
efa_version: "1.49.0"
efa_version: "latest"
gdrcopy_version: "2.4.4"
max_jobs: "8"
dlc_major_version: "1"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/pytorch/2.12-sagemaker-cuda.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ build:
transformer_engine_version: "2.12.0"
nccl_version: "2.26.2"
nccl_tests_version: "v2.20.0"
efa_version: "1.49.0"
efa_version: "latest"
gdrcopy_version: "2.4.4"
max_jobs: "8"
dlc_major_version: "1"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/pytorch/2.13-ec2-cuda.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ build:
transformer_engine_version: "2.17.0"
nccl_version: "2.30.7-1"
nccl_tests_version: "v2.20.0"
efa_version: "1.49.0"
efa_version: "latest"
gdrcopy_version: "2.6"
max_jobs: "8"
dlc_major_version: "1"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/pytorch/2.13-sagemaker-cuda.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ build:
transformer_engine_version: "2.17.0"
nccl_version: "2.30.7-1"
nccl_tests_version: "v2.20.0"
efa_version: "1.49.0"
efa_version: "latest"
gdrcopy_version: "2.6"
max_jobs: "8"
dlc_major_version: "1"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/pytorch/2.14-ec2-cuda.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ build:
transformer_engine_version: "2.18.0"
nccl_version: "2.30.7-1"
nccl_tests_version: "v2.20.0"
efa_version: "1.50.0"
efa_version: "latest"
gdrcopy_version: "2.6"
max_jobs: "8"
dlc_major_version: "1"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/pytorch/2.14-sagemaker-cuda.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ build:
transformer_engine_version: "2.18.0"
nccl_version: "2.30.7-1"
nccl_tests_version: "v2.20.0"
efa_version: "1.50.0"
efa_version: "latest"
gdrcopy_version: "2.6"
max_jobs: "8"
dlc_major_version: "1"
Expand Down
1 change: 1 addition & 0 deletions .github/config/image/ray-llm/ec2-gpu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@ metadata:
build:
dockerfile: "docker/ray_llm/Dockerfile.cuda"
target: "ec2"
efa_version: "latest"
builder_base_image: "public.ecr.aws/deep-learning-containers/base:devel-cu130-amzn2023"
base_image: "public.ecr.aws/deep-learning-containers/base:runtime-cu130-amzn2023"
python_version: "3.13.12"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/ray-train/ec2-gpu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ build:
torch_version: "2.13.0"
transformer_engine_version: "2.13.0"
flash_attn_version: "2.8.3"
efa_version: "1.49.0"
efa_version: "latest"
gdrcopy_version: "2.4.4"
nccl_tests_version: "2.19.6"
max_jobs: "8"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/sglang/ec2-amzn2023.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ build:
torch_version: "2.13.0"
nccl_version: "2.31.2"
cudnn_version: "9.16.0.29"
efa_version: "1.50.0"
efa_version: "latest"
rust_version: "1.96.1"
gdrcopy_version: "2.5.2"
torch_cuda_arch_list: "9.0;10.0;10.3"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/sglang/ec2-ubuntu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ build:
base_image: "lmsysorg/sglang:v0.5.20"
python_version: "3.12"
cuda_version: "13.0.3"
efa_version: "1.50.0"
efa_version: "latest"
dlc_major_version: "1"
dlc_minor_version: "0"
release:
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/sglang/sagemaker-amzn2023.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ build:
torch_version: "2.13.0"
nccl_version: "2.31.2"
cudnn_version: "9.16.0.29"
efa_version: "1.50.0"
efa_version: "latest"
rust_version: "1.96.1"
gdrcopy_version: "2.5.2"
torch_cuda_arch_list: "9.0;10.0;10.3"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/sglang/sagemaker-ubuntu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ build:
base_image: "lmsysorg/sglang:v0.5.20"
python_version: "3.12"
cuda_version: "13.0.3"
efa_version: "1.50.0"
efa_version: "latest"
dlc_major_version: "1"
dlc_minor_version: "0"
release:
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/tensorflow/2.21-training-sagemaker-cuda.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ build:
cuda_version: "12.9.1"
tf_version: "2.21.0"
open_mpi_version: "4.1.8"
efa_version: "1.49.0"
efa_version: "latest"
dlc_major_version: "1"

release:
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/vllm-omni/ec2-amzn2023.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ build:
vllm_omni_version: "0.29.0rc1"
flashinfer_version: "0.6.18"
deepep_commit_hash: "874779c9ccd2294b56304bd6cc5f138f1f71d097"
efa_version: "1.50.0"
efa_version: "latest"
torch_cuda_arch_list: "7.5;8.0;8.6;8.9;9.0;10.0;11.0;12.0"
install_kv_connectors: "true"
dlc_major_version: "1"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/vllm-omni/sagemaker-amzn2023.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ build:
vllm_omni_version: "0.29.0rc1"
flashinfer_version: "0.6.18"
deepep_commit_hash: "874779c9ccd2294b56304bd6cc5f138f1f71d097"
efa_version: "1.50.0"
efa_version: "latest"
torch_cuda_arch_list: "7.5;8.0;8.6;8.9;9.0;10.0;11.0;12.0"
install_kv_connectors: "true"
dlc_major_version: "1"
Expand Down
1 change: 1 addition & 0 deletions .github/config/image/vllm/ec2-amzn2023.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ metadata:
build:
dockerfile: "docker/vllm/Dockerfile.amzn2023"
target: "vllm-ec2-amzn2023"
efa_version: "latest"
python_version: "3.12"
cuda_version: "13.0.2"
vllm_ref: "ec4a3a537068db40afbc9374a67da719c8c9b964"
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/vllm/ec2-ubuntu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ build:
base_image: "vllm/vllm-openai:v0.30.0"
python_version: "3.12"
cuda_version: "13.0.2"
efa_version: "1.50.0"
efa_version: "latest"
dlc_major_version: "1"
dlc_minor_version: "0"
release:
Expand Down
1 change: 1 addition & 0 deletions .github/config/image/vllm/sagemaker-amzn2023.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@ metadata:
build:
dockerfile: "docker/vllm/Dockerfile.amzn2023"
target: "vllm-sagemaker-amzn2023"
efa_version: "latest"
python_version: "3.12"
cuda_version: "13.0.2"
# Kept in lockstep with ec2-amzn2023.yml -- same Dockerfile.
Expand Down
2 changes: 1 addition & 1 deletion .github/config/image/vllm/sagemaker-ubuntu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ build:
base_image: "vllm/vllm-openai:v0.30.0"
python_version: "3.12"
cuda_version: "13.0.2"
efa_version: "1.50.0"
efa_version: "latest"
dlc_major_version: "1"
dlc_minor_version: "0"
release:
Expand Down
8 changes: 5 additions & 3 deletions docker/base/cu129/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,8 @@ RUN ln -sf /usr/local/bin/python${PYTHON_SHORT_VERSION} /usr/local/bin/python3 \
&& ln -sf /usr/local/bin/pip${PYTHON_SHORT_VERSION} /usr/local/bin/pip

ARG CACHE_REFRESH=0
RUN dnf install -y --allowerasing --setopt=install_weak_deps=False curl \
RUN echo "cache refresh: ${CACHE_REFRESH}" \
&& dnf install -y --allowerasing --setopt=install_weak_deps=False curl \
&& dnf upgrade -y --security --releasever latest \
&& dnf clean all && rm -rf /var/cache/dnf

Expand Down Expand Up @@ -139,8 +140,9 @@ RUN ln -sf /usr/local/bin/python${PYTHON_SHORT_VERSION} /usr/local/bin/python3 \
&& ln -sf /usr/local/bin/pip${PYTHON_SHORT_VERSION} /usr/local/bin/pip

ARG CACHE_REFRESH=0
RUN dnf install -y --allowerasing --setopt=install_weak_deps=False \
curl automake autoconf cmake gcc gcc-c++ git make tar \
RUN echo "cache refresh: ${CACHE_REFRESH}" \
&& dnf install -y --allowerasing --setopt=install_weak_deps=False \
curl automake autoconf cmake gcc gcc-c++ git make tar \
&& dnf upgrade -y --security --releasever latest \
&& dnf clean all && rm -rf /var/cache/dnf

Expand Down
Loading
Loading