Skip to content

Bump CI Megatron-Bridge to e42042fa8 and test Qwen3.5-VL bridge export with full NVFP4 #3125

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
kevalmorabia97 wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Bump CI Megatron-Bridge to e42042fa8 and test Qwen3.5-VL bridge export with full NVFP4 #3125

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/actions/megatron-from-source/action.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ description: >-
inputs:
commit:
description: Megatron-Bridge commit. Keep in sync with examples/megatron_bridge/README.md.
default: 0652ea797ab629e6451c64e1c92f976501b3b8b3
default: e42042fa83aed837ce6bc13480c06350ea091f1a

runs:
using: composite
Expand Down
2 changes: 1 addition & 1 deletion examples/megatron_bridge/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ Some features (e.g. [`--vllm_fakequant_export`](#evaluating-a-qad-checkpoint-in-
```bash
export MBRIDGE_DIR=${PWD}/Megatron-Bridge
git clone https://github.com/NVIDIA-NeMo/Megatron-Bridge.git ${MBRIDGE_DIR}
git -C ${MBRIDGE_DIR} checkout 0652ea797ab629e6451c64e1c92f976501b3b8b3
git -C ${MBRIDGE_DIR} checkout e42042fa83aed837ce6bc13480c06350ea091f1a
git -C ${MBRIDGE_DIR} submodule update --init 3rdparty/Megatron-LM
```

Expand Down
6 changes: 3 additions & 3 deletions tests/gpu_megatron/torch/export/test_quantized_mbridge_export.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -101,11 +101,11 @@ def bridge_workers(request):
[
(partial(create_tiny_llama_dir, with_tokenizer=True), "nvfp4"),
(partial(create_tiny_qwen3_dir, with_tokenizer=True), "fp8"),
# The bridge can't export quantized Mamba or GatedDeltaNet projections yet.
# The bridge can't export quantized Mamba projections yet.
(partial(create_tiny_nemotron_h_dir, with_tokenizer=True), "nvfp4_mlp_only"),
(partial(create_tiny_qwen3_5_moe_vl_dir, with_processor=True), "nvfp4_mlp_only"),
(partial(create_tiny_qwen3_5_moe_vl_dir, with_processor=True), "nvfp4"),
],
ids=["llama-nvfp4", "qwen3-fp8", "nemotron_h-nvfp4_mlp_only", "qwen3_5_moe_vl-nvfp4_mlp_only"],
ids=["llama-nvfp4", "qwen3-fp8", "nemotron_h-nvfp4_mlp_only", "qwen3_5_moe_vl-nvfp4"],
)
def test_matches_megatron_exporter(
dist_workers_size_1, bridge_workers, tmp_path, create_source, quant_cfg_name
Expand Down