Skip to content

Pull requests: deepspeedai/DeepSpeed

New pull request New
127 Open 3,575 Closed
127 Open 3,575 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix gemma4 num attention head bugs
#7975 opened Apr 15, 2026 by mingxiang1006 Loading…
1
[Blog] Muon Optimizer Support in DeepSpeed
#7962 opened Apr 8, 2026 by delock Collaborator Loading…
1
Add Gram Newton-Schulz orthogonalization for Muon optimizer
#7953 opened Apr 3, 2026 by delock Collaborator Loading…
4
Fix/warnings stacklevel mvapich runner
#7949 opened Apr 2, 2026 by nathon-lee Contributor • Draft
2
Refactor/torch autocast encapsulate global state
#7946 opened Apr 2, 2026 by nathon-lee Contributor Loading…
3
feat(zero2): add CPU offload support for Muon optimizer
#7939 opened Mar 31, 2026 by delock Collaborator Loading…
7
Add AutoEP
#7938 opened Mar 31, 2026 by tohtana Collaborator • Draft
8
Fix ZeRO-3 optimizer initialization validation (#7844)
#7929 opened Mar 28, 2026 by amadhan882 Loading…
1
9
[Feature] Enable AutoEP Compatibility with ZeRO-3
#7928 opened Mar 28, 2026 by nathon-lee Contributor Loading…
11
Add torch_xla TPU support for ZeRO-1/2
#7917 opened Mar 21, 2026 by PKUWZP Collaborator Loading…
18
fix: add setup_context for torch.func compatibility
#7916 opened Mar 21, 2026 by roycho96 Loading…
1
26
doc: Remove suggestion to build extensions in parallel
#7899 opened Mar 12, 2026 by Flamefire Contributor Loading…
1
5
[Bugfix] Validate fp16.loss_scale is finite in DeepSpeedFP16Config
#7892 opened Mar 8, 2026 by s-zx Loading…
1
8
Fix Stage 0 + Ulysses crash: make bwc_tensor_model_parallel_rank() resilient to MP API absence
#7888 opened Mar 6, 2026 by nathon-lee Contributor Loading…
3
fix(zero): Ensure full gradient reduction for Muon optimizer with reduce_scatter
#7878 opened Feb 27, 2026 by nathon-lee Contributor Loading…
1
2
fix: correct DistributedAttention output shape and pad uneven sequence lengths (#7842)
#7868 opened Feb 22, 2026 by harshang03 • Draft
1
1
fix: keep fp32-pinned parameters out of the bf16 cast path in ZeRO-3 (#7747)
#7867 opened Feb 22, 2026 by harshang03 • Draft
1
Revert "fix: remove premature MPI environment variable check in OpenMPIRunner"
#7864 opened Feb 21, 2026 by mikloorbi-sys • Draft
1
Fix global .cuh ignore and enforce tracked CUDA headers
#7858 opened Feb 18, 2026 by harshang03 • Draft
1
Fix ZeRO legacy grad-hook crash when next_functions is missing
#7857 opened Feb 17, 2026 by harshang03 • Draft
1
Reject non-finite fp16 loss_scale across config and ZeRO paths
#7856 opened Feb 17, 2026 by harshang03 • Draft
1
Fix zero/division safety gaps in utility and inference paths
#7855 opened Feb 17, 2026 by harshang03 • Draft
Fix count_used_parameters_in_backward crash on PyTorch < 2.3 (#7756)
#7849 opened Feb 12, 2026 by harshang03 • Draft
1
1
[BUG] Fix: Fix gradient norm calculation and dynamic shape blocking in PP+ZeRO1 collective communication
#7847 opened Feb 12, 2026 by Thinksky5124 Loading…
11
Fix subgroup optimizer metadata inconsistency
#7820 opened Jan 27, 2026 by st-bang97 Loading…
2
ProTip! Add no:assignee to see everything that’s not assigned.