Skip to content

Fix the Top-K KD loss running out of memory at long sequences with large vocabularies - #3080

Merged
kevalmorabia97 merged 3 commits into
mainfrom
kmorabia/topk-kd-loss-memory
Oct 28, 2026
Merged

Fix the Top-K KD loss running out of memory at long sequences with large vocabularies#3080
kevalmorabia97 merged 3 commits into
mainfrom
kmorabia/topk-kd-loss-memory

Keep the Top-K KD loss working for empty batch or sequence inputs

685afb4
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 28, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO