Skip to content

--prefetch-experts-slots: lookahead H2D prefetch of host-resident MoE expert weights - #146

Closed
leshchukandrej wants to merge 1 commit into
Anbeeld:v0.4.5from
leshchukandrej:feat/prefetch-experts-slots
Closed

leshchukandrej wants to merge 1 commit into
Anbeeld:v0.4.5from
leshchukandrej:feat/prefetch-experts-slots

Commits

Commits on Sep 4, 2026