[OMNIML-6060] [2/3] Load an MoE expert-parallel: shard the experts at load time - #3136

[OMNIML-6060] [2/3] Load an MoE expert-parallel: shard the experts at load time#3136

shengliangxu wants to merge 23 commits into

shengliangx/hfep-base-6a-ep-loaderNVIDIA/Model-Optimizer:shengliangx/hfep-base-6a-ep-loaderfrom

shengliangx/hfep-6a2-ep-loader-coreNVIDIA/Model-Optimizer:shengliangx/hfep-6a2-ep-loader-coreCopy head branch name to clipboard