Skip to content

[OMNIML-6062] Dequantize block-FP8 checkpoints as they load expert-parallel - #2743

Open
shengliangxu wants to merge 5 commits into
shengliangx/hfep-6b-ep-dense-shardingfrom
shengliangx/hfep-6c-fp8-dequant
Open

shengliangxu wants to merge 5 commits into
shengliangx/hfep-6b-ep-dense-shardingfrom
shengliangx/hfep-6c-fp8-dequant

Read a config.json that holds no JSON object as one that names no FP8…

939bf6e
Select commit
Loading
Failed to load commit list.