Skip to content

Improve layerwise GPTQ memory and speed: Hessian headroom, batch probe and offload fixes - #2945

Merged
cjluo-nv merged 6 commits into
mainfrom
chenjiel/gptq-hessian-headroom
Oct 27, 2026
Merged

Improve layerwise GPTQ memory and speed: Hessian headroom, batch probe and offload fixes#2945
cjluo-nv merged 6 commits into
mainfrom
chenjiel/gptq-hessian-headroom

Probe every GPU a layer kind runs on; count only allocatable cache

8c7a668
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 26, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO