Skip to content

sycl: 2-3x prompt processing speedup by dequantizing PTQ1_0 and PQ2_0 to FP16 - #278

Open
dwymark wants to merge 1 commit into
PrismML-Eng:prismfrom
dwymark:sycl-fp16-prompt-gemm
Open

sycl: 2-3x prompt processing speedup by dequantizing PTQ1_0 and PQ2_0 to FP16#278
dwymark wants to merge 1 commit into
PrismML-Eng:prismfrom
dwymark:sycl-fp16-prompt-gemm

sycl: dequantize PTQ1_0 and PQ2_0 prompt batches to FP16

1f16fba
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar