Skip to content

Keep the attention sink and ring caches when the KV cache is quantized - #24473

Open
pssrawat wants to merge 1 commit into
pytorch:mainfrom
pssrawat:export-D126929701
Open

Keep the attention sink and ring caches when the KV cache is quantized#24473
pssrawat wants to merge 1 commit into
pytorch:mainfrom
pssrawat:export-D126929701

Keep the attention sink and ring caches when the KV cache is quantized

d8d4226
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 errors and 1 warning
Job log options

This job was cancelled