Skip to content

Long-context fixes: RoPE precision + Gemma chunked-prefill sliding-window cache - #688

Closed
ncylich wants to merge 2 commits into
long-ctx-attnfrom
longctx-rope-gemma-fix
Closed

Long-context fixes: RoPE precision + Gemma chunked-prefill sliding-window cache#688
ncylich wants to merge 2 commits into
long-ctx-attnfrom
longctx-rope-gemma-fix

Fix chunked-prefill sliding-window KV cache corruption

5652ab6
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar