Skip to content

sched, ggml-meta : pipeline the host KV delivery under split mode tensor - #8

Open
Piggidragon wants to merge 3 commits into
stack/kv-transport-basefrom
kv/pipelined-transport-tensor-split
Open

sched, ggml-meta : pipeline the host KV delivery under split mode tensor#8
Piggidragon wants to merge 3 commits into
stack/kv-transport-basefrom
kv/pipelined-transport-tensor-split

docs : measure the pipelined transport under split mode tensor

0f0f11e
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar