Skip to content

feat(deepseek4): run the vision encoder on a second GPU and stream images into prefill - #758

Merged
davide221 merged 2 commits into
mainfrom
feat/ds4v-encoder-gpu
Sep 24, 2026
Merged

feat(deepseek4): run the vision encoder on a second GPU and stream images into prefill#758
davide221 merged 2 commits into
mainfrom
feat/ds4v-encoder-gpu

fix(deepseek4): keep exceptions inside the image stream thread

88e54cf
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar