Skip to content

[Python][RunInference] Add prefix-aware batching across workers - #40905

Open
AMOOOMA wants to merge 1 commit into
apache:masterfrom
AMOOOMA:pr-prefix-batching
Open

AMOOOMA wants to merge 1 commit into
apache:masterfrom
AMOOOMA:pr-prefix-batching

[RunInference] Add prefix-aware batching across workers

07aac31
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings and 1 notice
label
succeeded Oct 30, 2026 in 13s