Repository navigation
[Python] Add prefix-aware batching and capacity-based GPU autoscaling signal for vLLM RunInference - #40760
Draft
AMOOOMA wants to merge 2 commits into
Draft
[Python] Add prefix-aware batching and capacity-based GPU autoscaling signal for vLLM RunInference#40760AMOOOMA wants to merge 2 commits into
AMOOOMA wants to merge 2 commits into
Annotations
1 warning
|
.github/workflows/gemini_code_review.yml#L1
On December 2, 2026, GitHub will restrict `pull_request_target` on public repositories by default. To continue allowing the event trigger, configure an Actions policy. Learn more: https://gh.io/securely-using-pull_request_target#default-policy-for-pull_request_target
|
This job was skipped
Loading