Skip to content

[Python] Make remote inference retry tests deterministic - #40776

Draft
bvolpato wants to merge 1 commit into
apache:masterfrom
bvolpato:bvolpato/remote-inference-retry-test-throttling
Draft

bvolpato wants to merge 1 commit into
apache:masterfrom
bvolpato:bvolpato/remote-inference-retry-test-throttling

Conversation

@bvolpato

Copy link
Copy Markdown
Contributor

The remote-inference retry tests use a real stochastic throttler. Repeated fake failures can keep the test waiting until pytest times out, as seen in macOS Python 3.14 CI.

Mock throttling and backoff waits in the retry tests, while checking both retry exhaustion and successful recovery. Check the expected request error rather than accepting any pipeline exception.

Reproduced the hang with a forced throttle decision. The focused remote-inference and adaptive-throttler tests pass, along with Ruff and YAPF.

@github-actions github-actions Bot added python size/s S: 10-49 lines changed labels Oct 25, 2026
@codecov

codecov Bot commented Oct 25, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 79.90%. Comparing base (a8d6afd) to head (6a12d89).
⚠️ Report is 75 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master   #40776      +/-   ##
==========================================
- Coverage   80.04%   79.90%   -0.15%     
==========================================
  Files         490      493       +3     
  Lines       82916    83473     +557     
==========================================
+ Hits        66373    66697     +324     
- Misses      16543    16776     +233     
Flag Coverage Δ
python 79.90% <ø> (-0.15%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

python size/s S: 10-49 lines changed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant