Python: Audit integration-test markers and behavior-focused coverage #9632

Maintainer-owned issue. Community contributors: please do not pick up or start implementing this issue.

Category

Build or CI

Problem

External-service tests do not consistently pair the integration marker with provider-specific credential or infrastructure skips, and flaky is sometimes applied at module scope without confirming that every test is genuinely nondeterministic or service-sensitive. Some tests also assert private implementation details instead of observable behavior.

Evidence

The audit found marker-related patterns across about 80 files. Existing integration workflow guidance requires synchronized updates to python-merge-tests.yml and python-integration-tests.yml when provider jobs change.

Desired Outcome

Inventory external-service tests, add required integration and provider skip markers, retain flaky only where justified, move tests toward observable contracts, and keep both integration workflow definitions synchronized.

Language

Python

Acknowledgements

• I searched existing issues and did not find a duplicate.
• I will wait for explicit maintainer agreement before starting implementation of a non-trivial change.

Ownership: Core maintainers only; not available for community pickup.