Skip to content

[Failing Test]: Milvus RAG integration tests fail consistently in beam_PreCommit_Python_ML (py3.13) #38945

Closed

Description

@tkaymak

What happened?

The Milvus RAG integration tests fail consistently on the beam_PreCommit_Python_ML workflow (observed on Python 3.13, on both ubuntu-latest and self-hosted runners). This does not look like an intermittent flake: the last 4 completed runs on master all failed.

Failing suites:

  • apache_beam.ml.rag.enrichment.milvus_search_it_test.TestMilvusSearchEnrichment (e.g. test_hybrid_search, test_empty_input_chunks, test_filtered_search_with_cosine_similarity_and_batching, test_invalid_query_on_non_existent_collection, ...)
  • apache_beam.ml.rag.ingestion.milvus_search_it_test.TestMilvusVectorWriterConfig (e.g. test_idempotent_write, test_write_with_batching, ...)

Several of the failures are 10-minute timeouts, which suggests the Milvus testcontainer fails to come up (or is unreachable) rather than an assertion-level regression.

Recent failing runs on master:

Also reproduced on unrelated PR runs, e.g. https://github.com/apache/beam/actions/runs/27417091271 (PR #38493, which touches no ML code).

Related: #31285 tracks general flakiness of this job; filing this separately since the Milvus suites currently fail on every run.

Issue Priority

Priority: 2 (default / most failing tests should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK

Activity

  1. linhongyu510 commented on Aug 31, 2026

    @linhongyu510

    This appears to have been resolved by merged PR #39007, which disabled xdist for the Milvus integration tests and explicitly applied the milvus run standalone container command. I also checked the 10 most recent scheduled beam_PreCommit_Python_ML runs on master; all 10 completed successfully (latest: run 33437814910). Suggest closing this issue if maintainers agree.

  2. added this to the 2.77.0 Release milestone on Sep 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions