Skip to content

[GSoC 2025] Beam ML Integration Tracking: Vector DB, Feature Store, and Embedding Generator #35046

Closed as not planned
Closed as not planned
[GSoC 2025] Beam ML Integration Tracking: Vector DB, Feature Store, and Embedding Generator#35046
Labels
stale

Description

@moawnallah
moawnallah
opened on May 25, 2025

Upstream

🔗 Apache JIRA: GSOC-279
🔗 GSoC 2025 - Project Page

Mentor

Mentor: Danny McCormick
GitHub Handle: @damccorm

Legend

  • ⬜: Not started yet
  • ⚪: Feedback — not yet addressed
  • 🏗️: Created
  • ⏳: In review
  • ✅: Merged

Milestone 0 – Community Engagement (Google CloudSQL Integration)

Status Period Activity Role Artifact
🏗️ Community Bonding Share GSoC 2025 selection and project goals with Beam developer community Author
✅ Community Bonding Add Google CloudSQL Enrichment Handler Author PR #34398
✅ Community Bonding Support Enrichment for Unmanaged PostgreSQL Author PR #34398
✅ Community Bonding Support Enrichment for Unmanaged MySQL Author PR #34398
✅ Community Bonding Support Enrichment for Unmanaged Microsoft SQL Server Author PR #34398
✅ Community Bonding Unit Test Google CloudSQL Enrichment Handler Author PR #34398
✅ Community Bonding Integrate Test Google CloudSQL Enrichment Handler Author PR #34398
✅ Community Bonding Add Release Note for the new Google CloudSQL Enrichment Handler Integration Author PR #34398
⏳ Community Bonding Update the Enrichment Documentation to include CloudSQL Enrichment Handler integration Author PR #35473
⏳ Community Bonding Add Python Example for Google CloudSQL (Managed PostgreSQL) Enrichment to the Documentation Author PR #35473
⏳ Community Bonding Add Python Example for Unmanaged PostgreSQL Enrichment to the Documentation Author PR #35473
⏳ Community Bonding Add Python Example for Unmanaged MySQL Enrichment to the Documentation Author PR #35473
⏳ Community Bonding Add Python Example for Unmanaged Microsoft SQL Server Enrichment to the Documentation Author PR #35473

Milestone 1 — Design Doc for Milvus Search Enrichment Handler Integration

Status Period Activity Role Artifact
🏗️ May 26 - May 30 Write Design Document for Milvus Enrichment Handler Author Proposal
🏗️ May 26 - May 30 Share Design Document on Beam Dev Mailing List for Feedback Communicator Mail

Milestone 2 – Implementation of Milvus Search Enrichment Handler

Status Period Activity Role Artifact
✅ May 31 - Jun 13 Add Milvus Search Enrichment Handler [Vector, Keyword, Hybrid] Author PR #35216
✅ May 31 - Jun 13 Unit Test Milvus Search Enrichment Handler Author PR #35216
✅ May 31 - Jun 13 Integrate Test Milvus Search Enrichment Handler Author PR #35216
✅ May 31 - Jun 13 Review & Address (can be) Flaky Test Cases Author PR #35216
✅ May 31 - Jun 13 Add Release Note for the new Milvus Search Enrichment Handler Integration [Vector, Keyword, Hybrid] Author PR #35216
✅ May 31 - Jun 13 Make Milvus as extra dependency Author PR #35577
✅ May 31 - Jun 13 Mark Milvus itests as require_docker_in_docker to run ubuntu-latest Author PR #35577
⏳ May 31 - Jun 13 Update the Enrichment Documentation to include Milvus Search Enrichment Handler integration Author PR #35467
⏳ May 31 - Jun 13 Add Python Example for Milvus Search Enrichment to the Documentation Author PR #35467
⏳ May 31 - Jun 13 Add Jupyter Notebook Example for Milvus Enrichment Transform Author PR #35467
⏳ May 31 - Jun 13 Add Release Note for the added documentation and examples for Milvus enrichment transform Author PR #35467

Milestone 3 – Design Doc for Milvus Search Sink I/O Connector

Status Period Activity Role Artifact
⏳ Jun 14 - Jul 1 Any backlog from previous milestone(s) Author –
🏗️ Jul 2 - Jul 18 Write Design Document for Milvus Sink I/O Connector Author Proposal
🏗️ Jul 2 - Jul 18 Share Design Document on Beam Dev Mailing List for Feedback Communicator Mail

Milestone 4 – Implementation of Milvus Search Sink I/O Connector

Status Period Activity Role Artifact
⏳ Jun 19 - Jul 26 Any backlog from previous milestone(s) Author –
⏳ Jul 27 - Aug 8 Add Milvus Search Sink I/O Connector Author PR #35708
⏳ Jul 27 - Aug 8 Unit Test Milvus Search Sink I/O Connector Author PR #35708
⏳ Jul 27 - Aug 8 Integrate Test Milvus Search Sink I/O Connector Author PR #35708
⏳ Jul 27 - Aug 8 Review & Address (can be) Flaky Test Cases (if any) Author PR #35708
⏳ Jul 27 - Aug 8 Add Release Note for the new Milvus Search Sink I/O Connector Integration Author PR #35708
⏳ Jul 27 - Aug 8 Update the Managed I/O Connectors Documentation to include Milvus Search Sink I/O Connector Integration Author PR #35944
⏳ Jul 27 - Aug 8 Add Python Example for Milvus Sink I/O Connector to the Documentation Author PR #35944
⏳ Jul 27 - Aug 8 Add Milvus Sink I/O Connector Integration to Beam I/O Connectors Built-in Catalog Author PR #35944
⏳ Jul 27 - Aug 8 Add Jupyter Notebook Example for Milvus Search Sink I/O Connector Author PR #35944
⏳ Jul 27 - Aug 8 Add Release Note for the added documentation and notebook example for Milvus sink I/O connector Author PR #35944

Milestone 5 – Design Doc for Feast Feature Store Sink I/O Connector

Milestone 6 – Implementation of Feast Feature Store Sink I/O Connector

Milestone 7 – Design Doc for Feast Feature Store Enrichment Handler

Milestone 8 – Implementation of Feast Feature Store Enrichment Handler

Milestone 9 – Review Work

Nice to Have

Activity

  1. moawnallah
    changed the title [-][Beam ML][GSoC 2025] Integration Tracking: Vector DB, Feature Store, and Embedding Generator[/-] [+][GSoC 2025] Beam ML: Vector DB, Feature Store, and Embedding Generator[/+] on May 25, 2025
  2. moawnallah
    changed the title [-][GSoC 2025] Beam ML: Vector DB, Feature Store, and Embedding Generator[/-] [+][GSoC 2025] Beam ML: Vector DB, Feature Store, and Embedding Gen[/+] on May 25, 2025
  3. moawnallah
    changed the title [-][GSoC 2025] Beam ML: Vector DB, Feature Store, and Embedding Gen[/-] [+][GSoC 2025] Beam ML: VectorDB, FeatureStore, and EmbeddingGen[/+] on May 25, 2025
  4. moawnallah
    changed the title [-][GSoC 2025] Beam ML: VectorDB, FeatureStore, and EmbeddingGen[/-] [+][GSoC 2025] Beam ML: VectorDB, FeatureStore, & EmbeddingGen[/+] on May 25, 2025
  5. moawnallah
    changed the title [-][GSoC 2025] Beam ML: VectorDB, FeatureStore, & EmbeddingGen[/-] [+][GSoC 2025] Beam ML: VectorDB, FeatureStore, and EmbeddingGenerator[/+] on May 25, 2025
  6. moawnallah
    changed the title [-][GSoC 2025] Beam ML: VectorDB, FeatureStore, and EmbeddingGenerator[/-] [+][GSoC 2025] Beam ML Integration Tracking: Vector DB, Feature Store, and Embedding Generator[/+] on May 25, 2025

  7. github-actions commented on Jan 20, 2026

    @github-actions
    github-actionsBot
    on Jan 20, 2026 – with GitHub Actions
    Contributor

    This issue has been marked as stale due to 150 days of inactivity. It will be closed in 30 days if no further activity occurs. If you think that’s incorrect or this issue still needs to be addressed, please simply write any comment. If closed, you can reopen the issue at any time. Thank you for your contributions.

  8. github-actions
    added
    stale
    on Jan 20, 2026

  9. github-actions commented on Feb 19, 2026

    @github-actions
    github-actionsBot
    on Feb 19, 2026 – with GitHub Actions
    Contributor

    This issue has been closed due to lack of activity. If you think that is incorrect, you can reopen the issue at any time.

  10. github-actions
    closed this as not plannedon Feb 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    stale

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions