Repository navigation
[Feature Request]: Support pandas 3+ in the dataframes API #40709
Description
What would you like to happen?
Beam is hard-capped at pandas 2.3.3 because the dataframes module is not currently compatible with pandas 3+. This will limit support for pandas in Python versions after 3.14 and the upgrade should be scoped out for viability.
Issue Priority
Priority: 2 (default / most feature requests should be filed as P2)
Issue Components
- Component: Python SDK
- Component: Java SDK
- Component: Go SDK
- Component: Typescript SDK
- Component: IO connector
- Component: Beam YAML
- Component: Beam examples
- Component: Beam playground
- Component: Beam katas
- Component: Website
- Component: Infrastructure
- Component: Spark Runner
- Component: Flink Runner
- Component: Prism Runner
- Component: Twister2 Runner
- Component: Hazelcast Jet Runner
- Component: Google Cloud Dataflow Runner
Activity
alisha-1000 commentedon Oct 23, 2026
Hi @jrmccluskey,
I'd be interested in investigating the feasibility of supporting pandas 3+ in Beam's DataFrames API.
I plan to start by identifying the current pandas version constraints, reviewing the DataFrames API for deprecated or incompatible pandas usage, and running the relevant test suites against pandas 3.x to identify concrete compatibility failures. Based on those findings, I can assess the scope of the required changes and outline a backward-compatible implementation approach.
Would this investigation be helpful? I'm happy to share the findings before proceeding with any broader changes.
dhanusharer commentedon Oct 24, 2026
.take-issue