You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When writing logic for rewriting manifest files, it was found to be easy to hand partition specs around with the wrong schema reference: #2367 (comment)
This issue proposes to bind a PartitionSpec to a schema, such as by holding a reference to the Schema. Or, a better approach if there is one.
Ultimately, rough idea:
Add schema to PartitionSpec
Update SnapshotSummaryCollector's APIs: schema should be inferred from partition spec, not passed in
Activity
dannycjones commentedon May 29, 2026
FYI @CTTY I found this PR removing a type similar to the one we're proposing here: #771
I will dig a bit more into that PR to understand the reasoning.