Skip to content

[core] Validate DATE partition timestamps as dates - #10885

Closed
chenjian2664 wants to merge 1 commit into
apache:masterfrom
chenjian2664:chenjian2664/bytequay/fix-strict-date-partition-validation
Closed

chenjian2664 wants to merge 1 commit into
apache:masterfrom
chenjian2664:chenjian2664/bytequay/fix-strict-date-partition-validation

Conversation

@chenjian2664

Copy link
Copy Markdown
Contributor

Purpose

Fixes #10873.

Strict partition timestamp validation receives DATE values as epoch-day integers, so valid date-formatted partitions fail during writes. Convert DATE values to calendar dates before timestamp extraction, matching partition expiration.

Regression coverage includes ordinary append and primary-key tables, formatter/pattern combinations, pre-epoch dates, leap days, and mixed DATE/hour partitions with invalid-hour rejection.

Tests

@chenjian2664
chenjian2664 marked this pull request as ready for review October 30, 2026 05:59

@Akash3121 Akash3121 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@JingsongLi

Copy link
Copy Markdown
Contributor

I have now reviewed the earlier #10874 as well. Both PRs fix #10873, and their complete production implementations are identical apart from one explanatory comment. #10874 was opened first and already covers a real write/commit/read plus mismatched-formatter rejection.

This PR is technically correct: its 57 targeted write/partition-expiry/extractor tests passed under the normal JDK 8 Maven checks, and CI is green. However, it adds no independent production behavior beyond the earlier PR. Closing this duplicate so the fix stays in one place. Please contribute the useful append/primary-key, pre-epoch/leap-day and mixed-hour regression coverage to #10874 rather than maintain a second implementation.

@JingsongLi JingsongLi closed this Nov 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] partition.timestamp-format.strict rejects every DATE partition value

3 participants