Repository navigation
Delta Sharing protocol: Query Table predicate and limit pushdown - #113
Draft
littlegrasscao wants to merge 1 commit into
Draft
littlegrasscao wants to merge 1 commit into
littlegrasscao wants to merge 1 commit into
Conversation
This was referenced Oct 5, 2026
Draft
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 7, 2026 00:44
16700d1 to
6bac9b1
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 7, 2026 01:12
dde54a7 to
8d9acdb
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 7, 2026 01:13
1172cf8 to
f79c4a4
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 7, 2026 01:56
8d9acdb to
f9fd14c
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 7, 2026 01:56
f79c4a4 to
0b6b3ea
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 7, 2026 17:27
f9fd14c to
27f5e9b
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 7, 2026 17:28
0b6b3ea to
fd4dfa1
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 14, 2026 17:26
27f5e9b to
87d4ec5
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 14, 2026 17:31
fd4dfa1 to
81ab161
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 14, 2026 19:25
87d4ec5 to
4df052f
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 14, 2026 19:25
81ab161 to
9ccea3e
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 15, 2026 16:47
4df052f to
1f0f218
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 15, 2026 16:47
9ccea3e to
9e15672
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 15, 2026 18:14
1f0f218 to
b35ac17
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 15, 2026 18:14
9e15672 to
77177a1
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 15, 2026 18:29
b35ac17 to
0b6b7d4
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 15, 2026 18:30
77177a1 to
5ec2957
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 15, 2026 23:35
0b6b7d4 to
2471df2
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 15, 2026 23:35
5ec2957 to
af34658
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 15, 2026 23:38
2471df2 to
a6e5aa5
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 15, 2026 23:38
af34658 to
7d57a1e
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 15, 2026 23:54
a6e5aa5 to
f592d4b
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 15, 2026 23:54
7d57a1e to
2e26c60
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 16, 2026 00:18
f592d4b to
40ea5dd
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 16, 2026 00:18
2e26c60 to
819be21
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 16, 2026 00:41
40ea5dd to
59f23fe
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 16, 2026 00:41
819be21 to
162317e
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 19, 2026 17:13
59f23fe to
3185340
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 19, 2026 17:13
162317e to
d82395a
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 19, 2026 21:44
3185340 to
1719cf1
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 19, 2026 21:44
d82395a to
f7be628
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 19, 2026 22:35
1719cf1 to
535b1a8
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 19, 2026 22:35
f7be628 to
76ed426
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 19, 2026 22:37
535b1a8 to
8f1537f
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 19, 2026 22:37
76ed426 to
d30057f
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 20, 2026 00:31
8f1537f to
afb8502
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 20, 2026 00:31
d30057f to
515fd94
Compare
littlegrasscao
force-pushed
the
server/split2/20-protocol-query-refresh
branch
from
October 21, 2026 19:21
afb8502 to
a874165
Compare
littlegrasscao
force-pushed
the
server/split2/21-protocol-query-pushdown
branch
from
October 21, 2026 19:25
515fd94 to
88e900b
Compare
littlegrasscao
added this pull request to stack #116
October 21, 2026 20:09
littlegrasscao
removed this pull request from stack #116
October 21, 2026 20:27
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
jsonPredicateHintsto a Kernel predicate forScanBuilder.withFilter, so Kernel prunes partitions and skips files by min/max statspredicateHintsare logged at debug and never filterlimitHintonly when no predicate hint is present, stopping once the returned files cover the limit (stats.numRecordsminus deletion vector cardinality)statsTesting
mvn clean install: 220 tests passedJsonPredicateHintsTest: every op and value type,and/or/not/isNull, bool leaves, the depth limit, and hints that are skippedDeltaTableQueryReaderTest: partition pruning, stats-based skipping, an unsupported hint, and thelimitHintcutoff on a local Delta log, with stub signing instead of MockitoProtocolTablePushdownIntegrationTest: limits and filters on the S3, Azure, and GCS test tables; each case is skipped without credentialsStacked on #110.