Skip to content

protocol: query shared Delta table metadata - #106

Draft
littlegrasscao wants to merge 1 commit into
server/split2/15-protocol-get-tablefrom
server/split2/16-protocol-table-metadata
Draft

littlegrasscao wants to merge 1 commit into
server/split2/15-protocol-get-tablefrom
server/split2/16-protocol-table-metadata

Conversation

@littlegrasscao

@littlegrasscao littlegrasscao commented Sep 26, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • add Delta Sharing GET /shares/{share}/schemas/{schema}/tables/{table}/metadata to OpenSharingProtocolService
  • return NDJSON (protocol then metaData) with Delta-Table-Version and the delta-sharing-capabilities format actually used
  • parquet format by default; responseformat=delta (preferred whenever listed) wraps Kernel's protocol and metadata as deltaProtocol / deltaMetadata
  • support optional version or timestamp (mutually exclusive); latest when neither is set
  • resolve explicit table shares and tables discovered through a shared schema, reading the Delta log with credentials the catalog vends to the share owner
  • reject unknown capability keys or response formats as INVALID_PARAMETER_VALUE

Testing

  • mvn clean install: 154 tests passed
  • ProtocolTableMetadataTest reads real Delta logs written to a temp directory (shared with the version test through LocalDeltaTableSupport): parquet and delta formats, historical version and timestamp, invalid capabilities, mutually exclusive parameters, version past the latest, ungranted share
  • ProtocolTableMetadataIntegrationTest ran against the AWS test tables, including the deletion-vectors table (skipped without credentials)
  • unit tests for DeltaSharingCapabilities and TableActions

Stacked on #105.

@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch 3 times, most recently from fb17164 to 273079c Compare September 28, 2026 21:55
@littlegrasscao
littlegrasscao marked this pull request as ready for review September 28, 2026 22:53
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from f44f259 to 64a4e40 Compare September 29, 2026 18:35
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from 4460d77 to 35e669c Compare September 29, 2026 22:05
@littlegrasscao
littlegrasscao marked this pull request as draft October 7, 2026 01:57
@littlegrasscao littlegrasscao changed the title server: query shared Delta table metadata protocol: query shared Delta table metadata Oct 9, 2026
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from f946362 to 72b71de Compare October 14, 2026 01:31
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from 72b71de to a062774 Compare October 14, 2026 02:07
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from a062774 to d2bb466 Compare October 14, 2026 19:25
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from d2bb466 to 94219aa Compare October 15, 2026 16:47
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from 94219aa to 1cea07b Compare October 15, 2026 18:14
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from 1cea07b to 77a0199 Compare October 15, 2026 18:29
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from 77a0199 to d858fb8 Compare October 15, 2026 23:35
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from d858fb8 to 1f9cd94 Compare October 15, 2026 23:38
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from 1f9cd94 to f51c521 Compare October 15, 2026 23:54
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from f51c521 to 916e1cb Compare October 16, 2026 00:18
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from 916e1cb to cacb334 Compare October 16, 2026 00:41
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from cacb334 to f560c6f Compare October 19, 2026 17:13
@zhu-tom
zhu-tom added this pull request to stack #116 October 19, 2026 19:06
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from f560c6f to 05dbb52 Compare October 19, 2026 21:44
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from 05dbb52 to 30668ca Compare October 19, 2026 22:35
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from 30668ca to 6f6c73d Compare October 19, 2026 22:37
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch 2 times, most recently from d6ed049 to 2d7cc77 Compare October 21, 2026 17:01
@littlegrasscao
littlegrasscao force-pushed the server/split2/16-protocol-table-metadata branch from 2d7cc77 to 26b91ba Compare October 21, 2026 19:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant