Commit 2ac64b7
committed
feat(dqe): multi-node Iceberg split dispatch with round-robin assignment
- Add assignSplitsToNodes() in IcebergFragmenter for round-robin
split-to-node assignment across data nodes
- Replace executeAndMergeSplits() with dispatchIcebergSplits() +
mergeIcebergResults() in TransportTrinoSqlAction
- Local fast path when allLocal=true (single-node, no serialization)
- Transport dispatch via sendRequest when multi-node
- Verified on 2-node cluster: 8/10 queries PASS, 2 timeout (perf)1 parent c61ae4e commit 2ac64b7
2 files changed
Lines changed: 471 additions & 75 deletions
File tree
- dqe/src/main/java/org/opensearch/sql/dqe
- coordinator/transport
- iceberg
0 commit comments