Repository navigation

Data, Spark 4.2: Add format model TCK coverage for vectorized reads - #17610

Open

joyhaldar wants to merge 10 commits into

apache:mainfrom

joyhaldar:spark-vectorized-formatmodel-tck

Open

Data, Spark 4.2: Add format model TCK coverage for vectorized reads#17610
joyhaldar wants to merge 10 commits into
apache:mainfrom
joyhaldar:spark-vectorized-formatmodel-tck

Commits on Oct 16, 2026
- Spark: Add format model TCK coverage for vectorized reads
  
  joyhaldar
  and
  Joy Haldar
  committed
  1e95954
- Spark 4.2: skip nested type tests via unsupportedTypeIds, move test to 4.2
  
  joyhaldar
  and
  Joy Haldar
  committed
  e8b97ba
- Count rows via countRows hook so split and empty projection tests run for batch readers
  
  joyhaldar
  and
  Joy Haldar
  committed
  2240f75
- Test recordsPerBatch for both batch and row readers
  
  joyhaldar
  and
  Joy Haldar
  committed
  d2cae98
- Skip row lineage tests only for vectorized ORC, reference #18543
  
  joyhaldar
  and
  Joy Haldar
  committed
  d01b937
- Reword _deleted skip message and limit it to vectorized Parquet
  
  joyhaldar
  and
  Joy Haldar
  committed
  556ce35
Commits on Oct 18, 2026
- Test container reuse for Spark vectorized Parquet reads
  
  joyhaldar
  and
  Joy Haldar
  committed
  0f643c1
Commits on Oct 19, 2026
- Merge upstream/main into spark-vectorized-formatmodel-tck
  
  joyhaldar
  and
  Joy Haldar
  committed
  96db61e
- Skip unsupported geospatial types in Spark vectorized format tests
  
  joyhaldar
  and
  Joy Haldar
  committed
  04bc928
Commits on Oct 21, 2026
- Address review feedback for Spark vectorized format tests
  
  joyhaldar
  and
  Joy Haldar
  committed
  4346610