Skip to content

Data, Spark 4.2: Add format model TCK coverage for vectorized reads #17610

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
joyhaldar wants to merge 10 commits into
base: main
Choose a base branch
from
+303 −77
Open

Data, Spark 4.2: Add format model TCK coverage for vectorized reads #17610

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
1e95954
Spark: Add format model TCK coverage for vectorized reads
joyhaldar Aug 27, 2026
e8b97ba
Spark 4.2: skip nested type tests via unsupportedTypeIds, move test t…
joyhaldar Oct 16, 2026
2240f75
Count rows via countRows hook so split and empty projection tests run…
joyhaldar Oct 16, 2026
d2cae98
Test recordsPerBatch for both batch and row readers
joyhaldar Oct 16, 2026
d01b937
Skip row lineage tests only for vectorized ORC, reference #18543
joyhaldar Oct 16, 2026
556ce35
Reword _deleted skip message and limit it to vectorized Parquet
joyhaldar Oct 16, 2026
0f643c1
Test container reuse for Spark vectorized Parquet reads
joyhaldar Oct 18, 2026
96db61e
Merge upstream/main into spark-vectorized-formatmodel-tck
joyhaldar Oct 19, 2026
04bc928
Skip unsupported geospatial types in Spark vectorized format tests
joyhaldar Oct 19, 2026
4346610
Address review feedback for Spark vectorized format tests
joyhaldar Oct 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion data/src/test/java/org/apache/iceberg/data/DataGenerator.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
import org.apache.iceberg.Schema;

/** Interface for generating test data with different schema types. */
interface DataGenerator {
public interface DataGenerator {

/** Returns the Iceberg schema for this test data. */
Schema schema();
Expand Down
4 changes: 2 additions & 2 deletions data/src/test/java/org/apache/iceberg/data/DataGenerators.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,9 +32,9 @@
* Test data generators for different schema types. Add new generators to ALL array to include them
* in format model tests.
*/
class DataGenerators {
public class DataGenerators {

static final DataGenerator[] ALL =
public static final DataGenerator[] ALL =
new DataGenerator[] {
new Primitives(),
new UUID(),
Expand Down
Loading
Loading