From b466ff7254d735a9e4b5d9f83e2a138b65bf4ac6 Mon Sep 17 00:00:00 2001 From: Gidon Gershinsky Date: Wed, 2 Sep 2026 15:07:18 +0300 Subject: [PATCH 1/4] add spaces --- parquet-hadoop/README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/parquet-hadoop/README.md b/parquet-hadoop/README.md index 51fd34b0c9..18dbe253dc 100644 --- a/parquet-hadoop/README.md +++ b/parquet-hadoop/README.md @@ -469,12 +469,12 @@ If `false`, write files in encrypted footer mode, that fully encrypts the footer --- -**Property:** `parquet.encryption.kms.enable.url.read` +**Property:** `parquet.encryption.kms.enable.url.read` **Description:** If a KMS URL is set by writers, it will be stored in the key material. However, by default, it will not be given to readers because the storage is untrusted. Readers that need the URL should set the KMS URL property. If they cannot do so, they can enable retrieving the KMS URL from the stored key material by setting this parameter to `true`. KMS client implementations must validate the URL value and use authentication to prevent key material -tampering attacks that could, for example, result in a KMS access token being sent to a malicious URL endpoint. +tampering attacks that could, for example, result in a KMS access token being sent to a malicious URL endpoint. **Default value:** `false` --- From 43443b7c3e89c2544b73336033bfe599a00e7bc1 Mon Sep 17 00:00:00 2001 From: Gidon Gershinsky Date: Wed, 2 Sep 2026 15:22:15 +0300 Subject: [PATCH 2/4] rm duplicate, fix additional parameters --- parquet-hadoop/README.md | 28 +++++++++++----------------- 1 file changed, 11 insertions(+), 17 deletions(-) diff --git a/parquet-hadoop/README.md b/parquet-hadoop/README.md index 18dbe253dc..a6c1f1bda2 100644 --- a/parquet-hadoop/README.md +++ b/parquet-hadoop/README.md @@ -222,7 +222,7 @@ conf.set("parquet.bloom.filter.enabled#column.path", false); If it is true, the bloom filter will be generated with the optimal bit size according to the number of real data distinct values. If it is false, it will not take effect. Note that the maximum bytes of the bloom filter will not exceed `parquet.bloom.filter.max.bytes` configuration (if it is -set too small, the generated bloom filter will not be efficient). +set too small, the generated bloom filter will not be efficient). **Default value:** `false` --- @@ -230,7 +230,7 @@ set too small, the generated bloom filter will not be efficient). **Property:** `parquet.bloom.filter.candidates.number` **Description:** The number of candidate bloom filters written at the same time. When `parquet.bloom.filter.adaptive.enabled` is true, multiple candidate bloom filters will be inserted -at the same time, finally a bloom filter with the optimal bit size will be selected and written to the file. +at the same time, finally a bloom filter with the optimal bit size will be selected and written to the file. **Default value:** `5` --- @@ -268,13 +268,13 @@ conf.set("parquet.bloom.filter.fpp#column.path", 0.02) **Property:** `parquet.decrypt.off-heap.buffer.enabled` **Description:** Whether to use direct buffers to decrypt encrypted files. This should be set to -true if the reader is using a `DirectByteBufferAllocator` +true if the reader is using a `DirectByteBufferAllocator` **Default value:** `false` --- -**Property:** `parquet.block.row.count.limit` -**Description:** The maximum number of rows per row group. +**Property:** `parquet.block.row.count.limit` +**Description:** The maximum number of rows per row group. **Default value:** `2147483647` (Integer.MAX_VALUE) --- @@ -288,12 +288,6 @@ true if the reader is using a `DirectByteBufferAllocator` **Description:** Whether to write out page level checksums. **Default value:** `true` ---- - -**Property:** `parquet.crypto.factory.class` -**Description:** Class implementing EncryptionPropertiesFactory. -**Default value:** None. If not set, the file won't be encrypted by a crypto factory. - ## Class: ParquetInputFormat **Property:** `parquet.read.support.class` @@ -406,7 +400,7 @@ ParquetInputFormat to materialize records. It should be a the descendant class o ## Class: HadoopReadOptions **Property:** `parquet.crypto.factory.class` -**Description:** Class implementing DecryptionPropertiesFactory. +**Description:** Class implementing DecryptionPropertiesFactory. **Default value:** None. If not set, the file won't be decrypted by a crypto factory. ## Class: PropertiesDrivenCryptoFactory @@ -520,16 +514,16 @@ If `false`, key material is stored in separate new files, created in the same fo **Property:** `parquet.hadoop.vectored.io.enabled` **Description:** Flag to enable use of the FileSystem Vector IO API on Hadoop releases which support the feature. If `true` then an attempt will be made to dynamically load the relevant classes; -if not found then the library will use the classic non-vectored reads: it is safe to enable this option on older releases. +if not found then the library will use the classic non-vectored reads: it is safe to enable this option on older releases. **Default value:** `true` --- -**Property:** `parquet.column.statistics.enabled` +**Property:** `parquet.column.statistics.enabled` **Description:** Whether to enable column statistics collection. If `true`, statistics will be collected for all columns unless explicitly disabled for specific columns. If `false`, statistics will be disabled for all columns regardless of column-specific settings. -It is possible to enable or disable statistics for specific columns by appending `#` followed by the column path. +It is possible to enable or disable statistics for specific columns by appending `#` followed by the column path. **Default value:** `true` **Example:** ```java @@ -542,8 +536,8 @@ conf.set("parquet.column.statistics.enabled#column.path", false); --- -**Property:** `parquet.size.statistics.enabled` -**Description:** Whether to enable size statistics collection. +**Property:** `parquet.size.statistics.enabled` +**Description:** Whether to enable size statistics collection. If `true`, size statistics will be collected for all columns unless explicitly disabled for specific columns. If `false`, size statistics will be disabled for all columns regardless of column-specific settings. It is possible to enable or disable size statistics for specific columns by appending `#` followed by the column path. From 005ac3a7ef469e3647fe439c3fc4f32f4122cfa6 Mon Sep 17 00:00:00 2001 From: Gidon Gershinsky Date: Wed, 2 Sep 2026 15:28:12 +0300 Subject: [PATCH 3/4] 2 more --- parquet-hadoop/README.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/parquet-hadoop/README.md b/parquet-hadoop/README.md index a6c1f1bda2..19a50ff4f6 100644 --- a/parquet-hadoop/README.md +++ b/parquet-hadoop/README.md @@ -176,7 +176,7 @@ If the frequency is low, the performance will be better. --- **Property:** `parquet.page.value.count.threshold` -**Description:** The value count threshold within a Parquet page used on each page check. +**Description:** The value count threshold within a Parquet page used on each page check. **Default value:** `Integer.MAX_VALUE / 2` --- @@ -524,7 +524,7 @@ if not found then the library will use the classic non-vectored reads: it is saf If `true`, statistics will be collected for all columns unless explicitly disabled for specific columns. If `false`, statistics will be disabled for all columns regardless of column-specific settings. It is possible to enable or disable statistics for specific columns by appending `#` followed by the column path. -**Default value:** `true` +**Default value:** `true` **Example:** ```java // Enable statistics for all columns @@ -540,8 +540,8 @@ conf.set("parquet.column.statistics.enabled#column.path", false); **Description:** Whether to enable size statistics collection. If `true`, size statistics will be collected for all columns unless explicitly disabled for specific columns. If `false`, size statistics will be disabled for all columns regardless of column-specific settings. -It is possible to enable or disable size statistics for specific columns by appending `#` followed by the column path. -**Default value:** `true` +It is possible to enable or disable size statistics for specific columns by appending `#` followed by the column path. +**Default value:** `true` **Example:** ```java // Enable size statistics for all columns From 7b752569ca15b1017a30011eba3cd3b686836953 Mon Sep 17 00:00:00 2001 From: Gidon Gershinsky Date: Thu, 3 Sep 2026 19:45:41 +0300 Subject: [PATCH 4/4] return duplicate --- parquet-hadoop/README.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/parquet-hadoop/README.md b/parquet-hadoop/README.md index 19a50ff4f6..cb4cf36225 100644 --- a/parquet-hadoop/README.md +++ b/parquet-hadoop/README.md @@ -288,6 +288,12 @@ true if the reader is using a `DirectByteBufferAllocator` **Description:** Whether to write out page level checksums. **Default value:** `true` +--- + +**Property:** `parquet.crypto.factory.class` +**Description:** Class implementing EncryptionPropertiesFactory. +**Default value:** None. If not set, the file won't be encrypted by a crypto factory. + ## Class: ParquetInputFormat **Property:** `parquet.read.support.class`