Repository navigation

Core: update manifest delete file size after rewrite table action - #15470

Merged

amogh-jahagirdar merged 25 commits into

apache:mainfrom

mbutrovich:delete_file_size_after_rewrite

Jun 27, 2026

Merged

Core: update manifest delete file size after rewrite table action#15470
amogh-jahagirdar merged 25 commits into
apache:mainfrom
mbutrovich:delete_file_size_after_rewrite

Commits on Apr 15, 2026
Commits on Apr 24, 2026
- Create Spark 3.4, 3.5, 4.0 versions.
  mbutrovich
  committed
  57b3c43
Commits on May 6, 2026
- Merge branch 'main' into delete_file_size_after_rewrite
  mbutrovich
  committed
  5f4ac53
- Fix after upmerge with main.
  mbutrovich
  committed
  e66e0b7
Commits on May 12, 2026
- Dedupe concurrent rewrites of the same position delete file across manifest tasks to avoid FileAlreadyExistsException on the shared staging path.
  mbutrovich
  committed
  2b54f86
- Merge branch 'main' into delete_file_size_after_rewrite
  mbutrovich
  committed
  12db8c0
Commits on May 28, 2026
- Merge remote-tracking branch 'apache/main' into delete_file_size_after_rewrite
  mbutrovich
  committed
  850c1f4
- Address PR comments.
  mbutrovich
  committed
  81469d5
- Add test for position delete file in multiple snapshots.
  mbutrovich
  committed
  bfd6e65
Commits on Jun 3, 2026
- Merge branch 'main' into delete_file_size_after_rewrite
  mbutrovich
  committed
  550eb80
Commits on Jun 5, 2026
- Fix new test setup.
  mbutrovich
  committed
  3ffa406
Commits on Jun 12, 2026
- Merge branch 'main' into delete_file_size_after_rewrite
  mbutrovich
  committed
  89b181e
- Core, Spark: measure rewritten delete file size in a parallel phase to address PR feedback
  mbutrovich
  committed
  3ed7b95
Commits on Jun 22, 2026
- Merge branch 'main' into delete_file_size_after_rewrite
  mbutrovich
  committed
  ecb1070
- Core, Spark: dedupe DV rewrites by location and rename position-delete APIs per PR feedback
  mbutrovich
  committed
  bbbe466
Commits on Jun 24, 2026
- Merge remote-tracking branch 'apache/main' into delete_file_size_after_rewrite
  mbutrovich
  committed
  1f3679f
Commits on Jun 25, 2026
- Merge branch 'main' into delete_file_size_after_rewrite
  mbutrovich
  committed
  ec2484a

Navigation Menu

Repository navigation

Core: update manifest delete file size after rewrite table action - #15470

Core: update manifest delete file size after rewrite table action#15470
amogh-jahagirdar merged 25 commits into
apache:mainfrom
mbutrovich:delete_file_size_after_rewrite

Commits on Apr 15, 2026

Move position delete file rewriting into the manifest-writing Spark task, eliminating the separate `rewritePositionDeletes()` Spark job. Each manifest-writing task now also rewrites the delete file…

Fix API check?

Fix API check?

Address PR feedback 2 and 4.

Try to reduce revapi diff.

Try to reduce revapi diff.

rebased on upstream main

Address PR feedback.

Update revapi. Used ./gradlew :iceberg-core:revapiAcceptAllBreaks --justification "rewriteDeleteManifest signature changed to accept PositionDeleteReaderWriter for inline position delete rewriting;…

Commits on Apr 24, 2026

Create Spark 3.4, 3.5, 4.0 versions.

Commits on May 6, 2026

Merge branch 'main' into delete_file_size_after_rewrite

Fix after upmerge with main.

Commits on May 12, 2026

Dedupe concurrent rewrites of the same position delete file across manifest tasks to avoid FileAlreadyExistsException on the shared staging path.

Merge branch 'main' into delete_file_size_after_rewrite

Commits on May 28, 2026

Merge remote-tracking branch 'apache/main' into delete_file_size_after_rewrite

Address PR comments.

Add test for position delete file in multiple snapshots.

Commits on Jun 3, 2026

Merge branch 'main' into delete_file_size_after_rewrite

Commits on Jun 5, 2026

Fix new test setup.

Commits on Jun 12, 2026

Merge branch 'main' into delete_file_size_after_rewrite

Core, Spark: measure rewritten delete file size in a parallel phase to address PR feedback

Commits on Jun 22, 2026

Merge branch 'main' into delete_file_size_after_rewrite

Core, Spark: dedupe DV rewrites by location and rename position-delete APIs per PR feedback

Commits on Jun 24, 2026

Merge remote-tracking branch 'apache/main' into delete_file_size_after_rewrite

Commits on Jun 25, 2026

Merge branch 'main' into delete_file_size_after_rewrite