Add DataFusion 55.0.0 release blog post by alamb · Pull Request #203 · apache/datafusion-site

alamb · 2026-08-16T11:30:14Z

Which issue does this PR close?

Rationale for this change

Post announcing the DataFusion 55.0.0 release, following the model of the 54.0.0 post.

Changes

Rendered Preview: https://alamb.github.io/datafusion-site/blog/2026/08/25/datafusion-55.0.0/

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

gene-bordegaray · 2026-08-17T17:38:10Z

+partitions based on ordered split points ([#22395], design discussion
+[#21992]). Range partitioning preserves ordering across partitions, which is a
+natural fit for pre-sorted data and for distributed engines that shuffle by
+range.


maybe a quick example or link to documented example to show how split points are used 👍

I can of course make this change, just throwing idea out there first

@gene-bordegaray -- I am very behind on this post (I have been working on the ALP blog post with @sdf-jkl apache/parquet-site#195)

I now have some time and will likely focus on this over the next day or two

I also added you as a collaborator on my fork, so you should now be able to push directly to this branch -- please feel free to do so

sweet I will take time this weekend to help with edits here and in general 🙇

Thank you @gene-bordegaray -- the content about range partitioning was great, but I think a little too detailed for this release announcement. I filed a ticket about writing a self contained blog post

Blog post about Range Partitioning datafusion#24667

(I will trim the section down a bit but wanted to capture the content first)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

neilconway · 2026-08-25T15:59:55Z

This is great, @alamb! Nice work. And congrats to everyone on another awesome release!

rluvaton · 2026-08-25T16:07:47Z

I think you should also mention that you can now opt in for better ordering equivalence (for example custom cast)

ScalarUdfImpl::strictly_order_preserving: Allow expression to report whether they keep the same ordering of the input datafusion#23807

alamb · 2026-08-25T16:18:37Z

I think you should also mention that you can now opt in for better ordering equivalence (for example custom cast)

ScalarUdfImpl::strictly_order_preserving: Allow expression to report whether they keep the same ordering of the input datafusion#23807

Done in 1aed4ff and f1dc80f

stuhood

Thanks for doing this! Looks great.

kumarUjjawal

Thank you @alamb

This looks great. And thank you everyone involved in the release.

Co-authored-by: Stu Hood <stuhood@gmail.com>

Rich-T-kid

nice!

saadtajwar

Lets gooo!

peterxcli

🎊

gene-bordegaray · 2026-08-26T10:27:25Z

+the design discussion ([#21992]). Thanks to [@gene-bordegaray], [@saadtajwar], [@peterxcli], [@stuhood],
+[@gmhelmold], [@mattp5657], [@mithuncy], [@JSOD11], [@EdsonPetry],
+[@Rich-T-kid], and [@blinding-pixels] for driving this substantial community
+effort.


gene-bordegaray

woooooop 🚀

…ex()` (apache#24634) ## Which issue does this PR close? - N/A -- documentation only. ## Rationale for this change While writing a blog post - apache/datafusion-site#203 Which mentiones `file_row_index()` and `input_file_name()` -- I added a simple example for the post and I think it would help to have docs in the main site too. ## What changes are included in this PR? Replaces the `sql_example` with ```sql > COPY (SELECT * from values (100), (200), (300)) to '/tmp/foo.parquet'; > select *, input_file_name(), file_row_index() from '/tmp/foo.parquet'; +---------+-------------------+------------------+ | column1 | input_file_name() | file_row_index() | +---------+-------------------+------------------+ | 100 | tmp/foo.parquet | 0 | | 200 | tmp/foo.parquet | 1 | | 300 | tmp/foo.parquet | 2 | +---------+-------------------+------------------+ ``` The same example is used for both functions, since showing them together is likely common and I think makes it clear what they do ## Are these changes tested? By CI ## Are there any user-facing changes? Yes, but documentation only -- the rendered examples for `input_file_name()` and `file_row_index()` in the SQL function reference. No API or behavior changes.

zhuqi-lucas

Thank you @alamb LGTM 🚀

Co-authored-by: Qi Zhu <821684824@qq.com>

alamb · 2026-08-26T23:59:16Z

I'll plan to merge this on Friday unless anyone else woul like more time to review

wirybeaver · 2026-08-27T01:51:09Z

+
+Built-in table providers do not yet implement the hook, but custom
+[`TableProvider`][TableProvider] implementations (such as lakehouse table formats) can now plug
+in their own merge execution.


@alamb Thanks for highlighting MERGE INTO. One small note: 55.0 still rejects two target-alias edge cases—target-correlated subqueries and a source qualifier matching the target’s real table name. apache/datafusion#24429 fixes both in the planned 56.0 release with a breaking for the MergeIntoOp construction. Would it be useful to mention this briefly as a known limitation?

Thanks @wirybeaver that is a good point -- I added a note in 00cc646 that we plan more MERGE INTO work in the following releases

… into datafusion-55-blog

alamb · 2026-08-28T09:26:33Z

ok, here we go.

alamb · 2026-08-28T09:32:29Z

+---
+layout: post
+title: Apache DataFusion 55.0.0 Released
+date: 2026-08-25


🤔 the date will be a few days early, but I guess that is ok

alamb · 2026-08-28T09:49:20Z

Publishing workflow seems to be waiting on a builder: https://github.com/apache/datafusion-site/actions/runs/33159387574

alamb · 2026-08-28T10:55:41Z

Post is live: https://datafusion.apache.org/blog/output/2026/08/25/datafusion-55.0.0/

Add draft blog post for DataFusion 55.0.0 release

80f84c5

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

gene-bordegaray reviewed Aug 17, 2026

View reviewed changes

gene-bordegaray force-pushed the datafusion-55-blog branch from 9b4a74b to 0b1d694 Compare August 23, 2026 14:57

tidy up range

54d4c5f

gene-bordegaray force-pushed the datafusion-55-blog branch from e8e763b to 54d4c5f Compare August 23, 2026 14:59

alamb and others added 2 commits August 24, 2026 09:02

rework perf

9e14363

Add development activity chart (commits, commits/day, contributors)

f99e2b7

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

alamb mentioned this pull request Aug 24, 2026

Enable TopK per Partition (datafusion.optimizer.enable_window_topn) by default apache/datafusion#24608

Open

7 tasks

alamb added 9 commits August 24, 2026 10:04

more performance numbers, remove topk mention

b0a0edc

remove mention of topk per partition

297a410

more examples

8641022

images

ce3b0d1

update performance

cb0f8eb

update performance

b88f8e3

More

d6cdba0

example

1982f60

example / liks

55d342d

alamb mentioned this pull request Aug 24, 2026

docs: add runnable examples for input_file_name() and file_row_index() apache/datafusion#24634

Merged

updates

e0bb604

alamb mentioned this pull request Aug 25, 2026

Blog post about Range Partitioning apache/datafusion#24667

Open

alamb added 10 commits August 25, 2026 09:57

update

47f732c

trim range partitioning

1243ee6

trim more

c2a5ceb

tighen

c5104b6

Trim

af72558

tighten

2a80ac7

Update dates, tweak

b85fb1d

obsess

5880b0c

bencmaxx

4b98f88

obsess

a740ff6

alamb mentioned this pull request Aug 25, 2026

Release DataFusion 55.0.0 (Jul / Aug 2026) apache/datafusion#22393

Closed

50 tasks

alamb added 2 commits August 25, 2026 12:16

mention strictly order preserving

1aed4ff

Shorten

f1dc80f

stuhood approved these changes Aug 25, 2026

View reviewed changes

Comment thread content/blog/2026-08-25-datafusion-55.0.0.md Outdated

kumarUjjawal approved these changes Aug 25, 2026

View reviewed changes

avantgardnerio approved these changes Aug 25, 2026

View reviewed changes

Comment thread content/blog/2026-08-25-datafusion-55.0.0.md Outdated

alamb and others added 2 commits August 25, 2026 17:29

Update content/blog/2026-08-25-datafusion-55.0.0.md

0170e87

Co-authored-by: Stu Hood <stuhood@gmail.com>

Add reference to ballista use

024399b

Rich-T-kid approved these changes Aug 25, 2026

View reviewed changes

saadtajwar approved these changes Aug 25, 2026

View reviewed changes

peterxcli approved these changes Aug 26, 2026

View reviewed changes

gene-bordegaray reviewed Aug 26, 2026

View reviewed changes

gene-bordegaray approved these changes Aug 26, 2026

View reviewed changes

zhuqi-lucas approved these changes Aug 26, 2026

View reviewed changes

Comment thread content/blog/2026-08-25-datafusion-55.0.0.md Outdated

Comment thread content/blog/2026-08-25-datafusion-55.0.0.md Outdated

alamb and others added 2 commits August 26, 2026 17:08

Update content/blog/2026-08-25-datafusion-55.0.0.md

0c1af57

Co-authored-by: Qi Zhu <821684824@qq.com>

Update content/blog/2026-08-25-datafusion-55.0.0.md

6b8dfb8

Co-authored-by: Qi Zhu <821684824@qq.com>

wirybeaver reviewed Aug 27, 2026

View reviewed changes

alamb added 2 commits August 27, 2026 09:43

Mention more merge is planned

00cc646

Merge branch 'datafusion-55-blog' of github.com:alamb/datafusion-site…

4d15616

… into datafusion-55-blog

alamb merged commit abeb6cb into apache:main Aug 28, 2026
4 checks passed

alamb commented Aug 28, 2026

View reviewed changes

alamb deleted the datafusion-55-blog branch August 28, 2026 10:55

Uh oh!

Conversation

alamb commented Aug 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Which issue does this PR close?

Rationale for this change

Changes

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

neilconway commented Aug 25, 2026

Uh oh!

rluvaton commented Aug 25, 2026

Uh oh!

alamb commented Aug 25, 2026

Uh oh!

stuhood left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

kumarUjjawal left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Rich-T-kid left a comment

Choose a reason for hiding this comment

Uh oh!

saadtajwar left a comment

Choose a reason for hiding this comment

Uh oh!

peterxcli left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

gene-bordegaray left a comment

Choose a reason for hiding this comment

Uh oh!

zhuqi-lucas left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

alamb commented Aug 26, 2026

Uh oh!

wirybeaver Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

alamb commented Aug 28, 2026

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

alamb commented Aug 28, 2026

Uh oh!

alamb commented Aug 28, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

12 participants

alamb commented Aug 16, 2026 •

edited

Loading

zhuqi-lucas left a comment •

edited

Loading

wirybeaver Aug 27, 2026 •

edited

Loading