Skip to content

Separate RowFn batch inspection from execution planning - #10673

Closed
connortsui20 wants to merge 1 commit into
developfrom
ct/row-fn-cleanup/batch-inputs
Closed

connortsui20 wants to merge 1 commit into
developfrom
ct/row-fn-cleanup/batch-inputs

Conversation

@connortsui20

@connortsui20 connortsui20 commented Oct 21, 2026 •

Copy link
Copy Markdown
Member

Summary

Extracts batch setup from #9979 into a private borrowed-input boundary. Input lengths, dtypes, constants, and strict validity are inspected together before attaching the dispatch-selected execution plan.

Targets develop and can merge independently. #10675 and #10676 use the borrowed batch entry point introduced here.

Changes

Keeps constant classification, input ownership, and execution metadata inside the framework. General execution still collects owned inputs and uses the existing dispatch and retry paths. Function IDs are deferred during inspection until an error needs them, with the supporting CachedId inlining change kept here.

The Vortex test suite was not run locally. Focused native measurements of the combined migration were run separately during the compiler investigation.

@connortsui20
connortsui20 added this pull request to stack #10677 October 21, 2026 15:10
@codspeed

codspeed Bot commented Oct 21, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 5.32%

3 warnings, 1 note

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 17 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ Base and head ran on different runner types

Some benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.

Learn more about Macro Runners

Open the report in CodSpeed to investigate

ℹ️ 40 benchmarks have no flamegraph

The flamegraph wasn't generated: the symbols of the profiling trace could not be resolved, because no information about the language frames was collected.

See affected benchmarks

⚡ 2 improved benchmarks
❌ 5 regressed benchmarks
✅ 2401 untouched benchmarks
⏩ 12 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Walltime filter_neon[8] 893 ns 1,159 ns -22.95%
❌ Walltime filter_neon[64] 1.7 µs 2 µs -13.66%
❌ Walltime bitpack_blocked_compress_avx2 6.7 µs 7.6 µs -12.21%
❌ CPU Simulation test_scan_filter[int] 3.1 ms 3.4 ms -11.14%
❌ CPU Simulation random_i8[0.01] 103.5 µs 116 µs -10.74%
⚡ CPU Simulation random_i128[0.01] 5.3 µs 4.1 µs +29.79%
⚡ CPU Simulation stats_compute_is_constant_cached 112.8 µs 99.5 µs +13.45%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ct/row-fn-cleanup/batch-inputs (bb199a5) with develop (d270200)

Open in CodSpeed

Footnotes

  1. 12 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@connortsui20
connortsui20 force-pushed the ct/row-fn-cleanup/batch-inputs branch from 5541df9 to abc8689 Compare October 22, 2026 14:09
@connortsui20
connortsui20 force-pushed the ct/row-fn-cleanup/borrowed-decode branch from 80cbea7 to 9663585 Compare October 22, 2026 14:09
@connortsui20
connortsui20 removed this pull request from stack #10677 October 22, 2026 14:10
@connortsui20
connortsui20 changed the base branch from ct/row-fn-cleanup/borrowed-decode to develop October 22, 2026 14:10
@connortsui20
connortsui20 added this pull request to stack #10695 October 22, 2026 14:11
@connortsui20
connortsui20 force-pushed the ct/row-fn-cleanup/batch-inputs branch from abc8689 to d3afc24 Compare October 22, 2026 14:49
@connortsui20 connortsui20 added the changelog/performance A performance improvement label Oct 22, 2026
@connortsui20
connortsui20 removed this pull request from stack #10695 October 22, 2026 15:12
Inspect borrowed inputs once for lengths, dtypes, constant classification, and strict validity. Pair collected inputs with a separate execution plan while retaining the existing dispatch and retry paths.

Extracted from #9979.

Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
connortsui20 force-pushed the ct/row-fn-cleanup/batch-inputs branch from d3afc24 to bb199a5 Compare October 23, 2026 00:42
@connortsui20
connortsui20 marked this pull request as ready for review October 23, 2026 00:42
@connortsui20 connortsui20 added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-spatial Run only SpatialBench SQL benchmarks on this PR labels Oct 23, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 23, 2026
@github-actions

github-actions Bot commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done bb199a5 clickbench-nvme 1 Explore Profiling Data
🟢 Done bb199a5 polarsignals 1 Explore Profiling Data
🟢 Done bb199a5 tpch-nvme-10 1 Explore Profiling Data
🟢 Done bb199a5 fineweb 1 Explore Profiling Data
🟢 Done bb199a5 tpch-s3 1 Explore Profiling Data
🟢 Done bb199a5 tpcds-nvme 1 Explore Profiling Data
🟢 Done bb199a5 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR bb199a5d vs base d270200d
Vortex (geomean): hot 1.001x ➖ · cold 1.047x ➖


datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44819862 / 44744811 / +0.2% 87423095 / 92053975 / -5.0% 0.51 / 0.49 / +5.5%
polarsignals_q01/datafusion:vortex-file-compressed 51128764 / 50471093 / +1.3% 116540980 / 115244299 / +1.1% 0.44 / 0.44 / +0.2%
polarsignals_q02/datafusion:vortex-file-compressed 43562746 / 43477550 / +0.2% 87241073 / 84517206 / +3.2% 0.50 / 0.51 / -2.9%
polarsignals_q03/datafusion:vortex-file-compressed 54972238 / 53196134 / +3.3% 114078264 / 117408277 / -2.8% 0.48 / 0.45 / +6.4%
polarsignals_q04/datafusion:vortex-file-compressed 9289354 / 9321116 / -0.3% 53511778 / 46961493 / +13.9% 🔴 0.17 / 0.20 / -12.5%
polarsignals_q05/datafusion:vortex-file-compressed 12069938 / 11993730 / +0.6% 57114297 / 52087625 / +9.7% 0.21 / 0.23 / -8.2%
polarsignals_q06/datafusion:vortex-file-compressed 23132657 / 23454714 / -1.4% 69349668 / 65673288 / +5.6% 0.33 / 0.36 / -6.6%
polarsignals_q07/datafusion:vortex-file-compressed 11021556 / 11219796 / -1.8% 55371498 / 52109937 / +6.3% 0.20 / 0.22 / -7.6%
polarsignals_q08/datafusion:vortex-file-compressed 97911271 / 98392024 / -0.5% 171370157 / 163447155 / +4.8% 0.57 / 0.60 / -5.1%
polarsignals_q09/datafusion:vortex-file-compressed 9845164 / 9927289 / -0.8% 53403070 / 47845722 / +11.6% 🔴 0.18 / 0.21 / -11.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR bb199a5d vs base d270200d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+3.4%, low confidence) · DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): hot 1.008x ➖ · cold 0.977x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.009x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.021x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7045488 / 6986400 / +0.8% 17123324 / 18050622 / -5.1% 0.41 / 0.39 / +6.3%
fineweb_q01/datafusion:vortex-file-compressed 8793730 / 7275371 / +20.9% 🔴 43603104 / 44008989 / -0.9% 0.20 / 0.17 / +22.0%
fineweb_q02/datafusion:vortex-file-compressed 10303372 / 9643182 / +6.8% 51945473 / 51623419 / +0.6% 0.20 / 0.19 / +6.2%
fineweb_q03/datafusion:vortex-file-compressed 20062204 / 20239974 / -0.9% 108863854 / 113788461 / -4.3% 0.18 / 0.18 / +3.6%
fineweb_q04/datafusion:vortex-file-compressed 68369812 / 67301001 / +1.6% 155045827 / 159615326 / -2.9% 0.44 / 0.42 / +4.6%
fineweb_q05/datafusion:vortex-file-compressed 66251364 / 66250654 / +0.0% 150767323 / 152308326 / -1.0% 0.44 / 0.43 / +1.0%
fineweb_q06/datafusion:vortex-file-compressed 18641602 / 19394815 / -3.9% 114189965 / 113713476 / +0.4% 0.16 / 0.17 / -4.3%
fineweb_q07/datafusion:vortex-file-compressed 17553998 / 17205394 / +2.0% 111059257 / 108328681 / +2.5% 0.16 / 0.16 / -0.5%
fineweb_q08/datafusion:vortex-file-compressed 8621404 / 9192522 / -6.2% 52407581 / 53868375 / -2.7% 0.16 / 0.17 / -3.6%
datafusion / parquet / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9184938 / 9599664 / -4.3% 33111803 / 30957398 / +7.0% 0.28 / 0.31 / -10.5%
fineweb_q01/datafusion:parquet 74685965 / 76818224 / -2.8% 164183471 / 156716863 / +4.8% 0.45 / 0.49 / -7.2%
fineweb_q02/datafusion:parquet 74369364 / 75857119 / -2.0% 157821700 / 157029308 / +0.5% 0.47 / 0.48 / -2.5%
fineweb_q03/datafusion:parquet 73645288 / 74763248 / -1.5% 159994770 / 155066913 / +3.2% 0.46 / 0.48 / -4.5%
fineweb_q04/datafusion:parquet 82272650 / 82126054 / +0.2% 152637495 / 155280968 / -1.7% 0.54 / 0.53 / +1.9%
fineweb_q05/datafusion:parquet 79998502 / 80871888 / -1.1% 163601110 / 159896464 / +2.3% 0.49 / 0.51 / -3.3%
fineweb_q06/datafusion:parquet 76474018 / 76115157 / +0.5% 159796910 / 154647418 / +3.3% 0.48 / 0.49 / -2.8%
fineweb_q07/datafusion:parquet 75068106 / 75486456 / -0.6% 151343931 / 154294677 / -1.9% 0.50 / 0.49 / +1.4%
fineweb_q08/datafusion:parquet 73083596 / 72714976 / +0.5% 151904885 / 154494638 / -1.7% 0.48 / 0.47 / +2.2%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2465378 / 2442904 / +0.9% 7376990 / 7646728 / -3.5% 0.33 / 0.32 / +4.6%
fineweb_q01/duckdb:vortex-file-compressed 9486850 / 9633722 / -1.5% 34394563 / 36742609 / -6.4% 0.28 / 0.26 / +5.2%
fineweb_q02/duckdb:vortex-file-compressed 10661713 / 10759263 / -0.9% 36056193 / 37502538 / -3.9% 0.30 / 0.29 / +3.1%
fineweb_q03/duckdb:vortex-file-compressed 19193052 / 19525922 / -1.7% 106090519 / 108469343 / -2.2% 0.18 / 0.18 / +0.5%
fineweb_q04/duckdb:vortex-file-compressed 67204248 / 66771893 / +0.6% 118808929 / 121769522 / -2.4% 0.57 / 0.55 / +3.2%
fineweb_q05/duckdb:vortex-file-compressed 66768856 / 66827687 / -0.1% 112012989 / 118962195 / -5.8% 0.60 / 0.56 / +6.1%
fineweb_q06/duckdb:vortex-file-compressed 18686501 / 18863626 / -0.9% 112118617 / 110992318 / +1.0% 0.17 / 0.17 / -1.9%
fineweb_q07/duckdb:vortex-file-compressed 18524420 / 18856960 / -1.8% 103675973 / 109803242 / -5.6% 0.18 / 0.17 / +4.0%
fineweb_q08/duckdb:vortex-file-compressed 5594632 / 5512714 / +1.5% 16039555 / 15736650 / +1.9% 0.35 / 0.35 / -0.4%
duckdb / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 27292282 / 27556044 / -1.0% 29602756 / 29626087 / -0.1% 0.92 / 0.93 / -0.9%
fineweb_q01/duckdb:parquet 60796776 / 59969350 / +1.4% 83604634 / 82803940 / +1.0% 0.73 / 0.72 / +0.4%
fineweb_q02/duckdb:parquet 65334880 / 64344502 / +1.5% 85923203 / 83294170 / +3.2% 0.76 / 0.77 / -1.6%
fineweb_q03/duckdb:parquet 129923595 / 127188536 / +2.2% 191706276 / 189037997 / +1.4% 0.68 / 0.67 / +0.7%
fineweb_q04/duckdb:parquet 183847306 / 181173968 / +1.5% 228413055 / 228337627 / +0.0% 0.80 / 0.79 / +1.4%
fineweb_q05/duckdb:parquet 176418354 / 177437846 / -0.6% 213532286 / 222997388 / -4.2% 0.83 / 0.80 / +3.8%
fineweb_q06/duckdb:parquet 96634460 / 94799788 / +1.9% 155650892 / 158066465 / -1.5% 0.62 / 0.60 / +3.5%
fineweb_q07/duckdb:parquet 98516680 / 95855718 / +2.8% 156185366 / 156182174 / +0.0% 0.63 / 0.61 / +2.8%
fineweb_q08/duckdb:parquet 33343560 / 33243135 / +0.3% 34088864 / 33871389 / +0.6% 0.98 / 0.98 / -0.3%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR bb199a5d vs base d270200d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.016x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 14795969 / 14720854 / +0.5% 42483221 / 41884161 / +1.4% 0.35 / 0.35 / -0.9%
tpch_q02/datafusion:vortex-file-compressed 17262576 / 17131901 / +0.8% 35196349 / 34345564 / +2.5% 0.49 / 0.50 / -1.7%
tpch_q03/datafusion:vortex-file-compressed 18439043 / 18472161 / -0.2% 47683988 / 45809517 / +4.1% 0.39 / 0.40 / -4.1%
tpch_q04/datafusion:vortex-file-compressed 9974881 / 9896271 / +0.8% 32481607 / 32372925 / +0.3% 0.31 / 0.31 / +0.5%
tpch_q05/datafusion:vortex-file-compressed 36473630 / 36519125 / -0.1% 65683054 / 66240622 / -0.8% 0.56 / 0.55 / +0.7%
tpch_q06/datafusion:vortex-file-compressed 6022326 / 6074928 / -0.9% 30324715 / 28713673 / +5.6% 0.20 / 0.21 / -6.1%
tpch_q07/datafusion:vortex-file-compressed 51049674 / 51076790 / -0.1% 79359917 / 75336868 / +5.3% 0.64 / 0.68 / -5.1%
tpch_q08/datafusion:vortex-file-compressed 52086584 / 51570499 / +1.0% 80681563 / 82191556 / -1.8% 0.65 / 0.63 / +2.9%
tpch_q09/datafusion:vortex-file-compressed 48832045 / 49400561 / -1.2% 79415815 / 75863633 / +4.7% 0.61 / 0.65 / -5.6%
tpch_q10/datafusion:vortex-file-compressed 17146732 / 16896704 / +1.5% 51544607 / 51372094 / +0.3% 0.33 / 0.33 / +1.1%
tpch_q11/datafusion:vortex-file-compressed 14826188 / 14750158 / +0.5% 35175527 / 35398537 / -0.6% 0.42 / 0.42 / +1.2%
tpch_q12/datafusion:vortex-file-compressed 22236360 / 22912314 / -3.0% 44515226 / 47321091 / -5.9% 0.50 / 0.48 / +3.2%
tpch_q13/datafusion:vortex-file-compressed 19106334 / 19466228 / -1.8% 40247922 / 39324900 / +2.3% 0.47 / 0.50 / -4.1%
tpch_q14/datafusion:vortex-file-compressed 14508885 / 14689874 / -1.2% 41454596 / 40788319 / +1.6% 0.35 / 0.36 / -2.8%
tpch_q15/datafusion:vortex-file-compressed 18120741 / 18118386 / +0.0% 45206942 / 44596704 / +1.4% 0.40 / 0.41 / -1.3%
tpch_q16/datafusion:vortex-file-compressed 18486431 / 18138361 / +1.9% 40341686 / 40166329 / +0.4% 0.46 / 0.45 / +1.5%
tpch_q17/datafusion:vortex-file-compressed 28257096 / 28001192 / +0.9% 61735864 / 59632905 / +3.5% 0.46 / 0.47 / -2.5%
tpch_q18/datafusion:vortex-file-compressed 36455634 / 36936377 / -1.3% 58805626 / 58978664 / -0.3% 0.62 / 0.63 / -1.0%
tpch_q19/datafusion:vortex-file-compressed 14226398 / 14291435 / -0.5% 41855391 / 40784922 / +2.6% 0.34 / 0.35 / -3.0%
tpch_q20/datafusion:vortex-file-compressed 20172618 / 20243490 / -0.4% 46025831 / 43790825 / +5.1% 0.44 / 0.46 / -5.2%
tpch_q21/datafusion:vortex-file-compressed 38020043 / 38110461 / -0.2% 68521416 / 68913363 / -0.6% 0.55 / 0.55 / +0.3%
tpch_q22/datafusion:vortex-file-compressed 12001418 / 12080060 / -0.7% 32748243 / 33637108 / -2.6% 0.37 / 0.36 / +2.0%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 18646813 / 18979678 / -1.8% 45831585 / 46466290 / -1.4% 0.41 / 0.41 / -0.4%
tpch_q02/datafusion:parquet 49134774 / 49113246 / +0.0% 74585167 / 72867456 / +2.4% 0.66 / 0.67 / -2.3%
tpch_q03/datafusion:parquet 40477908 / 40374587 / +0.3% 76180870 / 71699536 / +6.3% 0.53 / 0.56 / -5.6%
tpch_q04/datafusion:parquet 17482417 / 17474402 / +0.0% 46357632 / 44134939 / +5.0% 0.38 / 0.40 / -4.8%
tpch_q05/datafusion:parquet 70743549 / 71101517 / -0.5% 106186780 / 103632011 / +2.5% 0.67 / 0.69 / -2.9%
tpch_q06/datafusion:parquet 10519870 / 10608224 / -0.8% 36318343 / 38165146 / -4.8% 0.29 / 0.28 / +4.2%
tpch_q07/datafusion:parquet 78522208 / 78299226 / +0.3% 114179645 / 116471073 / -2.0% 0.69 / 0.67 / +2.3%
tpch_q08/datafusion:parquet 89189727 / 88241962 / +1.1% 124237772 / 126235819 / -1.6% 0.72 / 0.70 / +2.7%
tpch_q09/datafusion:parquet 76795840 / 76151155 / +0.8% 113549802 / 111102344 / +2.2% 0.68 / 0.69 / -1.3%
tpch_q10/datafusion:parquet 31166006 / 31350921 / -0.6% 64911492 / 64388130 / +0.8% 0.48 / 0.49 / -1.4%
tpch_q11/datafusion:parquet 37964236 / 38207328 / -0.6% 64455398 / 66142810 / -2.6% 0.59 / 0.58 / +2.0%
tpch_q12/datafusion:parquet 28654874 / 28522974 / +0.5% 54418355 / 50770003 / +7.2% 0.53 / 0.56 / -6.3%
tpch_q13/datafusion:parquet 28582120 / 28232193 / +1.2% 50288239 / 45921643 / +9.5% 0.57 / 0.61 / -7.6%
tpch_q14/datafusion:parquet 24196306 / 24046851 / +0.6% 55427318 / 52011538 / +6.6% 0.44 / 0.46 / -5.6%
tpch_q15/datafusion:parquet 38297588 / 38529679 / -0.6% 68102927 / 69418084 / -1.9% 0.56 / 0.56 / +1.3%
tpch_q16/datafusion:parquet 28631464 / 29243026 / -2.1% 52218018 / 52364465 / -0.3% 0.55 / 0.56 / -1.8%
tpch_q17/datafusion:parquet 44002003 / 44965518 / -2.1% 81629170 / 80309945 / +1.6% 0.54 / 0.56 / -3.7%
tpch_q18/datafusion:parquet 44178102 / 44371168 / -0.4% 69737219 / 69969103 / -0.3% 0.63 / 0.63 / -0.1%
tpch_q19/datafusion:parquet 20389088 / 20879857 / -2.4% 50185777 / 54408507 / -7.8% 0.41 / 0.38 / +5.9%
tpch_q20/datafusion:parquet 55036494 / 54984009 / +0.1% 91068279 / 91226550 / -0.2% 0.60 / 0.60 / +0.3%
tpch_q21/datafusion:parquet 75862527 / 78129180 / -2.9% 112313809 / 113306674 / -0.9% 0.68 / 0.69 / -2.0%
tpch_q22/datafusion:parquet 21369900 / 21333552 / +0.2% 46239796 / 45089881 / +2.6% 0.46 / 0.47 / -2.3%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 10685603 / 10165497 / +5.1% 22999267 / 21473581 / +7.1% 0.46 / 0.47 / -1.9%
tpch_q02/duckdb:vortex-file-compressed 16147281 / 16113460 / +0.2% 25690644 / 25106850 / +2.3% 0.63 / 0.64 / -2.1%
tpch_q03/duckdb:vortex-file-compressed 20147113 / 20059592 / +0.4% 37913630 / 35899844 / +5.6% 0.53 / 0.56 / -4.9%
tpch_q04/duckdb:vortex-file-compressed 12962246 / 12779915 / +1.4% 26961684 / 26741110 / +0.8% 0.48 / 0.48 / +0.6%
tpch_q05/duckdb:vortex-file-compressed 21310976 / 21423519 / -0.5% 35447405 / 35849194 / -1.1% 0.60 / 0.60 / +0.6%
tpch_q06/duckdb:vortex-file-compressed 5783528 / 5896514 / -1.9% 16952503 / 16807799 / +0.9% 0.34 / 0.35 / -2.8%
tpch_q07/duckdb:vortex-file-compressed 25408924 / 25447196 / -0.2% 43918304 / 42368487 / +3.7% 0.58 / 0.60 / -3.7%
tpch_q08/duckdb:vortex-file-compressed 22454492 / 22117523 / +1.5% 41010062 / 39790606 / +3.1% 0.55 / 0.56 / -1.5%
tpch_q09/duckdb:vortex-file-compressed 23371331 / 23163908 / +0.9% 43063941 / 41581702 / +3.6% 0.54 / 0.56 / -2.6%
tpch_q10/duckdb:vortex-file-compressed 23905136 / 23789035 / +0.5% 41613392 / 40511577 / +2.7% 0.57 / 0.59 / -2.2%
tpch_q11/duckdb:vortex-file-compressed 8291802 / 8290155 / +0.0% 16720525 / 17164096 / -2.6% 0.50 / 0.48 / +2.7%
tpch_q12/duckdb:vortex-file-compressed 16985610 / 16773208 / +1.3% 32818343 / 31403584 / +4.5% 0.52 / 0.53 / -3.1%
tpch_q13/duckdb:vortex-file-compressed 21313796 / 21495771 / -0.8% 34142362 / 35333166 / -3.4% 0.62 / 0.61 / +2.6%
tpch_q14/duckdb:vortex-file-compressed 12408139 / 12263698 / +1.2% 26296886 / 24737589 / +6.3% 0.47 / 0.50 / -4.8%
tpch_q15/duckdb:vortex-file-compressed 9182881 / 9444418 / -2.8% 22670937 / 20880313 / +8.6% 0.41 / 0.45 / -10.4%
tpch_q16/duckdb:vortex-file-compressed 18978070 / 18931823 / +0.2% 26645962 / 25617861 / +4.0% 0.71 / 0.74 / -3.6%
tpch_q17/duckdb:vortex-file-compressed 14413338 / 14515698 / -0.7% 28872705 / 29744254 / -2.9% 0.50 / 0.49 / +2.3%
tpch_q18/duckdb:vortex-file-compressed 27878581 / 27483023 / +1.4% 36875784 / 38550818 / -4.3% 0.76 / 0.71 / +6.0%
tpch_q19/duckdb:vortex-file-compressed 12213865 / 12624827 / -3.3% 28931093 / 28241518 / +2.4% 0.42 / 0.45 / -5.6%
tpch_q20/duckdb:vortex-file-compressed 15936846 / 16022366 / -0.5% 33476263 / 32943342 / +1.6% 0.48 / 0.49 / -2.1%
tpch_q21/duckdb:vortex-file-compressed 39149267 / 40140318 / -2.5% 60438844 / 59236122 / +2.0% 0.65 / 0.68 / -4.4%
tpch_q22/duckdb:vortex-file-compressed 18805452 / 18899946 / -0.5% 29765773 / 29941738 / -0.6% 0.63 / 0.63 / +0.1%
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 18629627 / 18666860 / -0.2% 22136594 / 22206838 / -0.3% 0.84 / 0.84 / +0.1%
tpch_q02/duckdb:parquet 31606362 / 32597697 / -3.0% 39271416 / 39608128 / -0.9% 0.80 / 0.82 / -2.2%
tpch_q03/duckdb:parquet 36420699 / 36638202 / -0.6% 46477992 / 45071947 / +3.1% 0.78 / 0.81 / -3.6%
tpch_q04/duckdb:parquet 26302796 / 26766180 / -1.7% 34449746 / 34868676 / -1.2% 0.76 / 0.77 / -0.5%
tpch_q05/duckdb:parquet 40504906 / 41326967 / -2.0% 52382861 / 51136437 / +2.4% 0.77 / 0.81 / -4.3%
tpch_q06/duckdb:parquet 11199068 / 11239823 / -0.4% 16195521 / 16320295 / -0.8% 0.69 / 0.69 / +0.4%
tpch_q07/duckdb:parquet 44382975 / 44537468 / -0.3% 54942974 / 56634780 / -3.0% 0.81 / 0.79 / +2.7%
tpch_q08/duckdb:parquet 49231778 / 49633183 / -0.8% 61078416 / 60118179 / +1.6% 0.81 / 0.83 / -2.4%
tpch_q09/duckdb:parquet 52305237 / 52383972 / -0.2% 62803631 / 61516222 / +2.1% 0.83 / 0.85 / -2.2%
tpch_q10/duckdb:parquet 42017666 / 42294920 / -0.7% 49089764 / 50605070 / -3.0% 0.86 / 0.84 / +2.4%
tpch_q11/duckdb:parquet 17453449 / 17766571 / -1.8% 24379901 / 24168987 / +0.9% 0.72 / 0.74 / -2.6%
tpch_q12/duckdb:parquet 23401643 / 23688654 / -1.2% 30553068 / 31045530 / -1.6% 0.77 / 0.76 / +0.4%
tpch_q13/duckdb:parquet 35496264 / 36243377 / -2.1% 40323492 / 40871676 / -1.3% 0.88 / 0.89 / -0.7%
tpch_q14/duckdb:parquet 26299440 / 26058360 / +0.9% 34423365 / 34600288 / -0.5% 0.76 / 0.75 / +1.4%
tpch_q15/duckdb:parquet 19342605 / 19006459 / +1.8% 25549235 / 25479027 / +0.3% 0.76 / 0.75 / +1.5%
tpch_q16/duckdb:parquet 31140431 / 31162826 / -0.1% 38793878 / 39538607 / -1.9% 0.80 / 0.79 / +1.8%
tpch_q17/duckdb:parquet 27427109 / 26842171 / +2.2% 36848185 / 34677131 / +6.3% 0.74 / 0.77 / -3.8%
tpch_q18/duckdb:parquet 39194959 / 39036355 / +0.4% 47807574 / 50859301 / -6.0% 0.82 / 0.77 / +6.8%
tpch_q19/duckdb:parquet 23110335 / 22846631 / +1.2% 30395617 / 30382477 / +0.0% 0.76 / 0.75 / +1.1%
tpch_q20/duckdb:parquet 33170657 / 32932254 / +0.7% 43345672 / 43761703 / -1.0% 0.77 / 0.75 / +1.7%
tpch_q21/duckdb:parquet 65154707 / 65735205 / -0.9% 75751200 / 75550714 / +0.3% 0.86 / 0.87 / -1.1%
tpch_q22/duckdb:parquet 24049221 / 24332936 / -1.2% 32568404 / 32029332 / +1.7% 0.74 / 0.76 / -2.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR bb199a5d vs base d270200d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.974x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 86973062 / 86496369 / +0.6% 129678050 / 146958834 / -11.8% 🟢 0.67 / 0.59 / +14.0%
tpch_q02/datafusion:vortex-file-compressed 65327866 / 63772897 / +2.4% 94123039 / 94698631 / -0.6% 0.69 / 0.67 / +3.1%
tpch_q03/datafusion:vortex-file-compressed 61739346 / 61626461 / +0.2% 104052954 / 111691050 / -6.8% 0.59 / 0.55 / +7.5%
tpch_q04/datafusion:vortex-file-compressed 33458676 / 33221679 / +0.7% 62394594 / 67773347 / -7.9% 0.54 / 0.49 / +9.4%
tpch_q05/datafusion:vortex-file-compressed 114129361 / 113960374 / +0.1% 168829404 / 158779950 / +6.3% 0.68 / 0.72 / -5.8%
tpch_q06/datafusion:vortex-file-compressed 10462586 / 10749478 / -2.7% 51661823 / 55333879 / -6.6% 0.20 / 0.19 / +4.2%
tpch_q07/datafusion:vortex-file-compressed 133185177 / 134734501 / -1.1% 173943005 / 173649587 / +0.2% 0.77 / 0.78 / -1.3%
tpch_q08/datafusion:vortex-file-compressed 139349146 / 139805446 / -0.3% 189538552 / 195985074 / -3.3% 0.74 / 0.71 / +3.1%
tpch_q09/datafusion:vortex-file-compressed 180117017 / 182263407 / -1.2% 243193873 / 252623009 / -3.7% 0.74 / 0.72 / +2.7%
tpch_q10/datafusion:vortex-file-compressed 69745868 / 70178506 / -0.6% 129105689 / 127961453 / +0.9% 0.54 / 0.55 / -1.5%
tpch_q11/datafusion:vortex-file-compressed 42147029 / 42891207 / -1.7% 65092137 / 66205555 / -1.7% 0.65 / 0.65 / -0.1%
tpch_q12/datafusion:vortex-file-compressed 36787190 / 38160767 / -3.6% 72097877 / 76917697 / -6.3% 0.51 / 0.50 / +2.8%
tpch_q13/datafusion:vortex-file-compressed 41875998 / 42041864 / -0.4% 69958219 / 73865921 / -5.3% 0.60 / 0.57 / +5.2%
tpch_q14/datafusion:vortex-file-compressed 22133325 / 23321888 / -5.1% 85476334 / 87568450 / -2.4% 0.26 / 0.27 / -2.8%
tpch_q15/datafusion:vortex-file-compressed 32843879 / 33696846 / -2.5% 83458422 / 86791794 / -3.8% 0.39 / 0.39 / +1.4%
tpch_q16/datafusion:vortex-file-compressed 36260967 / 35911838 / +1.0% 61669420 / 67358721 / -8.4% 0.59 / 0.53 / +10.3%
tpch_q17/datafusion:vortex-file-compressed 171254515 / 170938101 / +0.2% 206534610 / 215232959 / -4.0% 0.83 / 0.79 / +4.4%
tpch_q18/datafusion:vortex-file-compressed 198836093 / 197205238 / +0.8% 254114477 / 254037489 / +0.0% 0.78 / 0.78 / +0.8%
tpch_q19/datafusion:vortex-file-compressed 29631664 / 30345755 / -2.4% 86385804 / 87912912 / -1.7% 0.34 / 0.35 / -0.6%
tpch_q20/datafusion:vortex-file-compressed 60586749 / 60752757 / -0.3% 111131019 / 114999153 / -3.4% 0.55 / 0.53 / +3.2%
tpch_q21/datafusion:vortex-file-compressed 174597840 / 175512505 / -0.5% 228852271 / 240562771 / -4.9% 0.76 / 0.73 / +4.6%
tpch_q22/datafusion:vortex-file-compressed 25221115 / 25193867 / +0.1% 48302789 / 51286407 / -5.8% 0.52 / 0.49 / +6.3%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 86064916 / 86040726 / +0.0% 120904588 / 123163012 / -1.8% 0.71 / 0.70 / +1.9%
tpch_q02/datafusion:parquet 98856455 / 98928510 / -0.1% 126879543 / 134352458 / -5.6% 0.78 / 0.74 / +5.8%
tpch_q03/datafusion:parquet 125858280 / 125601235 / +0.2% 167089156 / 165369432 / +1.0% 0.75 / 0.76 / -0.8%
tpch_q04/datafusion:parquet 58036925 / 58136625 / -0.2% 84834068 / 86574584 / -2.0% 0.68 / 0.67 / +1.9%
tpch_q05/datafusion:parquet 156735602 / 156585469 / +0.1% 214263513 / 204764340 / +4.6% 0.73 / 0.76 / -4.3%
tpch_q06/datafusion:parquet 37006294 / 36891022 / +0.3% 72620222 / 74143945 / -2.1% 0.51 / 0.50 / +2.4%
tpch_q07/datafusion:parquet 203549192 / 205191377 / -0.8% 253213730 / 261983178 / -3.3% 0.80 / 0.78 / +2.6%
tpch_q08/datafusion:parquet 194441406 / 195466195 / -0.5% 265334943 / 261226966 / +1.6% 0.73 / 0.75 / -2.1%
tpch_q09/datafusion:parquet 215746845 / 217073264 / -0.6% 288943342 / 283216725 / +2.0% 0.75 / 0.77 / -2.6%
tpch_q10/datafusion:parquet 151379547 / 152037531 / -0.4% 200065741 / 206045568 / -2.9% 0.76 / 0.74 / +2.5%
tpch_q11/datafusion:parquet 59928409 / 60039349 / -0.2% 82802260 / 92361436 / -10.3% 🟢 0.72 / 0.65 / +11.3%
tpch_q12/datafusion:parquet 82899065 / 82833515 / +0.1% 114595611 / 118474727 / -3.3% 0.72 / 0.70 / +3.5%
tpch_q13/datafusion:parquet 205643072 / 205856281 / -0.1% 236571780 / 237215492 / -0.3% 0.87 / 0.87 / +0.2%
tpch_q14/datafusion:parquet 58166650 / 58461591 / -0.5% 123140562 / 121360765 / +1.5% 0.47 / 0.48 / -1.9%
tpch_q15/datafusion:parquet 98128651 / 97430395 / +0.7% 147391464 / 146251123 / +0.8% 0.67 / 0.67 / -0.1%
tpch_q16/datafusion:parquet 45297197 / 45518945 / -0.5% 67716733 / 75337980 / -10.1% 🟢 0.67 / 0.60 / +10.7%
tpch_q17/datafusion:parquet 196519948 / 197837609 / -0.7% 242174064 / 250783713 / -3.4% 0.81 / 0.79 / +2.9%
tpch_q18/datafusion:parquet 240341075 / 240888219 / -0.2% 280447257 / 280492851 / -0.0% 0.86 / 0.86 / -0.2%
tpch_q19/datafusion:parquet 84954470 / 84731868 / +0.3% 147104674 / 145841682 / +0.9% 0.58 / 0.58 / -0.6%
tpch_q20/datafusion:parquet 122331937 / 123397964 / -0.9% 186716388 / 196204345 / -4.8% 0.66 / 0.63 / +4.2%
tpch_q21/datafusion:parquet 267963982 / 270676225 / -1.0% 330815743 / 336206409 / -1.6% 0.81 / 0.81 / +0.6%
tpch_q22/datafusion:parquet 57102520 / 57071102 / +0.1% 77996783 / 86298836 / -9.6% 0.73 / 0.66 / +10.7%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 40204833 / 40197783 / +0.0% 78374862 / 80071791 / -2.1% 0.51 / 0.50 / +2.2%
tpch_q02/duckdb:vortex-file-compressed 29965627 / 30072177 / -0.4% 42890085 / 43280723 / -0.9% 0.70 / 0.69 / +0.6%
tpch_q03/duckdb:vortex-file-compressed 55675873 / 55911562 / -0.4% 102926166 / 103648995 / -0.7% 0.54 / 0.54 / +0.3%
tpch_q04/duckdb:vortex-file-compressed 53044796 / 53084703 / -0.1% 83846642 / 84321406 / -0.6% 0.63 / 0.63 / +0.5%
tpch_q05/duckdb:vortex-file-compressed 70675765 / 71482740 / -1.1% 115653891 / 117043008 / -1.2% 0.61 / 0.61 / +0.1%
tpch_q06/duckdb:vortex-file-compressed 24098430 / 23677983 / +1.8% 62598204 / 66454913 / -5.8% 0.38 / 0.36 / +8.0%
tpch_q07/duckdb:vortex-file-compressed 59826449 / 58948970 / +1.5% 110445225 / 115403851 / -4.3% 0.54 / 0.51 / +6.0%
tpch_q08/duckdb:vortex-file-compressed 91181730 / 90590409 / +0.7% 138436427 / 140221219 / -1.3% 0.66 / 0.65 / +2.0%
tpch_q09/duckdb:vortex-file-compressed 115033466 / 113434440 / +1.4% 182508160 / 183312711 / -0.4% 0.63 / 0.62 / +1.9%
tpch_q10/duckdb:vortex-file-compressed 99859267 / 99921395 / -0.1% 151080840 / 151103661 / -0.0% 0.66 / 0.66 / -0.0%
tpch_q11/duckdb:vortex-file-compressed 15499107 / 15715668 / -1.4% 27832673 / 28273044 / -1.6% 0.56 / 0.56 / +0.2%
tpch_q12/duckdb:vortex-file-compressed 60529611 / 60589106 / -0.1% 104642553 / 105072752 / -0.4% 0.58 / 0.58 / +0.3%
tpch_q13/duckdb:vortex-file-compressed 76823300 / 76154977 / +0.9% 101167800 / 97506011 / +3.8% 0.76 / 0.78 / -2.8%
tpch_q14/duckdb:vortex-file-compressed 30146744 / 30284424 / -0.5% 72671216 / 73772222 / -1.5% 0.41 / 0.41 / +1.1%
tpch_q15/duckdb:vortex-file-compressed 26373709 / 26231296 / +0.5% 62699855 / 66288993 / -5.4% 0.42 / 0.40 / +6.3%
tpch_q16/duckdb:vortex-file-compressed 51888175 / 52143317 / -0.5% 63872954 / 65083095 / -1.9% 0.81 / 0.80 / +1.4%
tpch_q17/duckdb:vortex-file-compressed 38315210 / 38408488 / -0.2% 77251710 / 74601240 / +3.6% 0.50 / 0.51 / -3.7%
tpch_q18/duckdb:vortex-file-compressed 112306855 / 114515995 / -1.9% 135805696 / 132737368 / +2.3% 0.83 / 0.86 / -4.1%
tpch_q19/duckdb:vortex-file-compressed 37011709 / 37937642 / -2.4% 90241852 / 96702059 / -6.7% 0.41 / 0.39 / +4.5%
tpch_q20/duckdb:vortex-file-compressed 50438098 / 50896449 / -0.9% 97159842 / 101231872 / -4.0% 0.52 / 0.50 / +3.3%
tpch_q21/duckdb:vortex-file-compressed 99851284 / 99224910 / +0.6% 146269729 / 150648775 / -2.9% 0.68 / 0.66 / +3.6%
tpch_q22/duckdb:vortex-file-compressed 36772777 / 36263841 / +1.4% 54442480 / 53808630 / +1.2% 0.68 / 0.67 / +0.2%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 79985016 / 80284294 / -0.4% 104601158 / 102083536 / +2.5% 0.76 / 0.79 / -2.8%
tpch_q02/duckdb:parquet 55762479 / 55355585 / +0.7% 63312179 / 63384321 / -0.1% 0.88 / 0.87 / +0.8%
tpch_q03/duckdb:parquet 119286906 / 120423795 / -0.9% 153231015 / 152981318 / +0.2% 0.78 / 0.79 / -1.1%
tpch_q04/duckdb:parquet 82883115 / 82462370 / +0.5% 102991642 / 102350063 / +0.6% 0.80 / 0.81 / -0.1%
tpch_q05/duckdb:parquet 138822164 / 139672064 / -0.6% 174301870 / 174737031 / -0.2% 0.80 / 0.80 / -0.4%
tpch_q06/duckdb:parquet 39321240 / 39172140 / +0.4% 62083064 / 60605546 / +2.4% 0.63 / 0.65 / -2.0%
tpch_q07/duckdb:parquet 132814453 / 133478547 / -0.5% 173161529 / 174810653 / -0.9% 0.77 / 0.76 / +0.5%
tpch_q08/duckdb:parquet 175664512 / 172690786 / +1.7% 217514575 / 216962992 / +0.3% 0.81 / 0.80 / +1.5%
tpch_q09/duckdb:parquet 179145065 / 178706039 / +0.2% 219595081 / 226092450 / -2.9% 0.82 / 0.79 / +3.2%
tpch_q10/duckdb:parquet 157111432 / 157896196 / -0.5% 178526631 / 179032054 / -0.3% 0.88 / 0.88 / -0.2%
tpch_q11/duckdb:parquet 34221757 / 34268505 / -0.1% 44803277 / 44387668 / +0.9% 0.76 / 0.77 / -1.1%
tpch_q12/duckdb:parquet 76783592 / 76845953 / -0.1% 95883063 / 96306775 / -0.4% 0.80 / 0.80 / +0.4%
tpch_q13/duckdb:parquet 332677456 / 332507798 / +0.1% 347075280 / 347014048 / +0.0% 0.96 / 0.96 / +0.0%
tpch_q14/duckdb:parquet 75924840 / 74362031 / +2.1% 113714774 / 111512641 / +2.0% 0.67 / 0.67 / +0.1%
tpch_q15/duckdb:parquet 70988226 / 70856087 / +0.2% 99798399 / 101109917 / -1.3% 0.71 / 0.70 / +1.5%
tpch_q16/duckdb:parquet 64549640 / 65513458 / -1.5% 67418014 / 67313061 / +0.2% 0.96 / 0.97 / -1.6%
tpch_q17/duckdb:parquet 88919711 / 88249572 / +0.8% 120875280 / 120261520 / +0.5% 0.74 / 0.73 / +0.2%
tpch_q18/duckdb:parquet 179198626 / 182604608 / -1.9% 166559564 / 167547898 / -0.6% 1.08 / 1.09 / -1.3%
tpch_q19/duckdb:parquet 81369514 / 81150692 / +0.3% 118332733 / 119625996 / -1.1% 0.69 / 0.68 / +1.4%
tpch_q20/duckdb:parquet 92409762 / 92544029 / -0.1% 131055271 / 130260533 / +0.6% 0.71 / 0.71 / -0.8%
tpch_q21/duckdb:parquet 280449586 / 279064583 / +0.5% 302476231 / 303593541 / -0.4% 0.93 / 0.92 / +0.9%
tpch_q22/duckdb:parquet 57032111 / 56525226 / +0.9% 67963006 / 68219098 / -0.4% 0.84 / 0.83 / +1.3%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR bb199a5d vs base d270200d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.990x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.987x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1246760 / 1263414 / -1.3% 21896185 / 21504141 / +1.8% 0.06 / 0.06 / -3.1%
clickbench_q01/datafusion:vortex-file-compressed 5768638 / 5723647 / +0.8% 34419863 / 28584622 / +20.4% 🔴 0.17 / 0.20 / -16.3%
clickbench_q02/datafusion:vortex-file-compressed 8975718 / 9382253 / -4.3% 37552656 / 37493555 / +0.2% 0.24 / 0.25 / -4.5%
clickbench_q03/datafusion:vortex-file-compressed 10792197 / 10722368 / +0.7% 53183541 / 52786866 / +0.8% 0.20 / 0.20 / -0.1%
clickbench_q04/datafusion:vortex-file-compressed 56107901 / 54365156 / +3.2% 92872071 / 89116962 / +4.2% 0.60 / 0.61 / -1.0%
clickbench_q05/datafusion:vortex-file-compressed 73076287 / 73296778 / -0.3% 121177956 / 119101808 / +1.7% 0.60 / 0.62 / -2.0%
clickbench_q06/datafusion:vortex-file-compressed 1248089 / 1258368 / -0.8% 21795784 / 21920108 / -0.6% 0.06 / 0.06 / -0.3%
clickbench_q07/datafusion:vortex-file-compressed 8912138 / 9022344 / -1.2% 31622063 / 31527321 / +0.3% 0.28 / 0.29 / -1.5%
clickbench_q08/datafusion:vortex-file-compressed 74433132 / 74244710 / +0.3% 113617027 / 114397584 / -0.7% 0.66 / 0.65 / +0.9%
clickbench_q09/datafusion:vortex-file-compressed 171258528 / 168989817 / +1.3% 208417408 / 207860679 / +0.3% 0.82 / 0.81 / +1.1%
clickbench_q10/datafusion:vortex-file-compressed 22985376 / 23132475 / -0.6% 67288503 / 63392508 / +6.1% 0.34 / 0.36 / -6.4%
clickbench_q11/datafusion:vortex-file-compressed 25337984 / 25249670 / +0.3% 65873020 / 66752829 / -1.3% 0.38 / 0.38 / +1.7%
clickbench_q12/datafusion:vortex-file-compressed 70526728 / 71405590 / -1.2% 114768853 / 118555590 / -3.2% 0.61 / 0.60 / +2.0%
clickbench_q13/datafusion:vortex-file-compressed 116706633 / 116907152 / -0.2% 177250711 / 176035319 / +0.7% 0.66 / 0.66 / -0.9%
clickbench_q14/datafusion:vortex-file-compressed 73931671 / 74324927 / -0.5% 117901171 / 118872641 / -0.8% 0.63 / 0.63 / +0.3%
clickbench_q15/datafusion:vortex-file-compressed 59632879 / 62417768 / -4.5% 96476209 / 95151063 / +1.4% 0.62 / 0.66 / -5.8%
clickbench_q16/datafusion:vortex-file-compressed 148432545 / 152095829 / -2.4% 204405474 / 207166742 / -1.3% 0.73 / 0.73 / -1.1%
clickbench_q17/datafusion:vortex-file-compressed 146653791 / 146499146 / +0.1% 205008151 / 206232623 / -0.6% 0.72 / 0.71 / +0.7%
clickbench_q18/datafusion:vortex-file-compressed 292154076 / 289874646 / +0.8% 371695519 / 385415863 / -3.6% 0.79 / 0.75 / +4.5%
clickbench_q19/datafusion:vortex-file-compressed 7583634 / 7374996 / +2.8% 48003488 / 48225757 / -0.5% 0.16 / 0.15 / +3.3%
clickbench_q20/datafusion:vortex-file-compressed 60088116 / 61966176 / -3.0% 221369014 / 231230479 / -4.3% 0.27 / 0.27 / +1.3%
clickbench_q21/datafusion:vortex-file-compressed 87974260 / 89043482 / -1.2% 265540831 / 264587887 / +0.4% 0.33 / 0.34 / -1.6%
clickbench_q22/datafusion:vortex-file-compressed 97206134 / 99792072 / -2.6% 342819465 / 349826059 / -2.0% 0.28 / 0.29 / -0.6%
clickbench_q23/datafusion:vortex-file-compressed 188615064 / 191540153 / -1.5% 487012465 / 431052733 / +13.0% 🔴 0.39 / 0.44 / -12.8%
clickbench_q24/datafusion:vortex-file-compressed 15520016 / 15449876 / +0.5% 62070863 / 64323866 / -3.5% 0.25 / 0.24 / +4.1%
clickbench_q25/datafusion:vortex-file-compressed 18300944 / 17936340 / +2.0% 61160220 / 58938613 / +3.8% 0.30 / 0.30 / -1.7%
clickbench_q26/datafusion:vortex-file-compressed 15500288 / 15479545 / +0.1% 63195605 / 67672701 / -6.6% 0.25 / 0.23 / +7.2%
clickbench_q27/datafusion:vortex-file-compressed 97845824 / 96047214 / +1.9% 239902540 / 245880425 / -2.4% 0.41 / 0.39 / +4.4%
clickbench_q28/datafusion:vortex-file-compressed 556215987 / 563586646 / -1.3% 604327572 / 623540250 / -3.1% 0.92 / 0.90 / +1.8%
clickbench_q29/datafusion:vortex-file-compressed 22576536 / 23185798 / -2.6% 48716329 / 49483361 / -1.6% 0.46 / 0.47 / -1.1%
clickbench_q30/datafusion:vortex-file-compressed 55705134 / 58484918 / -4.8% 104645529 / 105458505 / -0.8% 0.53 / 0.55 / -4.0%
clickbench_q31/datafusion:vortex-file-compressed 66078059 / 66876132 / -1.2% 150206676 / 152816774 / -1.7% 0.44 / 0.44 / +0.5%
clickbench_q32/datafusion:vortex-file-compressed 282496600 / 296672912 / -4.8% 381638136 / 384507307 / -0.7% 0.74 / 0.77 / -4.1%
clickbench_q33/datafusion:vortex-file-compressed 318710997 / 321275592 / -0.8% 438414322 / 438840272 / -0.1% 0.73 / 0.73 / -0.7%
clickbench_q34/datafusion:vortex-file-compressed 318149282 / 319437272 / -0.4% 417893277 / 431934822 / -3.3% 0.76 / 0.74 / +2.9%
clickbench_q35/datafusion:vortex-file-compressed 54025730 / 56751335 / -4.8% 84727369 / 86716009 / -2.3% 0.64 / 0.65 / -2.6%
clickbench_q36/datafusion:vortex-file-compressed 37412870 / 37159138 / +0.7% 65506105 / 65212230 / +0.5% 0.57 / 0.57 / +0.2%
clickbench_q37/datafusion:vortex-file-compressed 21641884 / 21649628 / -0.0% 47742808 / 46737539 / +2.2% 0.45 / 0.46 / -2.1%
clickbench_q38/datafusion:vortex-file-compressed 11664386 / 11779650 / -1.0% 38850685 / 39200064 / -0.9% 0.30 / 0.30 / -0.1%
clickbench_q39/datafusion:vortex-file-compressed 77390990 / 77557356 / -0.2% 109646012 / 109554588 / +0.1% 0.71 / 0.71 / -0.3%
clickbench_q40/datafusion:vortex-file-compressed 11363619 / 11251030 / +1.0% 36288187 / 36321221 / -0.1% 0.31 / 0.31 / +1.1%
clickbench_q41/datafusion:vortex-file-compressed 10536330 / 10710174 / -1.6% 35621349 / 35916343 / -0.8% 0.30 / 0.30 / -0.8%
clickbench_q42/datafusion:vortex-file-compressed 10846076 / 11101097 / -2.3% 35727473 / 36464898 / -2.0% 0.30 / 0.30 / -0.3%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1254038 / 1257998 / -0.3% 50753663 / 51249978 / -1.0% 0.02 / 0.02 / +0.7%
clickbench_q01/datafusion:parquet 16056064 / 15992357 / +0.4% 71981421 / 68808162 / +4.6% 0.22 / 0.23 / -4.0%
clickbench_q02/datafusion:parquet 18465037 / 18229861 / +1.3% 79517078 / 80621433 / -1.4% 0.23 / 0.23 / +2.7%
clickbench_q03/datafusion:parquet 16606962 / 16624108 / -0.1% 78897190 / 80378918 / -1.8% 0.21 / 0.21 / +1.8%
clickbench_q04/datafusion:parquet 63195270 / 62850747 / +0.5% 120998465 / 126146050 / -4.1% 0.52 / 0.50 / +4.8%
clickbench_q05/datafusion:parquet 89237422 / 88293888 / +1.1% 153272459 / 160785633 / -4.7% 0.58 / 0.55 / +6.0%
clickbench_q06/datafusion:parquet 1251568 / 1269862 / -1.4% 50905520 / 51352457 / -0.9% 0.02 / 0.02 / -0.6%
clickbench_q07/datafusion:parquet 16796526 / 17196414 / -2.3% 68013298 / 69395812 / -2.0% 0.25 / 0.25 / -0.3%
clickbench_q08/datafusion:parquet 86528995 / 84743069 / +2.1% 156495924 / 168409659 / -7.1% 0.55 / 0.50 / +9.9%
clickbench_q09/datafusion:parquet 188319028 / 190057650 / -0.9% 263998009 / 271143581 / -2.6% 0.71 / 0.70 / +1.8%
clickbench_q10/datafusion:parquet 35793268 / 36449889 / -1.8% 100156230 / 101986989 / -1.8% 0.36 / 0.36 / -0.0%
clickbench_q11/datafusion:parquet 42764774 / 42513889 / +0.6% 108421882 / 112273893 / -3.4% 0.39 / 0.38 / +4.2%
clickbench_q12/datafusion:parquet 95621354 / 96214426 / -0.6% 159257910 / 165818634 / -4.0% 0.60 / 0.58 / +3.5%
clickbench_q13/datafusion:parquet 146285342 / 146822884 / -0.4% 231435861 / 227553301 / +1.7% 0.63 / 0.65 / -2.0%
clickbench_q14/datafusion:parquet 101538562 / 102002414 / -0.5% 171398595 / 181099529 / -5.4% 0.59 / 0.56 / +5.2%
clickbench_q15/datafusion:parquet 70447718 / 71970492 / -2.1% 137973134 / 132927100 / +3.8% 0.51 / 0.54 / -5.7%
clickbench_q16/datafusion:parquet 154603584 / 154620893 / -0.0% 235207501 / 235726054 / -0.2% 0.66 / 0.66 / +0.2%
clickbench_q17/datafusion:parquet 156420564 / 156062544 / +0.2% 236496641 / 239083833 / -1.1% 0.66 / 0.65 / +1.3%
clickbench_q18/datafusion:parquet 306547762 / 312702379 / -2.0% 413711391 / 428318067 / -3.4% 0.74 / 0.73 / +1.5%
clickbench_q19/datafusion:parquet 18551168 / 18717484 / -0.9% 76237981 / 78236781 / -2.6% 0.24 / 0.24 / +1.7%
clickbench_q20/datafusion:parquet 176941070 / 179867666 / -1.6% 294440877 / 302300795 / -2.6% 0.60 / 0.59 / +1.0%
clickbench_q21/datafusion:parquet 171628227 / 173871862 / -1.3% 308122022 / 316188116 / -2.6% 0.56 / 0.55 / +1.3%
clickbench_q22/datafusion:parquet 256450518 / 260920070 / -1.7% 415629207 / 453076835 / -8.3% 0.62 / 0.58 / +7.1%
clickbench_q23/datafusion:parquet 1010215315 / 1011100574 / -0.1% 1181175962 / 1197048449 / -1.3% 0.86 / 0.84 / +1.3%
clickbench_q24/datafusion:parquet 29536406 / 30348140 / -2.7% 87007385 / 91193559 / -4.6% 0.34 / 0.33 / +2.0%
clickbench_q25/datafusion:parquet 36634984 / 37437986 / -2.1% 97693567 / 104921563 / -6.9% 0.37 / 0.36 / +5.1%
clickbench_q26/datafusion:parquet 29941226 / 30612899 / -2.2% 86426605 / 93071232 / -7.1% 0.35 / 0.33 / +5.3%
clickbench_q27/datafusion:parquet 192388244 / 193888752 / -0.8% 281911736 / 302969532 / -7.0% 0.68 / 0.64 / +6.6%
clickbench_q28/datafusion:parquet 612510418 / 619170953 / -1.1% 698086640 / 708439139 / -1.5% 0.88 / 0.87 / +0.4%
clickbench_q29/datafusion:parquet 28613354 / 28783752 / -0.6% 89308450 / 90690085 / -1.5% 0.32 / 0.32 / +0.9%
clickbench_q30/datafusion:parquet 91107452 / 91412592 / -0.3% 166879361 / 176451776 / -5.4% 0.55 / 0.52 / +5.4%
clickbench_q31/datafusion:parquet 103862508 / 103107196 / +0.7% 189170015 / 200148149 / -5.5% 0.55 / 0.52 / +6.6%
clickbench_q32/datafusion:parquet 305897980 / 310179424 / -1.4% 429027439 / 426990864 / +0.5% 0.71 / 0.73 / -1.8%
clickbench_q33/datafusion:parquet 374601474 / 376234898 / -0.4% 470629200 / 477330700 / -1.4% 0.80 / 0.79 / +1.0%
clickbench_q34/datafusion:parquet 375523440 / 378563870 / -0.8% 473910872 / 477639794 / -0.8% 0.79 / 0.79 / -0.0%
clickbench_q35/datafusion:parquet 67082082 / 64531013 / +4.0% 123394063 / 123935403 / -0.4% 0.54 / 0.52 / +4.4%
clickbench_q36/datafusion:parquet 73691858 / 73390619 / +0.4% 135023337 / 136729215 / -1.2% 0.55 / 0.54 / +1.7%
clickbench_q37/datafusion:parquet 35543142 / 35779234 / -0.7% 92226946 / 94180899 / -2.1% 0.39 / 0.38 / +1.4%
clickbench_q38/datafusion:parquet 47791836 / 47553372 / +0.5% 106411431 / 111225094 / -4.3% 0.45 / 0.43 / +5.0%
clickbench_q39/datafusion:parquet 142733468 / 143529898 / -0.6% 207918442 / 213596621 / -2.7% 0.69 / 0.67 / +2.2%
clickbench_q40/datafusion:parquet 19844680 / 20026020 / -0.9% 77212398 / 77275408 / -0.1% 0.26 / 0.26 / -0.8%
clickbench_q41/datafusion:parquet 18777554 / 18845828 / -0.4% 76738028 / 76624615 / +0.1% 0.24 / 0.25 / -0.5%
clickbench_q42/datafusion:parquet 19342174 / 19501062 / -0.8% 76824757 / 74346141 / +3.3% 0.25 / 0.26 / -4.0%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2472132 / 2460774 / +0.5% 26309400 / 25632183 / +2.6% 0.09 / 0.10 / -2.1%
clickbench_q01/duckdb:vortex-file-compressed 7622246 / 7478300 / +1.9% 31772714 / 28371675 / +12.0% 🔴 0.24 / 0.26 / -9.0%
clickbench_q02/duckdb:vortex-file-compressed 8230708 / 8195336 / +0.4% 33896316 / 35755944 / -5.2% 0.24 / 0.23 / +5.9%
clickbench_q03/duckdb:vortex-file-compressed 16370826 / 16511744 / -0.9% 55129759 / 61515143 / -10.4% 🟢 0.30 / 0.27 / +10.6%
clickbench_q04/duckdb:vortex-file-compressed 55803404 / 58568130 / -4.7% 98561066 / 101544917 / -2.9% 0.57 / 0.58 / -1.8%
clickbench_q05/duckdb:vortex-file-compressed 65329298 / 65457408 / -0.2% 96938025 / 95370452 / +1.6% 0.67 / 0.69 / -1.8%
clickbench_q06/duckdb:vortex-file-compressed 2813810 / 2765738 / +1.7% 33587902 / 31317299 / +7.3% 0.08 / 0.09 / -5.1%
clickbench_q07/duckdb:vortex-file-compressed 9021250 / 8806761 / +2.4% 32795972 / 28985114 / +13.1% 🔴 0.28 / 0.30 / -9.5%
clickbench_q08/duckdb:vortex-file-compressed 68295840 / 68603723 / -0.4% 109747215 / 113762816 / -3.5% 0.62 / 0.60 / +3.2%
clickbench_q09/duckdb:vortex-file-compressed 87579505 / 90645587 / -3.4% 128709550 / 138001256 / -6.7% 0.68 / 0.66 / +3.6%
clickbench_q10/duckdb:vortex-file-compressed 27906914 / 27523700 / +1.4% 65461869 / 74644225 / -12.3% 🟢 0.43 / 0.37 / +15.6%
clickbench_q11/duckdb:vortex-file-compressed 30185506 / 29916612 / +0.9% 68405369 / 74586195 / -8.3% 0.44 / 0.40 / +10.0%
clickbench_q12/duckdb:vortex-file-compressed 71944471 / 72024875 / -0.1% 99265981 / 103893935 / -4.5% 0.72 / 0.69 / +4.5%
clickbench_q13/duckdb:vortex-file-compressed 128915634 / 129985626 / -0.8% 164895503 / 169425396 / -2.7% 0.78 / 0.77 / +1.9%
clickbench_q14/duckdb:vortex-file-compressed 76168652 / 76960763 / -1.0% 104758957 / 108983735 / -3.9% 0.73 / 0.71 / +3.0%
clickbench_q15/duckdb:vortex-file-compressed 76713854 / 76899128 / -0.2% 113479298 / 119446808 / -5.0% 0.68 / 0.64 / +5.0%
clickbench_q16/duckdb:vortex-file-compressed 139613807 / 140337334 / -0.5% 183183871 / 187437943 / -2.3% 0.76 / 0.75 / +1.8%
clickbench_q17/duckdb:vortex-file-compressed 142586999 / 145804348 / -2.2% 177220848 / 183559183 / -3.5% 0.80 / 0.79 / +1.3%
clickbench_q18/duckdb:vortex-file-compressed 259212948 / 266631077 / -2.8% 313691253 / 328819968 / -4.6% 0.83 / 0.81 / +1.9%
clickbench_q19/duckdb:vortex-file-compressed 9736742 / 9358417 / +4.0% 47473814 / 43337002 / +9.5% 0.21 / 0.22 / -5.0%
clickbench_q20/duckdb:vortex-file-compressed 66599088 / 66052996 / +0.8% 169297904 / 172868514 / -2.1% 0.39 / 0.38 / +3.0%
clickbench_q21/duckdb:vortex-file-compressed 98207692 / 98936984 / -0.7% 272200925 / 284050134 / -4.2% 0.36 / 0.35 / +3.6%
clickbench_q22/duckdb:vortex-file-compressed 177460394 / 177989371 / -0.3% 398022607 / 448461685 / -11.2% 🟢 0.45 / 0.40 / +12.3%
clickbench_q23/duckdb:vortex-file-compressed 34867582 / 36050826 / -3.3% 91870088 / 92084192 / -0.2% 0.38 / 0.39 / -3.1%
clickbench_q24/duckdb:vortex-file-compressed 15002942 / 14882966 / +0.8% 39807301 / 40374315 / -1.4% 0.38 / 0.37 / +2.2%
clickbench_q25/duckdb:vortex-file-compressed 19016592 / 19232500 / -1.1% 54877159 / 55411979 / -1.0% 0.35 / 0.35 / -0.2%
clickbench_q26/duckdb:vortex-file-compressed 11650278 / 11736795 / -0.7% 38057896 / 38129808 / -0.2% 0.31 / 0.31 / -0.5%
clickbench_q27/duckdb:vortex-file-compressed 54102846 / 55906996 / -3.2% 217852464 / 228348690 / -4.6% 0.25 / 0.24 / +1.4%
clickbench_q28/duckdb:vortex-file-compressed 458094976 / 456049460 / +0.4% 520524200 / 529217897 / -1.6% 0.88 / 0.86 / +2.1%
clickbench_q29/duckdb:vortex-file-compressed 18472486 / 18180470 / +1.6% 45852894 / 48528227 / -5.5% 0.40 / 0.37 / +7.5%
clickbench_q30/duckdb:vortex-file-compressed 61017665 / 59745674 / +2.1% 105854074 / 111327257 / -4.9% 0.58 / 0.54 / +7.4%
clickbench_q31/duckdb:vortex-file-compressed 112674309 / 112104451 / +0.5% 186851491 / 180163443 / +3.7% 0.60 / 0.62 / -3.1%
clickbench_q32/duckdb:vortex-file-compressed 390472004 / 379324790 / +2.9% 418408401 / 419957727 / -0.4% 0.93 / 0.90 / +3.3%
clickbench_q33/duckdb:vortex-file-compressed 352967500 / 361673707 / -2.4% 437868503 / 459257678 / -4.7% 0.81 / 0.79 / +2.4%
clickbench_q34/duckdb:vortex-file-compressed 369084846 / 370206934 / -0.3% 460083115 / 479143797 / -4.0% 0.80 / 0.77 / +3.8%
clickbench_q35/duckdb:vortex-file-compressed 60164183 / 57868149 / +4.0% 91784756 / 95619497 / -4.0% 0.66 / 0.61 / +8.3%
clickbench_q36/duckdb:vortex-file-compressed 12404258 / 12303252 / +0.8% 34422260 / 34193501 / +0.7% 0.36 / 0.36 / +0.2%
clickbench_q37/duckdb:vortex-file-compressed 8521400 / 8626968 / -1.2% 30587151 / 32720106 / -6.5% 0.28 / 0.26 / +5.7%
clickbench_q38/duckdb:vortex-file-compressed 9210750 / 9406338 / -2.1% 30909250 / 33447105 / -7.6% 0.30 / 0.28 / +6.0%
clickbench_q39/duckdb:vortex-file-compressed 20649999 / 20671180 / -0.1% 42913820 / 45009083 / -4.7% 0.48 / 0.46 / +4.8%
clickbench_q40/duckdb:vortex-file-compressed 7561583 / 7511632 / +0.7% 31559053 / 29513080 / +6.9% 0.24 / 0.25 / -5.9%
clickbench_q41/duckdb:vortex-file-compressed 8348196 / 8376094 / -0.3% 30705918 / 29629303 / +3.6% 0.27 / 0.28 / -3.8%
clickbench_q42/duckdb:vortex-file-compressed 7554889 / 7627772 / -1.0% 30687982 / 31367610 / -2.2% 0.25 / 0.24 / +1.2%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 12513581 / 12932688 / -3.2% 19042506 / 19289146 / -1.3% 0.66 / 0.67 / -2.0%
clickbench_q01/duckdb:parquet 20263308 / 19262904 / +5.2% 25411663 / 25388411 / +0.1% 0.80 / 0.76 / +5.1%
clickbench_q02/duckdb:parquet 27176650 / 27327352 / -0.6% 35886935 / 37772009 / -5.0% 0.76 / 0.72 / +4.7%
clickbench_q03/duckdb:parquet 26766212 / 26587340 / +0.7% 43190190 / 41100008 / +5.1% 0.62 / 0.65 / -4.2%
clickbench_q04/duckdb:parquet 66138382 / 65414997 / +1.1% 80555285 / 83558804 / -3.6% 0.82 / 0.78 / +4.9%
clickbench_q05/duckdb:parquet 87561916 / 89884955 / -2.6% 105969620 / 107142377 / -1.1% 0.83 / 0.84 / -1.5%
clickbench_q06/duckdb:parquet 25333855 / 25265130 / +0.3% 32820020 / 32124566 / +2.2% 0.77 / 0.79 / -1.9%
clickbench_q07/duckdb:parquet 21370840 / 21556709 / -0.9% 29695378 / 27809973 / +6.8% 0.72 / 0.78 / -7.2%
clickbench_q08/duckdb:parquet 78123720 / 77997936 / +0.2% 93866221 / 90879973 / +3.3% 0.83 / 0.86 / -3.0%
clickbench_q09/duckdb:parquet 104863330 / 105545644 / -0.6% 127420187 / 123001549 / +3.6% 0.82 / 0.86 / -4.1%
clickbench_q10/duckdb:parquet 45101504 / 45492238 / -0.9% 60466006 / 59528365 / +1.6% 0.75 / 0.76 / -2.4%
clickbench_q11/duckdb:parquet 50292510 / 51389866 / -2.1% 67116166 / 69849991 / -3.9% 0.75 / 0.74 / +1.9%
clickbench_q12/duckdb:parquet 98209378 / 99069860 / -0.9% 117749925 / 116120242 / +1.4% 0.83 / 0.85 / -2.2%
clickbench_q13/duckdb:parquet 158505335 / 157996337 / +0.3% 181689943 / 182177812 / -0.3% 0.87 / 0.87 / +0.6%
clickbench_q14/duckdb:parquet 108768314 / 109166775 / -0.4% 132879449 / 130867214 / +1.5% 0.82 / 0.83 / -1.9%
clickbench_q15/duckdb:parquet 91743414 / 92460925 / -0.8% 106098708 / 108326866 / -2.1% 0.86 / 0.85 / +1.3%
clickbench_q16/duckdb:parquet 176967753 / 179901930 / -1.6% 192056648 / 193649118 / -0.8% 0.92 / 0.93 / -0.8%
clickbench_q17/duckdb:parquet 178039408 / 185663408 / -4.1% 194984717 / 194079653 / +0.5% 0.91 / 0.96 / -4.6%
clickbench_q18/duckdb:parquet 314989526 / 311080270 / +1.3% 344542936 / 343501640 / +0.3% 0.91 / 0.91 / +1.0%
clickbench_q19/duckdb:parquet 23541348 / 23826262 / -1.2% 31539573 / 33719846 / -6.5% 0.75 / 0.71 / +5.6%
clickbench_q20/duckdb:parquet 188001954 / 195217536 / -3.7% 235749430 / 248950611 / -5.3% 0.80 / 0.78 / +1.7%
clickbench_q21/duckdb:parquet 234850876 / 229511160 / +2.3% 280489003 / 272401599 / +3.0% 0.84 / 0.84 / -0.6%
clickbench_q22/duckdb:parquet 328180330 / 326377726 / +0.6% 373658406 / 385428768 / -3.1% 0.88 / 0.85 / +3.7%
clickbench_q23/duckdb:parquet 187613910 / 179124993 / +4.7% 242503656 / 239075589 / +1.4% 0.77 / 0.75 / +3.3%
clickbench_q24/duckdb:parquet 35539670 / 36550134 / -2.8% 42931941 / 44577927 / -3.7% 0.83 / 0.82 / +1.0%
clickbench_q25/duckdb:parquet 46690733 / 47060986 / -0.8% 67851371 / 63859675 / +6.3% 0.69 / 0.74 / -6.6%
clickbench_q26/duckdb:parquet 36355282 / 36284955 / +0.2% 46762203 / 48243820 / -3.1% 0.78 / 0.75 / +3.4%
clickbench_q27/duckdb:parquet 201558404 / 200334614 / +0.6% 240843698 / 247648358 / -2.7% 0.84 / 0.81 / +3.5%
clickbench_q28/duckdb:parquet 852456144 / 840244340 / +1.5% 843491589 / 839734300 / +0.4% 1.01 / 1.00 / +1.0%
clickbench_q29/duckdb:parquet 30676730 / 30701560 / -0.1% 41728583 / 39135900 / +6.6% 0.74 / 0.78 / -6.3%
clickbench_q30/duckdb:parquet 110945919 / 111055856 / -0.1% 140435469 / 137097878 / +2.4% 0.79 / 0.81 / -2.5%
clickbench_q31/duckdb:parquet 165238816 / 166956364 / -1.0% 187180661 / 214679060 / -12.8% 🟢 0.88 / 0.78 / +13.5%
clickbench_q32/duckdb:parquet 401656417 / 402243770 / -0.1% 427081922 / 420796935 / +1.5% 0.94 / 0.96 / -1.6%
clickbench_q33/duckdb:parquet 474753965 / 481015907 / -1.3% 461814338 / 473239481 / -2.4% 1.03 / 1.02 / +1.1%
clickbench_q34/duckdb:parquet 482579026 / 487112054 / -0.9% 474298215 / 472647354 / +0.3% 1.02 / 1.03 / -1.3%
clickbench_q35/duckdb:parquet 65969888 / 66570893 / -0.9% 80962536 / 80314598 / +0.8% 0.81 / 0.83 / -1.7%
clickbench_q36/duckdb:parquet 37117060 / 37538342 / -1.1% 46844193 / 45787813 / +2.3% 0.79 / 0.82 / -3.4%
clickbench_q37/duckdb:parquet 28485659 / 28435990 / +0.2% 36065247 / 37364788 / -3.5% 0.79 / 0.76 / +3.8%
clickbench_q38/duckdb:parquet 30663038 / 30694778 / -0.1% 39612497 / 38565659 / +2.7% 0.77 / 0.80 / -2.7%
clickbench_q39/duckdb:parquet 63726788 / 63073209 / +1.0% 72066522 / 72755605 / -0.9% 0.88 / 0.87 / +2.0%
clickbench_q40/duckdb:parquet 18022390 / 17596888 / +2.4% 26598683 / 26841646 / -0.9% 0.68 / 0.66 / +3.4%
clickbench_q41/duckdb:parquet 18639250 / 18750233 / -0.6% 26521904 / 26406651 / +0.4% 0.70 / 0.71 / -1.0%
clickbench_q42/duckdb:parquet 18494154 / 18414249 / +0.4% 27226460 / 27041690 / +0.7% 0.68 / 0.68 / -0.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR bb199a5d vs base d270200d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.007x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.006x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24052714 / 24420666 / -1.5% 40386673 / 41281865 / -2.2% 0.60 / 0.59 / +0.7%
tpcds_q02/datafusion:vortex-file-compressed 47080853 / 47431110 / -0.7% 65987247 / 63913641 / +3.2% 0.71 / 0.74 / -3.9%
tpcds_q03/datafusion:vortex-file-compressed 11544654 / 11723505 / -1.5% 27229329 / 27161778 / +0.2% 0.42 / 0.43 / -1.8%
tpcds_q04/datafusion:vortex-file-compressed 123782113 / 124886560 / -0.9% 154251956 / 153642586 / +0.4% 0.80 / 0.81 / -1.3%
tpcds_q05/datafusion:vortex-file-compressed 58569402 / 59362226 / -1.3% 78574741 / 79288903 / -0.9% 0.75 / 0.75 / -0.4%
tpcds_q06/datafusion:vortex-file-compressed 22674240 / 22659033 / +0.1% 44156373 / 43919851 / +0.5% 0.51 / 0.52 / -0.5%
tpcds_q07/datafusion:vortex-file-compressed 31219918 / 31676994 / -1.4% 52075355 / 53100859 / -1.9% 0.60 / 0.60 / +0.5%
tpcds_q08/datafusion:vortex-file-compressed 24396556 / 24209822 / +0.8% 40186845 / 41622010 / -3.4% 0.61 / 0.58 / +4.4%
tpcds_q09/datafusion:vortex-file-compressed 16581219 / 17038212 / -2.7% 34289537 / 33352912 / +2.8% 0.48 / 0.51 / -5.3%
tpcds_q10/datafusion:vortex-file-compressed 27715746 / 27343871 / +1.4% 47142478 / 46897016 / +0.5% 0.59 / 0.58 / +0.8%
tpcds_q11/datafusion:vortex-file-compressed 64541538 / 64120750 / +0.7% 90268332 / 92229983 / -2.1% 0.71 / 0.70 / +2.8%
tpcds_q12/datafusion:vortex-file-compressed 16485124 / 16582494 / -0.6% 32206364 / 32125728 / +0.3% 0.51 / 0.52 / -0.8%
tpcds_q13/datafusion:vortex-file-compressed 32216178 / 32005700 / +0.7% 54064624 / 53167509 / +1.7% 0.60 / 0.60 / -1.0%
tpcds_q14/datafusion:vortex-file-compressed 497185300 / 495576188 / +0.3% 559657954 / 553297880 / +1.1% 0.89 / 0.90 / -0.8%
tpcds_q15/datafusion:vortex-file-compressed 15388297 / 15612182 / -1.4% 34596367 / 33524986 / +3.2% 0.44 / 0.47 / -4.5%
tpcds_q16/datafusion:vortex-file-compressed 19623642 / 20023888 / -2.0% 38321335 / 37994494 / +0.9% 0.51 / 0.53 / -2.8%
tpcds_q17/datafusion:vortex-file-compressed 59176182 / 55711443 / +6.2% 75894077 / 72623221 / +4.5% 0.78 / 0.77 / +1.6%
tpcds_q18/datafusion:vortex-file-compressed 68791914 / 68069904 / +1.1% 89624906 / 92032345 / -2.6% 0.77 / 0.74 / +3.8%
tpcds_q19/datafusion:vortex-file-compressed 16745648 / 17304103 / -3.2% 39762706 / 37229410 / +6.8% 0.42 / 0.46 / -9.4%
tpcds_q20/datafusion:vortex-file-compressed 17771412 / 18124554 / -1.9% 33874719 / 34468946 / -1.7% 0.52 / 0.53 / -0.2%
tpcds_q21/datafusion:vortex-file-compressed 16196974 / 17114398 / -5.4% 38333919 / 38152750 / +0.5% 0.42 / 0.45 / -5.8%
tpcds_q22/datafusion:vortex-file-compressed 58310980 / 58068306 / +0.4% 81459928 / 80198917 / +1.6% 0.72 / 0.72 / -1.1%
tpcds_q23/datafusion:vortex-file-compressed 70725914 / 72749600 / -2.8% 95848982 / 97779682 / -2.0% 0.74 / 0.74 / -0.8%
tpcds_q24/datafusion:vortex-file-compressed 67428873 / 67025334 / +0.6% 89482892 / 89439825 / +0.0% 0.75 / 0.75 / +0.6%
tpcds_q25/datafusion:vortex-file-compressed 47082476 / 50179734 / -6.2% 78219262 / 78345544 / -0.2% 0.60 / 0.64 / -6.0%
tpcds_q26/datafusion:vortex-file-compressed 30416780 / 29926132 / +1.6% 49911259 / 49527819 / +0.8% 0.61 / 0.60 / +0.9%
tpcds_q27/datafusion:vortex-file-compressed 65220602 / 58678186 / +11.1% 🔴 90491318 / 82233912 / +10.0% 🔴 0.72 / 0.71 / +1.0%
tpcds_q28/datafusion:vortex-file-compressed 17427862 / 18015568 / -3.3% 37322307 / 37378151 / -0.1% 0.47 / 0.48 / -3.1%
tpcds_q29/datafusion:vortex-file-compressed 57049989 / 51125020 / +11.6% 🔴 92440177 / 80861622 / +14.3% 🔴 0.62 / 0.63 / -2.4%
tpcds_q30/datafusion:vortex-file-compressed 26504438 / 26560430 / -0.2% 44640311 / 42841544 / +4.2% 0.59 / 0.62 / -4.2%
tpcds_q31/datafusion:vortex-file-compressed 58771699 / 58139888 / +1.1% 82697123 / 83520677 / -1.0% 0.71 / 0.70 / +2.1%
tpcds_q32/datafusion:vortex-file-compressed 13596343 / 13677487 / -0.6% 30431360 / 29630064 / +2.7% 0.45 / 0.46 / -3.2%
tpcds_q33/datafusion:vortex-file-compressed 27626339 / 27516018 / +0.4% 48953080 / 48629287 / +0.7% 0.56 / 0.57 / -0.3%
tpcds_q34/datafusion:vortex-file-compressed 17990278 / 17480698 / +2.9% 34338673 / 33893394 / +1.3% 0.52 / 0.52 / +1.6%
tpcds_q35/datafusion:vortex-file-compressed 33593822 / 34003137 / -1.2% 56794472 / 56857490 / -0.1% 0.59 / 0.60 / -1.1%
tpcds_q36/datafusion:vortex-file-compressed 47190228 / 47892504 / -1.5% 72153794 / 70679133 / +2.1% 0.65 / 0.68 / -3.5%
tpcds_q37/datafusion:vortex-file-compressed 11720106 / 13039590 / -10.1% 🟢 31026136 / 31483474 / -1.5% 0.38 / 0.41 / -8.8%
tpcds_q38/datafusion:vortex-file-compressed 30390840 / 30268114 / +0.4% 48568469 / 49085672 / -1.1% 0.63 / 0.62 / +1.5%
tpcds_q39/datafusion:vortex-file-compressed 61274232 / 61653668 / -0.6% 88017647 / 85501239 / +2.9% 0.70 / 0.72 / -3.5%
tpcds_q40/datafusion:vortex-file-compressed 24355622 / 24117522 / +1.0% 43022837 / 42507385 / +1.2% 0.57 / 0.57 / -0.2%
tpcds_q41/datafusion:vortex-file-compressed 17088262 / 17188868 / -0.6% 30244857 / 30102009 / +0.5% 0.56 / 0.57 / -1.1%
tpcds_q42/datafusion:vortex-file-compressed 11312448 / 11179837 / +1.2% 26077183 / 26141554 / -0.2% 0.43 / 0.43 / +1.4%
tpcds_q43/datafusion:vortex-file-compressed 12791178 / 12930740 / -1.1% 28898147 / 29137482 / -0.8% 0.44 / 0.44 / -0.3%
tpcds_q44/datafusion:vortex-file-compressed 25415885 / 25912772 / -1.9% 46670022 / 45245341 / +3.1% 0.54 / 0.57 / -4.9%
tpcds_q45/datafusion:vortex-file-compressed 18269380 / 18332104 / -0.3% 36282551 / 35898738 / +1.1% 0.50 / 0.51 / -1.4%
tpcds_q46/datafusion:vortex-file-compressed 23193316 / 23096830 / +0.4% 45102075 / 43512734 / +3.7% 0.51 / 0.53 / -3.1%
tpcds_q47/datafusion:vortex-file-compressed 77534702 / 76949252 / +0.8% 106938771 / 104976505 / +1.9% 0.73 / 0.73 / -1.1%
tpcds_q48/datafusion:vortex-file-compressed 29891392 / 29942016 / -0.2% 49242606 / 50228058 / -2.0% 0.61 / 0.60 / +1.8%
tpcds_q49/datafusion:vortex-file-compressed 56348090 / 58373527 / -3.5% 78814947 / 78394893 / +0.5% 0.71 / 0.74 / -4.0%
tpcds_q50/datafusion:vortex-file-compressed 32542468 / 33039868 / -1.5% 53818568 / 51230970 / +5.1% 0.60 / 0.64 / -6.2%
tpcds_q51/datafusion:vortex-file-compressed 67577470 / 68327429 / -1.1% 89095502 / 88721206 / +0.4% 0.76 / 0.77 / -1.5%
tpcds_q52/datafusion:vortex-file-compressed 11902634 / 11785394 / +1.0% 26997009 / 26300947 / +2.6% 0.44 / 0.45 / -1.6%
tpcds_q53/datafusion:vortex-file-compressed 17913918 / 17741310 / +1.0% 36914135 / 36055529 / +2.4% 0.49 / 0.49 / -1.4%
tpcds_q54/datafusion:vortex-file-compressed 32555042 / 33193087 / -1.9% 59659827 / 57100247 / +4.5% 0.55 / 0.58 / -6.1%
tpcds_q55/datafusion:vortex-file-compressed 11276622 / 11271819 / +0.0% 26198438 / 25380268 / +3.2% 0.43 / 0.44 / -3.1%
tpcds_q56/datafusion:vortex-file-compressed 26509674 / 27000977 / -1.8% 47514630 / 47148125 / +0.8% 0.56 / 0.57 / -2.6%
tpcds_q57/datafusion:vortex-file-compressed 77139644 / 77615244 / -0.6% 101656666 / 100310111 / +1.3% 0.76 / 0.77 / -1.9%
tpcds_q58/datafusion:vortex-file-compressed 40319386 / 40933062 / -1.5% 64995388 / 64407422 / +0.9% 0.62 / 0.64 / -2.4%
tpcds_q59/datafusion:vortex-file-compressed 31143282 / 31044882 / +0.3% 51353944 / 50655448 / +1.4% 0.61 / 0.61 / -1.0%
tpcds_q60/datafusion:vortex-file-compressed 26263826 / 26980148 / -2.7% 47994709 / 45064856 / +6.5% 0.55 / 0.60 / -8.6%
tpcds_q61/datafusion:vortex-file-compressed 23406786 / 22302632 / +5.0% 43222942 / 42999231 / +0.5% 0.54 / 0.52 / +4.4%
tpcds_q62/datafusion:vortex-file-compressed 18123801 / 17982738 / +0.8% 33601738 / 32302190 / +4.0% 0.54 / 0.56 / -3.1%
tpcds_q63/datafusion:vortex-file-compressed 17889998 / 17834000 / +0.3% 37787200 / 37104256 / +1.8% 0.47 / 0.48 / -1.5%
tpcds_q64/datafusion:vortex-file-compressed 225077528 / 224131818 / +0.4% 259960855 / 266085838 / -2.3% 0.87 / 0.84 / +2.8%
tpcds_q65/datafusion:vortex-file-compressed 76026931 / 74406244 / +2.2% 96629699 / 95151269 / +1.6% 0.79 / 0.78 / +0.6%
tpcds_q66/datafusion:vortex-file-compressed 51894963 / 52393016 / -1.0% 70861414 / 71410238 / -0.8% 0.73 / 0.73 / -0.2%
tpcds_q67/datafusion:vortex-file-compressed 57938199 / 58435230 / -0.9% 85893356 / 85674975 / +0.3% 0.67 / 0.68 / -1.1%
tpcds_q68/datafusion:vortex-file-compressed 22451866 / 22335088 / +0.5% 45586226 / 44267435 / +3.0% 0.49 / 0.50 / -2.4%
tpcds_q69/datafusion:vortex-file-compressed 27175210 / 27399846 / -0.8% 48263991 / 45894508 / +5.2% 0.56 / 0.60 / -5.7%
tpcds_q70/datafusion:vortex-file-compressed 23013659 / 23151952 / -0.6% 44460981 / 43876402 / +1.3% 0.52 / 0.53 / -1.9%
tpcds_q71/datafusion:vortex-file-compressed 18025029 / 19762987 / -8.8% 38595476 / 35551115 / +8.6% 0.47 / 0.56 / -16.0%
tpcds_q72/datafusion:vortex-file-compressed 341916030 / 354706928 / -3.6% 406865232 / 396581694 / +2.6% 0.84 / 0.89 / -6.0%
tpcds_q73/datafusion:vortex-file-compressed 16087376 / 16530411 / -2.7% 35433615 / 34670921 / +2.2% 0.45 / 0.48 / -4.8%
tpcds_q74/datafusion:vortex-file-compressed 45697776 / 45955776 / -0.6% 70986027 / 69915157 / +1.5% 0.64 / 0.66 / -2.1%
tpcds_q75/datafusion:vortex-file-compressed 139020144 / 138539320 / +0.3% 164013783 / 161918323 / +1.3% 0.85 / 0.86 / -0.9%
tpcds_q76/datafusion:vortex-file-compressed 25975809 / 26647843 / -2.5% 43574352 / 45115611 / -3.4% 0.60 / 0.59 / +0.9%
tpcds_q77/datafusion:vortex-file-compressed 45110551 / 45415814 / -0.7% 64177725 / 62591959 / +2.5% 0.70 / 0.73 / -3.1%
tpcds_q78/datafusion:vortex-file-compressed 68405092 / 68079652 / +0.5% 97043300 / 94684746 / +2.5% 0.70 / 0.72 / -2.0%
tpcds_q79/datafusion:vortex-file-compressed 19637618 / 19727424 / -0.5% 41470620 / 40934213 / +1.3% 0.47 / 0.48 / -1.7%
tpcds_q80/datafusion:vortex-file-compressed 75135822 / 74248622 / +1.2% 99996017 / 102049145 / -2.0% 0.75 / 0.73 / +3.3%
tpcds_q81/datafusion:vortex-file-compressed 27295756 / 27003097 / +1.1% 45535108 / 43080032 / +5.7% 0.60 / 0.63 / -4.4%
tpcds_q82/datafusion:vortex-file-compressed 12388257 / 12354506 / +0.3% 32127872 / 33095031 / -2.9% 0.39 / 0.37 / +3.3%
tpcds_q83/datafusion:vortex-file-compressed 35743549 / 35631672 / +0.3% 53226552 / 53819376 / -1.1% 0.67 / 0.66 / +1.4%
tpcds_q84/datafusion:vortex-file-compressed 11829923 / 11622246 / +1.8% 25336562 / 24541959 / +3.2% 0.47 / 0.47 / -1.4%
tpcds_q85/datafusion:vortex-file-compressed 57340720 / 57531176 / -0.3% 81085555 / 82209078 / -1.4% 0.71 / 0.70 / +1.0%
tpcds_q86/datafusion:vortex-file-compressed 16455113 / 16753368 / -1.8% 32399687 / 31595049 / +2.5% 0.51 / 0.53 / -4.2%
tpcds_q87/datafusion:vortex-file-compressed 29547768 / 29438992 / +0.4% 49225894 / 49566954 / -0.7% 0.60 / 0.59 / +1.1%
tpcds_q88/datafusion:vortex-file-compressed 33063946 / 32085726 / +3.0% 63475842 / 60810608 / +4.4% 0.52 / 0.53 / -1.3%
tpcds_q89/datafusion:vortex-file-compressed 20999862 / 20636756 / +1.8% 40386476 / 39432556 / +2.4% 0.52 / 0.52 / -0.6%
tpcds_q90/datafusion:vortex-file-compressed 10281827 / 10199986 / +0.8% 24812965 / 25019472 / -0.8% 0.41 / 0.41 / +1.6%
tpcds_q91/datafusion:vortex-file-compressed 16298651 / 16038405 / +1.6% 34967680 / 34621916 / +1.0% 0.47 / 0.46 / +0.6%
tpcds_q92/datafusion:vortex-file-compressed 13780152 / 13551662 / +1.7% 29986567 / 29249384 / +2.5% 0.46 / 0.46 / -0.8%
tpcds_q93/datafusion:vortex-file-compressed 22164300 / 22604718 / -1.9% 40646750 / 39626744 / +2.6% 0.55 / 0.57 / -4.4%
tpcds_q94/datafusion:vortex-file-compressed 19432091 / 19361215 / +0.4% 35301616 / 35747265 / -1.2% 0.55 / 0.54 / +1.6%
tpcds_q95/datafusion:vortex-file-compressed 45363734 / 44776266 / +1.3% 64282863 / 64389249 / -0.2% 0.71 / 0.70 / +1.5%
tpcds_q96/datafusion:vortex-file-compressed 8503146 / 8300024 / +2.4% 25428547 / 23890636 / +6.4% 0.33 / 0.35 / -3.7%
tpcds_q97/datafusion:vortex-file-compressed 21368869 / 21109985 / +1.2% 41002056 / 39534303 / +3.7% 0.52 / 0.53 / -2.4%
tpcds_q98/datafusion:vortex-file-compressed 16975571 / 16917617 / +0.3% 36286414 / 34831386 / +4.2% 0.47 / 0.49 / -3.7%
tpcds_q99/datafusion:vortex-file-compressed 20838218 / 20706564 / +0.6% 36184916 / 35200562 / +2.8% 0.58 / 0.59 / -2.1%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42728228 / 43890012 / -2.6% 60541476 / 58085919 / +4.2% 0.71 / 0.76 / -6.6%
tpcds_q02/datafusion:parquet 55632188 / 55311458 / +0.6% 70593419 / 70635554 / -0.1% 0.79 / 0.78 / +0.6%
tpcds_q03/datafusion:parquet 19203698 / 19205204 / -0.0% 32555484 / 30959837 / +5.2% 0.59 / 0.62 / -4.9%
tpcds_q04/datafusion:parquet 180532014 / 180954231 / -0.2% 204462622 / 204756864 / -0.1% 0.88 / 0.88 / -0.1%
tpcds_q05/datafusion:parquet 67765166 / 68910674 / -1.7% 90718052 / 89885895 / +0.9% 0.75 / 0.77 / -2.6%
tpcds_q06/datafusion:parquet 33301778 / 33043806 / +0.8% 49168634 / 50137263 / -1.9% 0.68 / 0.66 / +2.8%
tpcds_q07/datafusion:parquet 46600166 / 47652511 / -2.2% 63306619 / 64130645 / -1.3% 0.74 / 0.74 / -0.9%
tpcds_q08/datafusion:parquet 31349645 / 31057256 / +0.9% 46894433 / 42815557 / +9.5% 0.67 / 0.73 / -7.8%
tpcds_q09/datafusion:parquet 31446180 / 33269318 / -5.5% 35998226 / 38327534 / -6.1% 0.87 / 0.87 / +0.6%
tpcds_q10/datafusion:parquet 44417649 / 43613502 / +1.8% 56704904 / 55048819 / +3.0% 0.78 / 0.79 / -1.1%
tpcds_q11/datafusion:parquet 99151116 / 100250221 / -1.1% 120239393 / 119739028 / +0.4% 0.82 / 0.84 / -1.5%
tpcds_q12/datafusion:parquet 23808922 / 23622296 / +0.8% 35484111 / 35793094 / -0.9% 0.67 / 0.66 / +1.7%
tpcds_q13/datafusion:parquet 45934256 / 46371776 / -0.9% 67701458 / 66220331 / +2.2% 0.68 / 0.70 / -3.1%
tpcds_q14/datafusion:parquet 534328632 / 534469225 / -0.0% 587487676 / 593123627 / -1.0% 0.91 / 0.90 / +0.9%
tpcds_q15/datafusion:parquet 24054862 / 23379706 / +2.9% 39213023 / 37867823 / +3.6% 0.61 / 0.62 / -0.6%
tpcds_q16/datafusion:parquet 36918383 / 37606427 / -1.8% 51268581 / 49494614 / +3.6% 0.72 / 0.76 / -5.2%
tpcds_q17/datafusion:parquet 73849123 / 73179844 / +0.9% 99058926 / 97209166 / +1.9% 0.75 / 0.75 / -1.0%
tpcds_q18/datafusion:parquet 68590630 / 66081368 / +3.8% 92206330 / 88647051 / +4.0% 0.74 / 0.75 / -0.2%
tpcds_q19/datafusion:parquet 29439212 / 29797932 / -1.2% 42763412 / 42781751 / -0.0% 0.69 / 0.70 / -1.2%
tpcds_q20/datafusion:parquet 25636104 / 25075280 / +2.2% 37539004 / 36024876 / +4.2% 0.68 / 0.70 / -1.9%
tpcds_q21/datafusion:parquet 20157826 / 20188460 / -0.2% 33048856 / 31273842 / +5.7% 0.61 / 0.65 / -5.5%
tpcds_q22/datafusion:parquet 77979284 / 77073442 / +1.2% 89245472 / 88614172 / +0.7% 0.87 / 0.87 / +0.5%
tpcds_q23/datafusion:parquet 93314119 / 93212706 / +0.1% 115263174 / 112837716 / +2.1% 0.81 / 0.83 / -2.0%
tpcds_q24/datafusion:parquet 90786507 / 91259862 / -0.5% 116359501 / 116006193 / +0.3% 0.78 / 0.79 / -0.8%
tpcds_q25/datafusion:parquet 79981384 / 80500935 / -0.6% 106708571 / 97345522 / +9.6% 0.75 / 0.83 / -9.4%
tpcds_q26/datafusion:parquet 43196910 / 43981704 / -1.8% 58791771 / 57943229 / +1.5% 0.73 / 0.76 / -3.2%
tpcds_q27/datafusion:parquet 77684500 / 78321726 / -0.8% 98764126 / 95170755 / +3.8% 0.79 / 0.82 / -4.4%
tpcds_q28/datafusion:parquet 28688846 / 28603876 / +0.3% 42784727 / 41636187 / +2.8% 0.67 / 0.69 / -2.4%
tpcds_q29/datafusion:parquet 75396960 / 74682498 / +1.0% 97477793 / 95420003 / +2.2% 0.77 / 0.78 / -1.2%
tpcds_q30/datafusion:parquet 46279644 / 47243796 / -2.0% 57157966 / 58006019 / -1.5% 0.81 / 0.81 / -0.6%
tpcds_q31/datafusion:parquet 80466475 / 80824830 / -0.4% 100505692 / 98947533 / +1.6% 0.80 / 0.82 / -2.0%
tpcds_q32/datafusion:parquet 26394156 / 26851631 / -1.7% 40572475 / 40836100 / -0.6% 0.65 / 0.66 / -1.1%
tpcds_q33/datafusion:parquet 38543082 / 38654976 / -0.3% 55473963 / 49179060 / +12.8% 🔴 0.69 / 0.79 / -11.6%
tpcds_q34/datafusion:parquet 24432911 / 24566042 / -0.5% 36255691 / 35563142 / +1.9% 0.67 / 0.69 / -2.4%
tpcds_q35/datafusion:parquet 50379365 / 50997858 / -1.2% 65262909 / 64780675 / +0.7% 0.77 / 0.79 / -1.9%
tpcds_q36/datafusion:parquet 53306428 / 51877660 / +2.8% 74069465 / 73662951 / +0.6% 0.72 / 0.70 / +2.2%
tpcds_q37/datafusion:parquet 21294198 / 21301677 / -0.0% 33325007 / 33797003 / -1.4% 0.64 / 0.63 / +1.4%
tpcds_q38/datafusion:parquet 43382998 / 44433333 / -2.4% 63552150 / 63900736 / -0.5% 0.68 / 0.70 / -1.8%
tpcds_q39/datafusion:parquet 68282872 / 68447941 / -0.2% 85686002 / 86504577 / -0.9% 0.80 / 0.79 / +0.7%
tpcds_q40/datafusion:parquet 30731948 / 31491938 / -2.4% 49385022 / 50038180 / -1.3% 0.62 / 0.63 / -1.1%
tpcds_q41/datafusion:parquet 19647199 / 19353338 / +1.5% 31567222 / 31872596 / -1.0% 0.62 / 0.61 / +2.5%
tpcds_q42/datafusion:parquet 18182100 / 18038634 / +0.8% 32200454 / 30198006 / +6.6% 0.56 / 0.60 / -5.5%
tpcds_q43/datafusion:parquet 19049099 / 19342574 / -1.5% 32439201 / 31128463 / +4.2% 0.59 / 0.62 / -5.5%
tpcds_q44/datafusion:parquet 34164635 / 34713082 / -1.6% 49793467 / 49413652 / +0.8% 0.69 / 0.70 / -2.3%
tpcds_q45/datafusion:parquet 27904884 / 27936833 / -0.1% 40835814 / 37737428 / +8.2% 0.68 / 0.74 / -7.7%
tpcds_q46/datafusion:parquet 29036589 / 29598708 / -1.9% 44791330 / 46447797 / -3.6% 0.65 / 0.64 / +1.7%
tpcds_q47/datafusion:parquet 99062226 / 98940466 / +0.1% 120757357 / 119520780 / +1.0% 0.82 / 0.83 / -0.9%
tpcds_q48/datafusion:parquet 42083649 / 41886476 / +0.5% 61691268 / 60907589 / +1.3% 0.68 / 0.69 / -0.8%
tpcds_q49/datafusion:parquet 71388963 / 72314512 / -1.3% 95330261 / 94381759 / +1.0% 0.75 / 0.77 / -2.3%
tpcds_q50/datafusion:parquet 47493161 / 47867547 / -0.8% 66509302 / 66398776 / +0.2% 0.71 / 0.72 / -0.9%
tpcds_q51/datafusion:parquet 75601937 / 75549763 / +0.1% 94313751 / 94684762 / -0.4% 0.80 / 0.80 / +0.5%
tpcds_q52/datafusion:parquet 18749649 / 18825764 / -0.4% 29855762 / 29861393 / -0.0% 0.63 / 0.63 / -0.4%
tpcds_q53/datafusion:parquet 22239663 / 22102662 / +0.6% 38535629 / 37287705 / +3.3% 0.58 / 0.59 / -2.6%
tpcds_q54/datafusion:parquet 52416160 / 52264439 / +0.3% 64809304 / 68207985 / -5.0% 0.81 / 0.77 / +5.5%
tpcds_q55/datafusion:parquet 18106526 / 18071042 / +0.2% 32011995 / 31278180 / +2.3% 0.57 / 0.58 / -2.1%
tpcds_q56/datafusion:parquet 40936215 / 41065324 / -0.3% 55429950 / 55082849 / +0.6% 0.74 / 0.75 / -0.9%
tpcds_q57/datafusion:parquet 101558576 / 101257162 / +0.3% 117828661 / 120849110 / -2.5% 0.86 / 0.84 / +2.9%
tpcds_q58/datafusion:parquet 65542498 / 65849746 / -0.5% 83194204 / 79516020 / +4.6% 0.79 / 0.83 / -4.9%
tpcds_q59/datafusion:parquet 48091294 / 48606930 / -1.1% 63705783 / 63744606 / -0.1% 0.75 / 0.76 / -1.0%
tpcds_q60/datafusion:parquet 39996114 / 41468712 / -3.6% 52284507 / 51922195 / +0.7% 0.76 / 0.80 / -4.2%
tpcds_q61/datafusion:parquet 35838946 / 36144162 / -0.8% 53673639 / 51492514 / +4.2% 0.67 / 0.70 / -4.9%
tpcds_q62/datafusion:parquet 24892886 / 25297244 / -1.6% 37968036 / 36768878 / +3.3% 0.66 / 0.69 / -4.7%
tpcds_q63/datafusion:parquet 21900032 / 22293907 / -1.8% 38518286 / 36239539 / +6.3% 0.57 / 0.62 / -7.6%
tpcds_q64/datafusion:parquet 289373138 / 288469428 / +0.3% 325713763 / 325456313 / +0.1% 0.89 / 0.89 / +0.2%
tpcds_q65/datafusion:parquet 125186202 / 122504960 / +2.2% 138110269 / 136010238 / +1.5% 0.91 / 0.90 / +0.6%
tpcds_q66/datafusion:parquet 60401626 / 60330750 / +0.1% 76505992 / 77786187 / -1.6% 0.79 / 0.78 / +1.8%
tpcds_q67/datafusion:parquet 68709846 / 69257902 / -0.8% 92105344 / 92944734 / -0.9% 0.75 / 0.75 / +0.1%
tpcds_q68/datafusion:parquet 29236666 / 29224446 / +0.0% 46990242 / 47479747 / -1.0% 0.62 / 0.62 / +1.1%
tpcds_q69/datafusion:parquet 44818584 / 43576365 / +2.9% 58072823 / 57200284 / +1.5% 0.77 / 0.76 / +1.3%
tpcds_q70/datafusion:parquet 80704996 / 80829759 / -0.2% 98112308 / 97021737 / +1.1% 0.82 / 0.83 / -1.3%
tpcds_q71/datafusion:parquet 25868919 / 26317842 / -1.7% 37472561 / 37118194 / +1.0% 0.69 / 0.71 / -2.6%
tpcds_q72/datafusion:parquet 521598514 / 519664150 / +0.4% 557565923 / 584841214 / -4.7% 0.94 / 0.89 / +5.3%
tpcds_q73/datafusion:parquet 24075422 / 23916252 / +0.7% 36279195 / 35367753 / +2.6% 0.66 / 0.68 / -1.9%
tpcds_q74/datafusion:parquet 71808949 / 69465678 / +3.4% 91883039 / 88628953 / +3.7% 0.78 / 0.78 / -0.3%
tpcds_q75/datafusion:parquet 153740078 / 156497968 / -1.8% 184201643 / 182522475 / +0.9% 0.83 / 0.86 / -2.7%
tpcds_q76/datafusion:parquet 33260490 / 33571724 / -0.9% 47013562 / 45726813 / +2.8% 0.71 / 0.73 / -3.6%
tpcds_q77/datafusion:parquet 56300934 / 56148932 / +0.3% 73775638 / 71358894 / +3.4% 0.76 / 0.79 / -3.0%
tpcds_q78/datafusion:parquet 88005728 / 85291219 / +3.2% 118000808 / 115928497 / +1.8% 0.75 / 0.74 / +1.4%
tpcds_q79/datafusion:parquet 27229706 / 26828878 / +1.5% 41430746 / 41425210 / +0.0% 0.66 / 0.65 / +1.5%
tpcds_q80/datafusion:parquet 80817366 / 80861236 / -0.1% 108313316 / 109502009 / -1.1% 0.75 / 0.74 / +1.0%
tpcds_q81/datafusion:parquet 39136648 / 39142411 / -0.0% 51619703 / 49639555 / +4.0% 0.76 / 0.79 / -3.9%
tpcds_q82/datafusion:parquet 21973199 / 22169617 / -0.9% 35319029 / 33841389 / +4.4% 0.62 / 0.66 / -5.0%
tpcds_q83/datafusion:parquet 57533134 / 57594450 / -0.1% 74017233 / 74125029 / -0.1% 0.78 / 0.78 / +0.0%
tpcds_q84/datafusion:parquet 25979340 / 27003372 / -3.8% 40681516 / 40568821 / +0.3% 0.64 / 0.67 / -4.1%
tpcds_q85/datafusion:parquet 80460453 / 81187504 / -0.9% 103099559 / 102814807 / +0.3% 0.78 / 0.79 / -1.2%
tpcds_q86/datafusion:parquet 20757040 / 20704862 / +0.3% 32559743 / 32424211 / +0.4% 0.64 / 0.64 / -0.2%
tpcds_q87/datafusion:parquet 45916140 / 46040472 / -0.3% 60151404 / 57441631 / +4.7% 0.76 / 0.80 / -4.8%
tpcds_q88/datafusion:parquet 37158642 / 37328218 / -0.5% 51428238 / 51552834 / -0.2% 0.72 / 0.72 / -0.2%
tpcds_q89/datafusion:parquet 25638911 / 26023690 / -1.5% 41439426 / 40936254 / +1.2% 0.62 / 0.64 / -2.7%
tpcds_q90/datafusion:parquet 14723500 / 14514152 / +1.4% 26348513 / 26322249 / +0.1% 0.56 / 0.55 / +1.3%
tpcds_q91/datafusion:parquet 32134040 / 31678042 / +1.4% 47030418 / 46044485 / +2.1% 0.68 / 0.69 / -0.7%
tpcds_q92/datafusion:parquet 26674174 / 26655206 / +0.1% 41445640 / 40362357 / +2.7% 0.64 / 0.66 / -2.5%
tpcds_q93/datafusion:parquet 26848084 / 27621254 / -2.8% 45843603 / 45440763 / +0.9% 0.59 / 0.61 / -3.7%
tpcds_q94/datafusion:parquet 35429760 / 34978962 / +1.3% 48879274 / 48310891 / +1.2% 0.72 / 0.72 / +0.1%
tpcds_q95/datafusion:parquet 63284260 / 64911839 / -2.5% 78489834 / 77454165 / +1.3% 0.81 / 0.84 / -3.8%
tpcds_q96/datafusion:parquet 12728472 / 12453842 / +2.2% 24281791 / 23253368 / +4.4% 0.52 / 0.54 / -2.1%
tpcds_q97/datafusion:parquet 35356051 / 35865433 / -1.4% 51193962 / 50987399 / +0.4% 0.69 / 0.70 / -1.8%
tpcds_q98/datafusion:parquet 24948026 / 24873730 / +0.3% 37976374 / 36829473 / +3.1% 0.66 / 0.68 / -2.7%
tpcds_q99/datafusion:parquet 29662104 / 29507328 / +0.5% 42428005 / 42156658 / +0.6% 0.70 / 0.70 / -0.1%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 17845184 / 18081534 / -1.3% 27961443 / 27781144 / +0.6% 0.64 / 0.65 / -1.9%
tpcds_q02/duckdb:vortex-file-compressed 16667750 / 16556927 / +0.7% 24467032 / 24886140 / -1.7% 0.68 / 0.67 / +2.4%
tpcds_q03/duckdb:vortex-file-compressed 7723780 / 7730097 / -0.1% 17171622 / 16670189 / +3.0% 0.45 / 0.46 / -3.0%
tpcds_q04/duckdb:vortex-file-compressed 49846116 / 49498381 / +0.7% 59098030 / 58856591 / +0.4% 0.84 / 0.84 / +0.3%
tpcds_q05/duckdb:vortex-file-compressed 25099048 / 25494884 / -1.6% 33759948 / 33894449 / -0.4% 0.74 / 0.75 / -1.2%
tpcds_q06/duckdb:vortex-file-compressed 29102266 / 29381100 / -0.9% 43412580 / 42953144 / +1.1% 0.67 / 0.68 / -2.0%
tpcds_q07/duckdb:vortex-file-compressed 14672700 / 15053220 / -2.5% 25761528 / 25936629 / -0.7% 0.57 / 0.58 / -1.9%
tpcds_q08/duckdb:vortex-file-compressed 19824248 / 19683558 / +0.7% 28869848 / 28129371 / +2.6% 0.69 / 0.70 / -1.9%
tpcds_q09/duckdb:vortex-file-compressed 19902983 / 19723758 / +0.9% 30308211 / 30211629 / +0.3% 0.66 / 0.65 / +0.6%
tpcds_q10/duckdb:vortex-file-compressed 34143314 / 33930680 / +0.6% 47319157 / 47153459 / +0.4% 0.72 / 0.72 / +0.3%
tpcds_q11/duckdb:vortex-file-compressed 40099100 / 39979786 / +0.3% 48271361 / 49077608 / -1.6% 0.83 / 0.81 / +2.0%
tpcds_q12/duckdb:vortex-file-compressed 10996867 / 11117646 / -1.1% 18159123 / 18643493 / -2.6% 0.61 / 0.60 / +1.6%
tpcds_q13/duckdb:vortex-file-compressed 22309278 / 21889786 / +1.9% 35025819 / 34896211 / +0.4% 0.64 / 0.63 / +1.5%
tpcds_q14/duckdb:vortex-file-compressed 61271546 / 61834332 / -0.9% 71920895 / 72916288 / -1.4% 0.85 / 0.85 / +0.5%
tpcds_q15/duckdb:vortex-file-compressed 27925018 / 28022008 / -0.3% 35714639 / 35999845 / -0.8% 0.78 / 0.78 / +0.4%
tpcds_q16/duckdb:vortex-file-compressed 37010162 / 36960760 / +0.1% 48060374 / 47600563 / +1.0% 0.77 / 0.78 / -0.8%
tpcds_q17/duckdb:vortex-file-compressed 26657827 / 27081890 / -1.6% 39526631 / 41766602 / -5.4% 0.67 / 0.65 / +4.0%
tpcds_q18/duckdb:vortex-file-compressed 33636074 / 33751385 / -0.3% 44028095 / 43666879 / +0.8% 0.76 / 0.77 / -1.2%
tpcds_q19/duckdb:vortex-file-compressed 91831051 / 90225064 / +1.8% 102438102 / 101872861 / +0.6% 0.90 / 0.89 / +1.2%
tpcds_q20/duckdb:vortex-file-compressed 11709816 / 11614958 / +0.8% 19705203 / 20259965 / -2.7% 0.59 / 0.57 / +3.7%
tpcds_q21/duckdb:vortex-file-compressed 10970180 / 11170270 / -1.8% 22735551 / 23170470 / -1.9% 0.48 / 0.48 / +0.1%
tpcds_q22/duckdb:vortex-file-compressed 19283768 / 19526919 / -1.2% 29436750 / 29664243 / -0.8% 0.66 / 0.66 / -0.5%
tpcds_q23/duckdb:vortex-file-compressed 40768983 / 41196271 / -1.0% 52573999 / 52189301 / +0.7% 0.78 / 0.79 / -1.8%
tpcds_q24/duckdb:vortex-file-compressed 29508770 / 29588375 / -0.3% 40245757 / 41117557 / -2.1% 0.73 / 0.72 / +1.9%
tpcds_q25/duckdb:vortex-file-compressed 25017224 / 25004534 / +0.1% 37109132 / 37460315 / -0.9% 0.67 / 0.67 / +1.0%
tpcds_q26/duckdb:vortex-file-compressed 14095685 / 14358378 / -1.8% 23140847 / 23118240 / +0.1% 0.61 / 0.62 / -1.9%
tpcds_q27/duckdb:vortex-file-compressed 17774822 / 17962320 / -1.0% 28242007 / 28519861 / -1.0% 0.63 / 0.63 / -0.1%
tpcds_q28/duckdb:vortex-file-compressed 16428630 / 16396626 / +0.2% 26443274 / 25311398 / +4.5% 0.62 / 0.65 / -4.1%
tpcds_q29/duckdb:vortex-file-compressed 25093382 / 25519335 / -1.7% 36894991 / 37400158 / -1.4% 0.68 / 0.68 / -0.3%
tpcds_q30/duckdb:vortex-file-compressed 17031866 / 17390512 / -2.1% 26952600 / 25417992 / +6.0% 0.63 / 0.68 / -7.6%
tpcds_q31/duckdb:vortex-file-compressed 19937912 / 20086626 / -0.7% 28325916 / 28572620 / -0.9% 0.70 / 0.70 / +0.1%
tpcds_q32/duckdb:vortex-file-compressed 14013462 / 13976772 / +0.3% 23706600 / 22179255 / +6.9% 0.59 / 0.63 / -6.2%
tpcds_q33/duckdb:vortex-file-compressed 19666631 / 20066088 / -2.0% 28356829 / 28113823 / +0.9% 0.69 / 0.71 / -2.8%
tpcds_q34/duckdb:vortex-file-compressed 13573482 / 13733599 / -1.2% 24400152 / 23994398 / +1.7% 0.56 / 0.57 / -2.8%
tpcds_q35/duckdb:vortex-file-compressed 30491624 / 30562832 / -0.2% 41171351 / 41899959 / -1.7% 0.74 / 0.73 / +1.5%
tpcds_q36/duckdb:vortex-file-compressed 15920213 / 15712008 / +1.3% 26948620 / 26998045 / -0.2% 0.59 / 0.58 / +1.5%
tpcds_q37/duckdb:vortex-file-compressed 10018876 / 9959021 / +0.6% 24092291 / 24051384 / +0.2% 0.42 / 0.41 / +0.4%
tpcds_q38/duckdb:vortex-file-compressed 26622943 / 26342428 / +1.1% 33681010 / 32842810 / +2.6% 0.79 / 0.80 / -1.5%
tpcds_q39/duckdb:vortex-file-compressed 20843134 / 21948214 / -5.0% 33134951 / 33747543 / -1.8% 0.63 / 0.65 / -3.3%
tpcds_q40/duckdb:vortex-file-compressed 15053416 / 15465406 / -2.7% 22812396 / 22634560 / +0.8% 0.66 / 0.68 / -3.4%
tpcds_q41/duckdb:vortex-file-compressed 16071894 / 15929237 / +0.9% 25122680 / 24484767 / +2.6% 0.64 / 0.65 / -1.7%
tpcds_q42/duckdb:vortex-file-compressed 7511910 / 7825409 / -4.0% 16853741 / 16678626 / +1.0% 0.45 / 0.47 / -5.0%
tpcds_q43/duckdb:vortex-file-compressed 10783856 / 10822709 / -0.4% 19998833 / 20235268 / -1.2% 0.54 / 0.53 / +0.8%
tpcds_q44/duckdb:vortex-file-compressed 15960142 / 15760400 / +1.3% 26890339 / 28423880 / -5.4% 0.59 / 0.55 / +7.0%
tpcds_q45/duckdb:vortex-file-compressed 26574804 / 26097528 / +1.8% 33855488 / 33097662 / +2.3% 0.78 / 0.79 / -0.5%
tpcds_q46/duckdb:vortex-file-compressed 20852884 / 20956550 / -0.5% 30184603 / 30082726 / +0.3% 0.69 / 0.70 / -0.8%
tpcds_q47/duckdb:vortex-file-compressed 37112198 / 37632136 / -1.4% 46281392 / 48834248 / -5.2% 0.80 / 0.77 / +4.1%
tpcds_q48/duckdb:vortex-file-compressed 24866974 / 25078994 / -0.8% 37750503 / 38109304 / -0.9% 0.66 / 0.66 / +0.1%
tpcds_q49/duckdb:vortex-file-compressed 21857282 / 21613488 / +1.1% 34659223 / 34501064 / +0.5% 0.63 / 0.63 / +0.7%
tpcds_q50/duckdb:vortex-file-compressed 18557920 / 18114274 / +2.4% 29879996 / 30841967 / -3.1% 0.62 / 0.59 / +5.7%
tpcds_q51/duckdb:vortex-file-compressed 53274265 / 52658332 / +1.2% 82712499 / 81945689 / +0.9% 0.64 / 0.64 / +0.2%
tpcds_q52/duckdb:vortex-file-compressed 7978394 / 7778136 / +2.6% 16917147 / 16287379 / +3.9% 0.47 / 0.48 / -1.2%
tpcds_q53/duckdb:vortex-file-compressed 12589830 / 12561274 / +0.2% 21410908 / 22643732 / -5.4% 0.59 / 0.55 / +6.0%
tpcds_q54/duckdb:vortex-file-compressed 21981744 / 22160263 / -0.8% 32379109 / 31528785 / +2.7% 0.68 / 0.70 / -3.4%
tpcds_q55/duckdb:vortex-file-compressed 7582514 / 7712050 / -1.7% 16611809 / 16387252 / +1.4% 0.46 / 0.47 / -3.0%
tpcds_q56/duckdb:vortex-file-compressed 20163604 / 19915106 / +1.2% 28356106 / 28716014 / -1.3% 0.71 / 0.69 / +2.5%
tpcds_q57/duckdb:vortex-file-compressed 28156294 / 28270326 / -0.4% 36290460 / 36655945 / -1.0% 0.78 / 0.77 / +0.6%
tpcds_q58/duckdb:vortex-file-compressed 22101325 / 22417908 / -1.4% 31298730 / 31469085 / -0.5% 0.71 / 0.71 / -0.9%
tpcds_q59/duckdb:vortex-file-compressed 21420009 / 21434222 / -0.1% 29475468 / 29991204 / -1.7% 0.73 / 0.71 / +1.7%
tpcds_q60/duckdb:vortex-file-compressed 20470924 / 20752663 / -1.4% 30789759 / 30369530 / +1.4% 0.66 / 0.68 / -2.7%
tpcds_q61/duckdb:vortex-file-compressed 25968996 / 25786570 / +0.7% 35858174 / 35668632 / +0.5% 0.72 / 0.72 / +0.2%
tpcds_q62/duckdb:vortex-file-compressed 13110662 / 13234864 / -0.9% 20629132 / 20709727 / -0.4% 0.64 / 0.64 / -0.6%
tpcds_q63/duckdb:vortex-file-compressed 12000248 / 11926508 / +0.6% 20590336 / 21516430 / -4.3% 0.58 / 0.55 / +5.1%
tpcds_q64/duckdb:vortex-file-compressed 53291856 / 53237404 / +0.1% 73453106 / 72763927 / +0.9% 0.73 / 0.73 / -0.8%
tpcds_q65/duckdb:vortex-file-compressed 16272865 / 16456932 / -1.1% 25791465 / 26461837 / -2.5% 0.63 / 0.62 / +1.5%
tpcds_q66/duckdb:vortex-file-compressed 32874672 / 32505472 / +1.1% 43019868 / 43409525 / -0.9% 0.76 / 0.75 / +2.1%
tpcds_q67/duckdb:vortex-file-compressed 64968654 / 65428886 / -0.7% 74018974 / 74802876 / -1.0% 0.88 / 0.87 / +0.3%
tpcds_q68/duckdb:vortex-file-compressed 20993808 / 20793763 / +1.0% 29997545 / 30054807 / -0.2% 0.70 / 0.69 / +1.2%
tpcds_q69/duckdb:vortex-file-compressed 24421048 / 24312746 / +0.4% 39567783 / 39954680 / -1.0% 0.62 / 0.61 / +1.4%
tpcds_q70/duckdb:vortex-file-compressed 17081582 / 16943546 / +0.8% 28325967 / 27701524 / +2.3% 0.60 / 0.61 / -1.4%
tpcds_q71/duckdb:vortex-file-compressed 14286688 / 14311884 / -0.2% 23732385 / 23461782 / +1.2% 0.60 / 0.61 / -1.3%
tpcds_q72/duckdb:vortex-file-compressed 59613500 / 60012566 / -0.7% 74103195 / 74424014 / -0.4% 0.80 / 0.81 / -0.2%
tpcds_q73/duckdb:vortex-file-compressed 12343164 / 12543901 / -1.6% 23315343 / 22490738 / +3.7% 0.53 / 0.56 / -5.1%
tpcds_q74/duckdb:vortex-file-compressed 28361529 / 28022154 / +1.2% 35567432 / 35315404 / +0.7% 0.80 / 0.79 / +0.5%
tpcds_q75/duckdb:vortex-file-compressed 30995488 / 30879771 / +0.4% 40426726 / 41782651 / -3.2% 0.77 / 0.74 / +3.7%
tpcds_q76/duckdb:vortex-file-compressed 14135238 / 14306308 / -1.2% 23759871 / 23315033 / +1.9% 0.59 / 0.61 / -3.0%
tpcds_q77/duckdb:vortex-file-compressed 22808090 / 22786690 / +0.1% 34301660 / 32777696 / +4.6% 0.66 / 0.70 / -4.4%
tpcds_q78/duckdb:vortex-file-compressed 45083728 / 44752623 / +0.7% 54776782 / 55646312 / -1.6% 0.82 / 0.80 / +2.3%
tpcds_q79/duckdb:vortex-file-compressed 14518380 / 14618250 / -0.7% 23619826 / 23240309 / +1.6% 0.61 / 0.63 / -2.3%
tpcds_q80/duckdb:vortex-file-compressed 40042114 / 40040812 / +0.0% 52843123 / 51914546 / +1.8% 0.76 / 0.77 / -1.8%
tpcds_q81/duckdb:vortex-file-compressed 22616650 / 22684506 / -0.3% 29921208 / 29617865 / +1.0% 0.76 / 0.77 / -1.3%
tpcds_q82/duckdb:vortex-file-compressed 10390433 / 10702117 / -2.9% 24269447 / 24955667 / -2.7% 0.43 / 0.43 / -0.2%
tpcds_q83/duckdb:vortex-file-compressed 19668942 / 19628719 / +0.2% 27520903 / 27421849 / +0.4% 0.71 / 0.72 / -0.2%
tpcds_q84/duckdb:vortex-file-compressed 16732052 / 17034596 / -1.8% 25599866 / 24645026 / +3.9% 0.65 / 0.69 / -5.4%
tpcds_q85/duckdb:vortex-file-compressed 26229669 / 26720561 / -1.8% 40299131 / 38789929 / +3.9% 0.65 / 0.69 / -5.5%
tpcds_q86/duckdb:vortex-file-compressed 10659119 / 10691342 / -0.3% 18836486 / 19226955 / -2.0% 0.57 / 0.56 / +1.8%
tpcds_q87/duckdb:vortex-file-compressed 28200336 / 28453694 / -0.9% 35220838 / 35495536 / -0.8% 0.80 / 0.80 / -0.1%
tpcds_q88/duckdb:vortex-file-compressed 42595838 / 42463320 / +0.3% 53062427 / 53145120 / -0.2% 0.80 / 0.80 / +0.5%
tpcds_q89/duckdb:vortex-file-compressed 13429620 / 13442935 / -0.1% 22766012 / 23088017 / -1.4% 0.59 / 0.58 / +1.3%
tpcds_q90/duckdb:vortex-file-compressed 9589526 / 9917005 / -3.3% 17037553 / 17501188 / -2.6% 0.56 / 0.57 / -0.7%
tpcds_q91/duckdb:vortex-file-compressed 15312192 / 15487410 / -1.1% 23386506 / 23530233 / -0.6% 0.65 / 0.66 / -0.5%
tpcds_q92/duckdb:vortex-file-compressed 14414552 / 14472882 / -0.4% 24249233 / 23416446 / +3.6% 0.59 / 0.62 / -3.8%
tpcds_q93/duckdb:vortex-file-compressed 11342696 / 11523718 / -1.6% 26635327 / 26137003 / +1.9% 0.43 / 0.44 / -3.4%
tpcds_q94/duckdb:vortex-file-compressed 33417277 / 33434804 / -0.1% 43817392 / 44006230 / -0.4% 0.76 / 0.76 / +0.4%
tpcds_q95/duckdb:vortex-file-compressed 44380473 / 44911304 / -1.2% 53625959 / 54164010 / -1.0% 0.83 / 0.83 / -0.2%
tpcds_q96/duckdb:vortex-file-compressed 7548346 / 7202614 / +4.8% 16381161 / 15922635 / +2.9% 0.46 / 0.45 / +1.9%
tpcds_q97/duckdb:vortex-file-compressed 24588022 / 24703711 / -0.5% 33515895 / 32392529 / +3.5% 0.73 / 0.76 / -3.8%
tpcds_q98/duckdb:vortex-file-compressed 12400788 / 12559910 / -1.3% 20479367 / 21233980 / -3.6% 0.61 / 0.59 / +2.4%
tpcds_q99/duckdb:vortex-file-compressed 16081750 / 16028130 / +0.3% 23958003 / 24360571 / -1.7% 0.67 / 0.66 / +2.0%
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 27656374 / 27711317 / -0.2% 35151903 / 35691204 / -1.5% 0.79 / 0.78 / +1.3%
tpcds_q02/duckdb:parquet 19863068 / 19909208 / -0.2% 26489019 / 26650808 / -0.6% 0.75 / 0.75 / +0.4%
tpcds_q03/duckdb:parquet 11294492 / 11478226 / -1.6% 18433173 / 18358912 / +0.4% 0.61 / 0.63 / -2.0%
tpcds_q04/duckdb:parquet 131840051 / 132507791 / -0.5% 141778233 / 141826643 / -0.0% 0.93 / 0.93 / -0.5%
tpcds_q05/duckdb:parquet 32492988 / 32478625 / +0.0% 38352274 / 38899995 / -1.4% 0.85 / 0.83 / +1.5%
tpcds_q06/duckdb:parquet 32992870 / 33192842 / -0.6% 43265166 / 43416043 / -0.3% 0.76 / 0.76 / -0.3%
tpcds_q07/duckdb:parquet 33736234 / 34148112 / -1.2% 43419531 / 43386917 / +0.1% 0.78 / 0.79 / -1.3%
tpcds_q08/duckdb:parquet 23233848 / 23490318 / -1.1% 30463849 / 29583404 / +3.0% 0.76 / 0.79 / -4.0%
tpcds_q09/duckdb:parquet 32642847 / 31564710 / +3.4% 36480096 / 37531858 / -2.8% 0.89 / 0.84 / +6.4%
tpcds_q10/duckdb:parquet 41894345 / 42577964 / -1.6% 50857516 / 50410154 / +0.9% 0.82 / 0.84 / -2.5%
tpcds_q11/duckdb:parquet 75257332 / 75481062 / -0.3% 83445503 / 84302767 / -1.0% 0.90 / 0.90 / +0.7%
tpcds_q12/duckdb:parquet 16477427 / 16666504 / -1.1% 22470300 / 23016593 / -2.4% 0.73 / 0.72 / +1.3%
tpcds_q13/duckdb:parquet 33495994 / 33709018 / -0.6% 43883070 / 44242762 / -0.8% 0.76 / 0.76 / +0.2%
tpcds_q14/duckdb:parquet 74677390 / 73038757 / +2.2% 80096680 / 79881748 / +0.3% 0.93 / 0.91 / +2.0%
tpcds_q15/duckdb:parquet 19140846 / 19329910 / -1.0% 25940259 / 26288329 / -1.3% 0.74 / 0.74 / +0.4%
tpcds_q16/duckdb:parquet 44568428 / 44778758 / -0.5% 51622984 / 52148797 / -1.0% 0.86 / 0.86 / +0.5%
tpcds_q17/duckdb:parquet 38835833 / 38818323 / +0.0% 46106665 / 46458874 / -0.8% 0.84 / 0.84 / +0.8%
tpcds_q18/duckdb:parquet 52616003 / 52937630 / -0.6% 61412768 / 61229889 / +0.3% 0.86 / 0.86 / -0.9%
tpcds_q19/duckdb:parquet 20990608 / 21379410 / -1.8% 29527831 / 29896075 / -1.2% 0.71 / 0.72 / -0.6%
tpcds_q20/duckdb:parquet 17587588 / 17824412 / -1.3% 23288844 / 23726590 / -1.8% 0.76 / 0.75 / +0.5%
tpcds_q21/duckdb:parquet 12583231 / 12757800 / -1.4% 19919823 / 19802969 / +0.6% 0.63 / 0.64 / -1.9%
tpcds_q22/duckdb:parquet 22874476 / 23137048 / -1.1% 29867436 / 30072760 / -0.7% 0.77 / 0.77 / -0.5%
tpcds_q23/duckdb:parquet 48601626 / 47605411 / +2.1% 53961172 / 54481385 / -1.0% 0.90 / 0.87 / +3.1%
tpcds_q24/duckdb:parquet 33814752 / 33967216 / -0.4% 41954736 / 41629503 / +0.8% 0.81 / 0.82 / -1.2%
tpcds_q25/duckdb:parquet 34697955 / 34762226 / -0.2% 43053069 / 42647752 / +1.0% 0.81 / 0.82 / -1.1%
tpcds_q26/duckdb:parquet 31918977 / 32051221 / -0.4% 39515483 / 39393006 / +0.3% 0.81 / 0.81 / -0.7%
tpcds_q27/duckdb:parquet 37046380 / 36939914 / +0.3% 45977514 / 46235118 / -0.6% 0.81 / 0.80 / +0.9%
tpcds_q28/duckdb:parquet 30054724 / 30591235 / -1.8% 35744837 / 37885131 / -5.6% 0.84 / 0.81 / +4.1%
tpcds_q29/duckdb:parquet 36576318 / 36667621 / -0.2% 45016043 / 45030615 / -0.0% 0.81 / 0.81 / -0.2%
tpcds_q30/duckdb:parquet 41041780 / 41565341 / -1.3% 50505722 / 51040740 / -1.0% 0.81 / 0.81 / -0.2%
tpcds_q31/duckdb:parquet 39762544 / 39693308 / +0.2% 48094631 / 47736426 / +0.8% 0.83 / 0.83 / -0.6%
tpcds_q32/duckdb:parquet 18134639 / 18270566 / -0.7% 25314629 / 25139632 / +0.7% 0.72 / 0.73 / -1.4%
tpcds_q33/duckdb:parquet 27214838 / 27157378 / +0.2% 34962030 / 34029115 / +2.7% 0.78 / 0.80 / -2.5%
tpcds_q34/duckdb:parquet 19315980 / 19128434 / +1.0% 27903928 / 27210682 / +2.5% 0.69 / 0.70 / -1.5%
tpcds_q35/duckdb:parquet 40690520 / 40426784 / +0.7% 49745603 / 50000778 / -0.5% 0.82 / 0.81 / +1.2%
tpcds_q36/duckdb:parquet 43443844 / 43261750 / +0.4% 52650694 / 53218492 / -1.1% 0.83 / 0.81 / +1.5%
tpcds_q37/duckdb:parquet 15185052 / 15359446 / -1.1% 22870030 / 22853540 / +0.1% 0.66 / 0.67 / -1.2%
tpcds_q38/duckdb:parquet 33599926 / 33329256 / +0.8% 39108998 / 38099017 / +2.7% 0.86 / 0.87 / -1.8%
tpcds_q39/duckdb:parquet 25811220 / 25961782 / -0.6% 32929618 / 32879876 / +0.2% 0.78 / 0.79 / -0.7%
tpcds_q40/duckdb:parquet 18801162 / 18898593 / -0.5% 25196598 / 24927774 / +1.1% 0.75 / 0.76 / -1.6%
tpcds_q41/duckdb:parquet 14488832 / 14563744 / -0.5% 22054859 / 22182406 / -0.6% 0.66 / 0.66 / +0.1%
tpcds_q42/duckdb:parquet 10946506 / 10967489 / -0.2% 18189865 / 18291422 / -0.6% 0.60 / 0.60 / +0.4%
tpcds_q43/duckdb:parquet 13882454 / 13938643 / -0.4% 21067886 / 21367725 / -1.4% 0.66 / 0.65 / +1.0%
tpcds_q44/duckdb:parquet 24183468 / 24944986 / -3.1% 30276789 / 30073118 / +0.7% 0.80 / 0.83 / -3.7%
tpcds_q45/duckdb:parquet 24286544 / 24659256 / -1.5% 31627517 / 32384993 / -2.3% 0.77 / 0.76 / +0.8%
tpcds_q46/duckdb:parquet 39222576 / 39508362 / -0.7% 48316457 / 48620235 / -0.6% 0.81 / 0.81 / -0.1%
tpcds_q47/duckdb:parquet 38191384 / 38366880 / -0.5% 45951411 / 46535084 / -1.3% 0.83 / 0.82 / +0.8%
tpcds_q48/duckdb:parquet 31667606 / 31503010 / +0.5% 41613006 / 41524778 / +0.2% 0.76 / 0.76 / +0.3%
tpcds_q49/duckdb:parquet 32758602 / 33441229 / -2.0% 41670801 / 41887131 / -0.5% 0.79 / 0.80 / -1.5%
tpcds_q50/duckdb:parquet 22250783 / 22230755 / +0.1% 29731389 / 29877788 / -0.5% 0.75 / 0.74 / +0.6%
tpcds_q51/duckdb:parquet 56769385 / 57092658 / -0.6% 65004830 / 64697213 / +0.5% 0.87 / 0.88 / -1.0%
tpcds_q52/duckdb:parquet 11030108 / 11141996 / -1.0% 18472821 / 18385940 / +0.5% 0.60 / 0.61 / -1.5%
tpcds_q53/duckdb:parquet 15958943 / 15992924 / -0.2% 23666871 / 23811490 / -0.6% 0.67 / 0.67 / +0.4%
tpcds_q54/duckdb:parquet 28874652 / 29137584 / -0.9% 37242008 / 37399213 / -0.4% 0.78 / 0.78 / -0.5%
tpcds_q55/duckdb:parquet 10874506 / 10896836 / -0.2% 18003228 / 18159305 / -0.9% 0.60 / 0.60 / +0.7%
tpcds_q56/duckdb:parquet 28607885 / 28801600 / -0.7% 35613330 / 35415588 / +0.6% 0.80 / 0.81 / -1.2%
tpcds_q57/duckdb:parquet 34105861 / 34390686 / -0.8% 41212311 / 41292770 / -0.2% 0.83 / 0.83 / -0.6%
tpcds_q58/duckdb:parquet 28185156 / 28372570 / -0.7% 35447660 / 35410315 / +0.1% 0.80 / 0.80 / -0.8%
tpcds_q59/duckdb:parquet 25688458 / 25960580 / -1.0% 33346593 / 33435703 / -0.3% 0.77 / 0.78 / -0.8%
tpcds_q60/duckdb:parquet 30555124 / 30670365 / -0.4% 37737245 / 37452560 / +0.8% 0.81 / 0.82 / -1.1%
tpcds_q61/duckdb:parquet 26506964 / 28782174 / -7.9% 34213582 / 33843396 / +1.1% 0.77 / 0.85 / -8.9%
tpcds_q62/duckdb:parquet 14948681 / 15040292 / -0.6% 21396089 / 21293387 / +0.5% 0.70 / 0.71 / -1.1%
tpcds_q63/duckdb:parquet 15225338 / 15327749 / -0.7% 22993099 / 23047071 / -0.2% 0.66 / 0.67 / -0.4%
tpcds_q64/duckdb:parquet 79980864 / 79635176 / +0.4% 90229657 / 91627704 / -1.5% 0.89 / 0.87 / +2.0%
tpcds_q65/duckdb:parquet 21786506 / 21576970 / +1.0% 27855918 / 29147739 / -4.4% 0.78 / 0.74 / +5.7%
tpcds_q66/duckdb:parquet 41186752 / 41410524 / -0.5% 48765284 / 49708579 / -1.9% 0.84 / 0.83 / +1.4%
tpcds_q67/duckdb:parquet 68652782 / 67992142 / +1.0% 74935303 / 76878468 / -2.5% 0.92 / 0.88 / +3.6%
tpcds_q68/duckdb:parquet 31588393 / 31819240 / -0.7% 40651020 / 40420800 / +0.6% 0.78 / 0.79 / -1.3%
tpcds_q69/duckdb:parquet 29786377 / 29638732 / +0.5% 39223767 / 39280273 / -0.1% 0.76 / 0.75 / +0.6%
tpcds_q70/duckdb:parquet 22120984 / 22243437 / -0.6% 30343913 / 30691298 / -1.1% 0.73 / 0.72 / +0.6%
tpcds_q71/duckdb:parquet 19214558 / 20460674 / -6.1% 26510888 / 27354501 / -3.1% 0.72 / 0.75 / -3.1%
tpcds_q72/duckdb:parquet 61538459 / 62406651 / -1.4% 70855002 / 71167690 / -0.4% 0.87 / 0.88 / -1.0%
tpcds_q73/duckdb:parquet 16540360 / 1656934 / -0.2% 24734617 / 24508892 / +0.9% 0.67 / 0.68 / -1.1%
tpcds_q74/duckdb:parquet 94748878 / 94827851 / -0.1% 102281099 / 103465956 / -1.1% 0.93 / 0.92 / +1.1%
tpcds_q75/duckdb:parquet 48369967 / 48571182 / -0.4% 57469064 / 57041719 / +0.7% 0.84 / 0.85 / -1.2%
tpcds_q76/duckdb:parquet 21545748 / 19954584 / +8.0% 26638237 / 27203095 / -2.1% 0.81 / 0.73 / +10.3%
tpcds_q77/duckdb:parquet 30008570 / 28827564 / +4.1% 36251790 / 35468783 / +2.2% 0.83 / 0.81 / +1.8%
tpcds_q78/duckdb:parquet 84779754 / 83890986 / +1.1% 92151255 / 92533336 / -0.4% 0.92 / 0.91 / +1.5%
tpcds_q79/duckdb:parquet 23821194 / 23961616 / -0.6% 32469173 / 33929629 / -4.3% 0.73 / 0.71 / +3.9%
tpcds_q80/duckdb:parquet 41633155 / 42788512 / -2.7% 50362790 / 49856012 / +1.0% 0.83 / 0.86 / -3.7%
tpcds_q81/duckdb:parquet 41762440 / 42033912 / -0.6% 50536409 / 50942342 / -0.8% 0.83 / 0.83 / +0.2%
tpcds_q82/duckdb:parquet 16189540 / 16262650 / -0.4% 23819943 / 24135658 / -1.3% 0.68 / 0.67 / +0.9%
tpcds_q83/duckdb:parquet 23617488 / 23914950 / -1.2% 30282640 / 30177266 / +0.3% 0.78 / 0.79 / -1.6%
tpcds_q84/duckdb:parquet 25029424 / 25417456 / -1.5% 31870555 / 32110972 / -0.7% 0.79 / 0.79 / -0.8%
tpcds_q85/duckdb:parquet 36327314 / 36766747 / -1.2% 44835742 / 44606730 / +0.5% 0.81 / 0.82 / -1.7%
tpcds_q86/duckdb:parquet 13891166 / 13821263 / +0.5% 20311736 / 20087215 / +1.1% 0.68 / 0.69 / -0.6%
tpcds_q87/duckdb:parquet 35014226 / 35786214 / -2.2% 40072927 / 40675508 / -1.5% 0.87 / 0.88 / -0.7%
tpcds_q88/duckdb:parquet 46314617 / 46386722 / -0.2% 53612875 / 53625928 / -0.0% 0.86 / 0.87 / -0.1%
tpcds_q89/duckdb:parquet 16170542 / 16246536 / -0.5% 24215493 / 24516273 / -1.2% 0.67 / 0.66 / +0.8%
tpcds_q90/duckdb:parquet 11852346 / 11927200 / -0.6% 18577420 / 18792526 / -1.1% 0.64 / 0.63 / +0.5%
tpcds_q91/duckdb:parquet 23876575 / 23968342 / -0.4% 32359004 / 32859432 / -1.5% 0.74 / 0.73 / +1.2%
tpcds_q92/duckdb:parquet 19506904 / 19485224 / +0.1% 27546541 / 27272511 / +1.0% 0.71 / 0.71 / -0.9%
tpcds_q93/duckdb:parquet 15875563 / 16013162 / -0.9% 23292520 / 23451558 / -0.7% 0.68 / 0.68 / -0.2%
tpcds_q94/duckdb:parquet 38481610 / 38710508 / -0.6% 46289060 / 46242138 / +0.1% 0.83 / 0.84 / -0.7%
tpcds_q95/duckdb:parquet 49741622 / 49116444 / +1.3% 56067465 / 55738902 / +0.6% 0.89 / 0.88 / +0.7%
tpcds_q96/duckdb:parquet 9562506 / 9622160 / -0.6% 16139851 / 16405408 / -1.6% 0.59 / 0.59 / +1.0%
tpcds_q97/duckdb:parquet 29738095 / 29853608 / -0.4% 37686891 / 35664900 / +5.7% 0.79 / 0.84 / -5.7%
tpcds_q98/duckdb:parquet 19211642 / 19291110 / -0.4% 26887625 / 27048653 / -0.6% 0.71 / 0.71 / +0.2%
tpcds_q99/duckdb:parquet 21138042 / 21058746 / +0.4% 27491023 / 27505402 / -0.1% 0.77 / 0.77 / +0.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR bb199a5d vs base d270200d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.8%
Engines: DataFusion No clear signal (+16.4%, environment too noisy confidence) · DuckDB No clear signal (-0.1%, environment too noisy confidence)
Vortex (geomean): hot 0.954x ➖ · cold 0.973x ➖
Parquet (geomean): hot 0.885x ➖ · cold 0.971x ➖
Shifts: Parquet (control) -11.5% · Median polish -7.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.982x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 220135458 / 212704965 / +3.5% 926196247 / 1028233475 / -9.9% 0.24 / 0.21 / +14.9%
tpch_q02/datafusion:vortex-file-compressed 679345563 / 361980095 / +87.7% 🔴 823539596 / 698996216 / +17.8% 0.82 / 0.52 / +59.3%
tpch_q03/datafusion:vortex-file-compressed 404397727 / 421370754 / -4.0% 1255172338 / 1014365493 / +23.7% 0.32 / 0.42 / -22.4%
tpch_q04/datafusion:vortex-file-compressed 249536720 / 242080193 / +3.1% 656154971 / 469339106 / +39.8% 🔴 0.38 / 0.52 / -26.3%
tpch_q05/datafusion:vortex-file-compressed 424838759 / 450333710 / -5.7% 858539369 / 749843955 / +14.5% 0.49 / 0.60 / -17.6%
tpch_q06/datafusion:vortex-file-compressed 293085235 / 353025051 / -17.0% 460254816 / 515354958 / -10.7% 0.64 / 0.69 / -7.0%
tpch_q07/datafusion:vortex-file-compressed 417562596 / 434568954 / -3.9% 560056291 / 744913210 / -24.8% 0.75 / 0.58 / +27.8%
tpch_q08/datafusion:vortex-file-compressed 485350695 / 557059740 / -12.9% 611946976 / 742261447 / -17.6% 0.79 / 0.75 / +5.7%
tpch_q09/datafusion:vortex-file-compressed 519489694 / 417172218 / +24.5% 578080983 / 603638507 / -4.2% 0.90 / 0.69 / +30.0%
tpch_q10/datafusion:vortex-file-compressed 398512120 / 422279197 / -5.6% 647208532 / 688023960 / -5.9% 0.62 / 0.61 / +0.3%
tpch_q11/datafusion:vortex-file-compressed 327061849 / 300438923 / +8.9% 463344715 / 586841038 / -21.0% 0.71 / 0.51 / +37.9%
tpch_q12/datafusion:vortex-file-compressed 465489164 / 434129495 / +7.2% 579136392 / 580394698 / -0.2% 0.80 / 0.75 / +7.5%
tpch_q13/datafusion:vortex-file-compressed 154101841 / 139928779 / +10.1% 498702355 / 447264080 / +11.5% 0.31 / 0.31 / -1.2%
tpch_q14/datafusion:vortex-file-compressed 321167617 / 229581058 / +39.9% 🔴 603248284 / 391115545 / +54.2% 🔴 0.53 / 0.59 / -9.3%
tpch_q15/datafusion:vortex-file-compressed 345756935 / 602314464 / -42.6% 🟢 632867595 / 842648441 / -24.9% 0.55 / 0.71 / -23.6%
tpch_q16/datafusion:vortex-file-compressed 140962085 / 148167742 / -4.9% 332002331 / 275946299 / +20.3% 0.42 / 0.54 / -20.9%
tpch_q17/datafusion:vortex-file-compressed 333409190 / 394330297 / -15.4% 566627750 / 651886118 / -13.1% 0.59 / 0.60 / -2.7%
tpch_q18/datafusion:vortex-file-compressed 315717414 / 413873678 / -23.7% 565730993 / 540171880 / +4.7% 0.56 / 0.77 / -27.2%
tpch_q19/datafusion:vortex-file-compressed 375538975 / 383414374 / -2.1% 530659744 / 508007933 / +4.5% 0.71 / 0.75 / -6.2%
tpch_q20/datafusion:vortex-file-compressed 300581934 / 302399167 / -0.6% 506919438 / 489170024 / +3.6% 0.59 / 0.62 / -4.1%
tpch_q21/datafusion:vortex-file-compressed 520253918 / 819532916 / -36.5% 🟢 761497497 / 1063614390 / -28.4% 0.68 / 0.77 / -11.3%
tpch_q22/datafusion:vortex-file-compressed 191487792 / 165889172 / +15.4% 402117482 / 497778482 / -19.2% 0.48 / 0.33 / +42.9%
datafusion / parquet / ns (0.844x ➖, 6↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 88598749 / 123967871 / -28.5% 404709594 / 350446822 / +15.5% 0.22 / 0.35 / -38.1%
tpch_q02/datafusion:parquet 5594307463 / 5572903672 / +0.4% 5821304449 / 6167098135 / -5.6% 0.96 / 0.90 / +6.3%
tpch_q03/datafusion:parquet 428067443 / 430219825 / -0.5% 622079569 / 911680671 / -31.8% 🟢 0.69 / 0.47 / +45.8%
tpch_q04/datafusion:parquet 198641861 / 267930011 / -25.9% 328304564 / 517640204 / -36.6% 🟢 0.61 / 0.52 / +16.9%
tpch_q05/datafusion:parquet 3097352540 / 3178423785 / -2.6% 4985444103 / 3382740904 / +47.4% 🔴 0.62 / 0.94 / -33.9%
tpch_q06/datafusion:parquet 103188349 / 267189136 / -61.4% 🟢 213592956 / 310197064 / -31.1% 🟢 0.48 / 0.86 / -43.9%
tpch_q07/datafusion:parquet 3104720601 / 3032640522 / +2.4% 2942888923 / 3172685132 / -7.2% 1.05 / 0.96 / +10.4%
tpch_q08/datafusion:parquet 3880153992 / 3269220726 / +18.7% 5154171197 / 3237606549 / +59.2% 🔴 0.75 / 1.01 / -25.4%
tpch_q09/datafusion:parquet 3237919613 / 3117700608 / +3.9% 3104345005 / 3101438346 / +0.1% 1.04 / 1.01 / +3.8%
tpch_q10/datafusion:parquet 276230528 / 327910772 / -15.8% 603012255 / 566015675 / +6.5% 0.46 / 0.58 / -20.9%
tpch_q11/datafusion:parquet 5954617536 / 5727902038 / +4.0% 6023924796 / 5735500734 / +5.0% 0.99 / 1.00 / -1.0%
tpch_q12/datafusion:parquet 174308170 / 357970208 / -51.3% 🟢 340083453 / 667694851 / -49.1% 🟢 0.51 / 0.54 / -4.4%
tpch_q13/datafusion:parquet 177194027 / 374528314 / -52.7% 🟢 307097123 / 484357694 / -36.6% 🟢 0.58 / 0.77 / -25.4%
tpch_q14/datafusion:parquet 205646612 / 168818820 / +21.8% 435120884 / 302717292 / +43.7% 🔴 0.47 / 0.56 / -15.3%
tpch_q15/datafusion:parquet 3237668753 / 2748160680 / +17.8% 3584817570 / 3316732522 / +8.1% 0.90 / 0.83 / +9.0%
tpch_q16/datafusion:parquet 2696630439 / 2725711155 / -1.1% 3536629739 / 2739533498 / +29.1% 0.76 / 0.99 / -23.4%
tpch_q17/datafusion:parquet 432493266 / 488482292 / -11.5% 662900073 / 968955901 / -31.6% 🟢 0.65 / 0.50 / +29.4%
tpch_q18/datafusion:parquet 602629489 / 514372394 / +17.2% 801825415 / 708196858 / +13.2% 0.75 / 0.73 / +3.5%
tpch_q19/datafusion:parquet 181387315 / 186623654 / -2.8% 338234687 / 348394294 / -2.9% 0.54 / 0.54 / +0.1%
tpch_q20/datafusion:parquet 3036053911 / 4509579265 / -32.7% 🟢 2870605241 / 3863492283 / -25.7% 1.06 / 1.17 / -9.4%
tpch_q21/datafusion:parquet 3245202163 / 4658712573 / -30.3% 🟢 5292406320 / 5174309794 / +2.3% 0.61 / 0.90 / -31.9%
tpch_q22/datafusion:parquet 248376385 / 355462760 / -30.1% 🟢 449184895 / 413886050 / +8.5% 0.55 / 0.86 / -35.6%
duckdb / vortex-file-compressed / ns (0.928x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 227321383 / 269532675 / -15.7% 284843870 / 321488609 / -11.4% 0.80 / 0.84 / -4.8%
tpch_q02/duckdb:vortex-file-compressed 432486406 / 430860400 / +0.4% 924724551 / 480009495 / +92.6% 🔴 0.47 / 0.90 / -47.9%
tpch_q03/duckdb:vortex-file-compressed 552593879 / 528085032 / +4.6% 571731200 / 537266075 / +6.4% 0.97 / 0.98 / -1.7%
tpch_q04/duckdb:vortex-file-compressed 296111948 / 326318368 / -9.3% 323758605 / 343706086 / -5.8% 0.91 / 0.95 / -3.7%
tpch_q05/duckdb:vortex-file-compressed 541874383 / 551517165 / -1.7% 630630853 / 626698465 / +0.6% 0.86 / 0.88 / -2.4%
tpch_q06/duckdb:vortex-file-compressed 348270879 / 368310272 / -5.4% 338279879 / 389530486 / -13.2% 1.03 / 0.95 / +8.9%
tpch_q07/duckdb:vortex-file-compressed 450536539 / 431422405 / +4.4% 488017695 / 475600297 / +2.6% 0.92 / 0.91 / +1.8%
tpch_q08/duckdb:vortex-file-compressed 620120252 / 751816815 / -17.5% 668783578 / 626350790 / +6.8% 0.93 / 1.20 / -22.8%
tpch_q09/duckdb:vortex-file-compressed 468857804 / 514992794 / -9.0% 505555263 / 519835027 / -2.7% 0.93 / 0.99 / -6.4%
tpch_q10/duckdb:vortex-file-compressed 525304806 / 576339523 / -8.9% 521542006 / 587340126 / -11.2% 1.01 / 0.98 / +2.6%
tpch_q11/duckdb:vortex-file-compressed 320038977 / 296337029 / +8.0% 351502805 / 363668597 / -3.3% 0.91 / 0.81 / +11.7%
tpch_q12/duckdb:vortex-file-compressed 583530768 / 615202903 / -5.1% 532147739 / 725719175 / -26.7% 1.10 / 0.85 / +29.4%
tpch_q13/duckdb:vortex-file-compressed 190610689 / 207987860 / -8.4% 190221644 / 328462248 / -42.1% 🟢 1.00 / 0.63 / +58.2%
tpch_q14/duckdb:vortex-file-compressed 246121812 / 262296612 / -6.2% 332131840 / 366173974 / -9.3% 0.74 / 0.72 / +3.5%
tpch_q15/duckdb:vortex-file-compressed 222782804 / 262122058 / -15.0% 310438065 / 269687182 / +15.1% 0.72 / 0.97 / -26.2%
tpch_q16/duckdb:vortex-file-compressed 199993400 / 238191424 / -16.0% 220920568 / 519000708 / -57.4% 🟢 0.91 / 0.46 / +97.3%
tpch_q17/duckdb:vortex-file-compressed 398634061 / 451028789 / -11.6% 404294226 / 439739806 / -8.1% 0.99 / 1.03 / -3.9%
tpch_q18/duckdb:vortex-file-compressed 390547664 / 450942032 / -13.4% 700581079 / 448851681 / +56.1% 🔴 0.56 / 1.00 / -44.5%
tpch_q19/duckdb:vortex-file-compressed 430071567 / 488429748 / -11.9% 496063507 / 470595226 / +5.4% 0.87 / 1.04 / -16.5%
tpch_q20/duckdb:vortex-file-compressed 548436057 / 467126927 / +17.4% 633190399 / 589351176 / +7.4% 0.87 / 0.79 / +9.3%
tpch_q21/duckdb:vortex-file-compressed 709790375 / 1010146102 / -29.7% 625915660 / 713564151 / -12.3% 1.13 / 1.42 / -19.9%
tpch_q22/duckdb:vortex-file-compressed 264803424 / 258219987 / +2.5% 291542927 / 257772289 / +13.1% 0.91 / 1.00 / -9.3%
duckdb / parquet / ns (0.928x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 159604289 / 166596147 / -4.2% 171340527 / 195112957 / -12.2% 0.93 / 0.85 / +9.1%
tpch_q02/duckdb:parquet 537463519 / 517953498 / +3.8% 565265334 / 540195426 / +4.6% 0.95 / 0.96 / -0.8%
tpch_q03/duckdb:parquet 480861820 / 643814161 / -25.3% 496998630 / 741350044 / -33.0% 🟢 0.97 / 0.87 / +11.4%
tpch_q04/duckdb:parquet 354227610 / 426774522 / -17.0% 402708232 / 466374123 / -13.7% 0.88 / 0.92 / -3.9%
tpch_q05/duckdb:parquet 607809776 / 854130144 / -28.8% 657544495 / 832114656 / -21.0% 0.92 / 1.03 / -9.9%
tpch_q06/duckdb:parquet 182724586 / 183728556 / -0.5% 203691481 / 260653654 / -21.9% 0.90 / 0.70 / +27.3%
tpch_q07/duckdb:parquet 553719067 / 650836683 / -14.9% 588369575 / 755071982 / -22.1% 0.94 / 0.86 / +9.2%
tpch_q08/duckdb:parquet 775663789 / 843300848 / -8.0% 1042145911 / 885438233 / +17.7% 0.74 / 0.95 / -21.9%
tpch_q09/duckdb:parquet 732598841 / 691433694 / +6.0% 642072322 / 719420684 / -10.8% 1.14 / 0.96 / +18.7%
tpch_q10/duckdb:parquet 602589775 / 709558258 / -15.1% 555679462 / 709680924 / -21.7% 1.08 / 1.00 / +8.5%
tpch_q11/duckdb:parquet 358159126 / 310092197 / +15.5% 383420066 / 343612738 / +11.6% 0.93 / 0.90 / +3.5%
tpch_q12/duckdb:parquet 327407762 / 450769595 / -27.4% 555710684 / 527960255 / +5.3% 0.59 / 0.85 / -31.0%
tpch_q13/duckdb:parquet 335587777 / 469195971 / -28.5% 362128079 / 462687012 / -21.7% 0.93 / 1.01 / -8.6%
tpch_q14/duckdb:parquet 413973799 / 377773981 / +9.6% 1372004319 / 465140325 / +195.0% 🔴 0.30 / 0.81 / -62.8%
tpch_q15/duckdb:parquet 256735112 / 276219747 / -7.1% 286405483 / 299876090 / -4.5% 0.90 / 0.92 / -2.7%
tpch_q16/duckdb:parquet 405422305 / 345646937 / +17.3% 474545615 / 356632189 / +33.1% 🔴 0.85 / 0.97 / -11.9%
tpch_q17/duckdb:parquet 340199462 / 329660174 / +3.2% 394260780 / 388646116 / +1.4% 0.86 / 0.85 / +1.7%
tpch_q18/duckdb:parquet 432295435 / 665031993 / -35.0% 🟢 594077978 / 553654047 / +7.3% 0.73 / 1.20 / -39.4%
tpch_q19/duckdb:parquet 334924229 / 342828451 / -2.3% 417271758 / 478856903 / -12.9% 0.80 / 0.72 / +12.1%
tpch_q20/duckdb:parquet 761828025 / 523109073 / +45.6% 🔴 741398536 / 541952131 / +36.8% 🔴 1.03 / 0.97 / +6.5%
tpch_q21/duckdb:parquet 525753013 / 619730963 / -15.2% 656720456 / 723330640 / -9.2% 0.80 / 0.86 / -6.6%
tpch_q22/duckdb:parquet 580900632 / 529979476 / +9.6% 838924375 / 840327052 / -0.2% 0.69 / 0.63 / +9.8%

Copy link
Copy Markdown
Member Author

Closing this performance extraction after the controlled measurements did not establish an independent performance case for the batch-inspection refactor. Its main role in this work was to enable the fused comparison migration, which is now closed in #10676.

The smaller internal candidates in #10741 and #10742 target develop independently and do not require the borrowed batch entry point or inspection types.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

action/bench-spatial Run only SpatialBench SQL benchmarks on this PR changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants