Skip to content

Remove array_session - #10681

Merged
robert3005 merged 2 commits into
developfrom
rk/split-array-12-remove-array-session
Oct 23, 2026
Merged

robert3005 merged 2 commits into
developfrom
rk/split-array-12-remove-array-session

Conversation

@robert3005

Copy link
Copy Markdown
Contributor

vortex_array::array_session() was a shared constructor that every test, bench and doc example called, whatever it needed from the session. Callers now build the session they need: VortexSession::empty() creates vortex-array's session variables on first use, and callers register anything else themselves.

Tests share their module's session through a static SESSION: LazyLock<_> built with the setup those tests need. Tests that change their session after setting it up, need a different setup, or create a RuntimeSession (which holds the runtime current at creation) keep a local session.

@robert3005 robert3005 added the changelog/chore A trivial change label Oct 21, 2026
@robert3005
robert3005 force-pushed the rk/split-array-12-remove-array-session branch from 236f7d2 to 3aa4e4d Compare October 21, 2026 21:42
@codspeed

codspeed Bot commented Oct 21, 2026 •

Copy link
Copy Markdown

Merging this PR will regress 10 benchmarks

4 warnings, 1 note

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ Unable to measure the execution of 2 benchmarks

These benchmarks measured no execution time, so their results are not comparable and count as unchanged. This usually happens when the compiler removes the code under test.

Prevent compiler optimizations

See affected benchmarks

⚠️ 16 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ Base and head ran on different runner types

Some benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.

Learn more about Macro Runners

Open the report in CodSpeed to investigate

ℹ️ 40 benchmarks have no flamegraph

The flamegraph wasn't generated: the symbols of the profiling trace could not be resolved, because no information about the language frames was collected.

See affected benchmarks

⚡ 12 improved benchmarks
❌ 10 regressed benchmarks
✅ 2386 untouched benchmarks
⏩ 12 skipped benchmarks1
🗄️ 43 archived benchmarks run2

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Walltime mul_u64_nonnull_neon 20.8 µs 39.6 µs -47.4%
❌ CPU Simulation decode_primitives[i64, (1000, 8)] 24 µs 37.3 µs -35.59%
❌ CPU Simulation new_raw_prim_test_between[i32, 2048] 59.6 µs 81.3 µs -26.73%
❌ Walltime threshold_neon[80] 3.6 µs 4.2 µs -15.95%
❌ CPU Simulation scan[1] 76.7 µs 89.1 µs -13.85%
❌ CPU Simulation test_scan_filter_to_arrow_array[int_float] 3.5 ms 4.1 ms -13.62%
❌ CPU Simulation test_repeated_scan_filter[int_float] 3.4 ms 3.9 ms -11.08%
❌ CPU Simulation search_index_mixed_out_of_range_chunked 219 µs 245.9 µs -10.93%
❌ CPU Simulation test_repeated_scan_filter[int] 2.4 ms 2.7 ms -10.36%
❌ CPU Simulation test_scan_filter_to_arrow_array[int] 2.5 ms 2.8 ms -10.17%
⚡ CPU Simulation extend_from_array_zctl[(250, 32)] 459.6 µs 55.4 µs ×8.3
⚡ CPU Simulation extend_from_array_zctl[(1000, 8)] 474.5 µs 69.4 µs ×6.8
⚡ CPU Simulation bench_compare_sliced_dict_primitive[(2000, 10000)] 68.9 µs 13.2 µs ×5.2
⚡ CPU Simulation extend_from_array_non_zctl_overlapping[(1000, 32)] 644.7 µs 246 µs ×2.6
⚡ CPU Simulation extend_from_array_non_zctl_overlapping[(1000, 8)] 655.6 µs 259.4 µs ×2.5
⚡ CPU Simulation decode_primitives[f32, (2000, 32)] 40.1 µs 26.5 µs +51.44%
⚡ Walltime random_rotating_avx512[(0.9, 0.9, "self_90pct_mask_90pct")] 9.6 µs 8.2 µs +16.45%
⚡ Walltime random_rotating_avx512[(0.5, 0.5, "self_50pct_mask_50pct")] 9.2 µs 8.2 µs +11.95%
⚡ Walltime add_constant_shapes_neon[(32768, ConstantPerRow)] 16.2 µs 14.6 µs +11.22%
⚡ Walltime add_constant_shapes_neon[(32768, PerRowConstant)] 16.1 µs 14.5 µs +10.88%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing rk/split-array-12-remove-array-session (1860149) with develop (6f7091d)

Open in CodSpeed

Footnotes

  1. 12 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. 43 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them. ↩

@robert3005
robert3005 force-pushed the rk/split-array-12-remove-array-session branch 2 times, most recently from 54dfbd0 to ba0ba3e Compare October 22, 2026 00:04
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 22, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 22, 2026
@github-actions

github-actions Bot commented Oct 22, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ba0ba3e tpch-nvme-10 1 Explore Profiling Data
🟢 Done ba0ba3e clickbench-nvme 1 Explore Profiling Data
🟢 Done ba0ba3e polarsignals 1 Explore Profiling Data
🟢 Done ba0ba3e fineweb 1 Explore Profiling Data
🟢 Done ba0ba3e tpch-s3 1 Explore Profiling Data
🟢 Done ba0ba3e tpch-nvme 1 Explore Profiling Data
🟢 Done ba0ba3e tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR ba0ba3e7 vs base 86d28450
Vortex (geomean): hot 1.002x ➖ · cold 0.998x ➖


datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45123364 / 44976210 / +0.3% 93858906 / 91186197 / +2.9% 0.48 / 0.49 / -2.5%
polarsignals_q01/datafusion:vortex-file-compressed 51257199 / 50523070 / +1.5% 113401205 / 115046524 / -1.4% 0.45 / 0.44 / +2.9%
polarsignals_q02/datafusion:vortex-file-compressed 43222928 / 43643639 / -1.0% 84885472 / 87378900 / -2.9% 0.51 / 0.50 / +1.9%
polarsignals_q03/datafusion:vortex-file-compressed 54516983 / 55144216 / -1.1% 119121916 / 127484009 / -6.6% 0.46 / 0.43 / +5.8%
polarsignals_q04/datafusion:vortex-file-compressed 9323492 / 9469322 / -1.5% 47513304 / 47327709 / +0.4% 0.20 / 0.20 / -1.9%
polarsignals_q05/datafusion:vortex-file-compressed 11992851 / 11757546 / +2.0% 52440458 / 50503249 / +3.8% 0.23 / 0.23 / -1.8%
polarsignals_q06/datafusion:vortex-file-compressed 23435272 / 23591748 / -0.7% 65029061 / 66656017 / -2.4% 0.36 / 0.35 / +1.8%
polarsignals_q07/datafusion:vortex-file-compressed 11314834 / 11126884 / +1.7% 51416995 / 50476307 / +1.9% 0.22 / 0.22 / -0.2%
polarsignals_q08/datafusion:vortex-file-compressed 97770560 / 98785365 / -1.0% 162449687 / 166042073 / -2.2% 0.60 / 0.59 / +1.2%
polarsignals_q09/datafusion:vortex-file-compressed 9959168 / 9780125 / +1.8% 49600192 / 47181052 / +5.1% 0.20 / 0.21 / -3.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR ba0ba3e7 vs base 86d28450
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.983x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.958x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6827502 / 6849478 / -0.3% 17159843 / 18882381 / -9.1% 0.40 / 0.36 / +9.7%
fineweb_q01/datafusion:vortex-file-compressed 7340006 / 8801433 / -16.6% 🟢 46306125 / 47478285 / -2.5% 0.16 / 0.19 / -14.5%
fineweb_q02/datafusion:vortex-file-compressed 9331154 / 9855118 / -5.3% 50365279 / 49496810 / +1.8% 0.19 / 0.20 / -6.9%
fineweb_q03/datafusion:vortex-file-compressed 20097724 / 19652448 / +2.3% 109807593 / 120761709 / -9.1% 0.18 / 0.16 / +12.5%
fineweb_q04/datafusion:vortex-file-compressed 66268412 / 66708440 / -0.7% 161636275 / 163759200 / -1.3% 0.41 / 0.41 / +0.6%
fineweb_q05/datafusion:vortex-file-compressed 66877164 / 68787904 / -2.8% 152489834 / 154342313 / -1.2% 0.44 / 0.45 / -1.6%
fineweb_q06/datafusion:vortex-file-compressed 18854466 / 19998356 / -5.7% 115910599 / 121173334 / -4.3% 0.16 / 0.17 / -1.4%
fineweb_q07/datafusion:vortex-file-compressed 17851512 / 17467462 / +2.2% 108708337 / 118117516 / -8.0% 0.16 / 0.15 / +11.0%
fineweb_q08/datafusion:vortex-file-compressed 10795904 / 8160168 / +32.3% 🔴 46849683 / 50686026 / -7.6% 0.23 / 0.16 / +43.1%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9353916 / 9562210 / -2.2% 32000425 / 31284418 / +2.3% 0.29 / 0.31 / -4.4%
fineweb_q01/datafusion:parquet 75397960 / 74148225 / +1.7% 159389696 / 174315563 / -8.6% 0.47 / 0.43 / +11.2%
fineweb_q02/datafusion:parquet 74087590 / 74029416 / +0.1% 156049386 / 174021721 / -10.3% 🟢 0.47 / 0.43 / +11.6%
fineweb_q03/datafusion:parquet 73214050 / 74275288 / -1.4% 158759831 / 169512520 / -6.3% 0.46 / 0.44 / +5.2%
fineweb_q04/datafusion:parquet 84275144 / 82708168 / +1.9% 156115200 / 164172509 / -4.9% 0.54 / 0.50 / +7.2%
fineweb_q05/datafusion:parquet 80493105 / 80198812 / +0.4% 153386402 / 171254550 / -10.4% 🟢 0.52 / 0.47 / +12.1%
fineweb_q06/datafusion:parquet 75433033 / 75307343 / +0.2% 153649642 / 180570167 / -14.9% 🟢 0.49 / 0.42 / +17.7%
fineweb_q07/datafusion:parquet 74848224 / 73052987 / +2.5% 155639408 / 175684110 / -11.4% 🟢 0.48 / 0.42 / +15.7%
fineweb_q08/datafusion:parquet 74482906 / 74207273 / +0.4% 150562698 / 170763751 / -11.8% 🟢 0.49 / 0.43 / +13.8%
duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2323688 / 2316143 / +0.3% 7716311 / 7577614 / +1.8% 0.30 / 0.31 / -1.5%
fineweb_q01/duckdb:vortex-file-compressed 9721328 / 9534302 / +2.0% 34171989 / 36183950 / -5.6% 0.28 / 0.26 / +8.0%
fineweb_q02/duckdb:vortex-file-compressed 10829854 / 10801272 / +0.3% 36383563 / 34928767 / +4.2% 0.30 / 0.31 / -3.7%
fineweb_q03/duckdb:vortex-file-compressed 19566875 / 19664230 / -0.5% 100439472 / 100987054 / -0.5% 0.19 / 0.19 / +0.0%
fineweb_q04/duckdb:vortex-file-compressed 66061448 / 67556398 / -2.2% 114996088 / 116816226 / -1.6% 0.57 / 0.58 / -0.7%
fineweb_q05/duckdb:vortex-file-compressed 66719503 / 66848484 / -0.2% 119009659 / 111957346 / +6.3% 0.56 / 0.60 / -6.1%
fineweb_q06/duckdb:vortex-file-compressed 18981761 / 19570784 / -3.0% 107003831 / 104418217 / +2.5% 0.18 / 0.19 / -5.4%
fineweb_q07/duckdb:vortex-file-compressed 18181082 / 19479172 / -6.7% 102958289 / 99850240 / +3.1% 0.18 / 0.20 / -9.5%
fineweb_q08/duckdb:vortex-file-compressed 5586791 / 5457946 / +2.4% 14851212 / 14552942 / +2.0% 0.38 / 0.38 / +0.3%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 26988016 / 27440402 / -1.6% 29456201 / 29842691 / -1.3% 0.92 / 0.92 / -0.4%
fineweb_q01/duckdb:parquet 60257406 / 59898480 / +0.6% 78965823 / 80692781 / -2.1% 0.76 / 0.74 / +2.8%
fineweb_q02/duckdb:parquet 62167518 / 65272128 / -4.8% 88066401 / 85952154 / +2.5% 0.71 / 0.76 / -7.0%
fineweb_q03/duckdb:parquet 130078712 / 130284322 / -0.2% 194148887 / 186728712 / +4.0% 0.67 / 0.70 / -4.0%
fineweb_q04/duckdb:parquet 179884436 / 176290700 / +2.0% 229867882 / 230956247 / -0.5% 0.78 / 0.76 / +2.5%
fineweb_q05/duckdb:parquet 176680888 / 174435262 / +1.3% 223435231 / 217574156 / +2.7% 0.79 / 0.80 / -1.4%
fineweb_q06/duckdb:parquet 94226902 / 94572632 / -0.4% 162372116 / 159236084 / +2.0% 0.58 / 0.59 / -2.3%
fineweb_q07/duckdb:parquet 97136585 / 98096828 / -1.0% 161151822 / 162690845 / -0.9% 0.60 / 0.60 / -0.0%
fineweb_q08/duckdb:parquet 33725270 / 33470289 / +0.8% 33759260 / 34238099 / -1.4% 1.00 / 0.98 / +2.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR ba0ba3e7 vs base 86d28450
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.040x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.017x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 14884184 / 14927195 / -0.3% 41551875 / 40693679 / +2.1% 0.36 / 0.37 / -2.3%
tpch_q02/datafusion:vortex-file-compressed 17183952 / 17228397 / -0.3% 37316759 / 34640468 / +7.7% 0.46 / 0.50 / -7.4%
tpch_q03/datafusion:vortex-file-compressed 19022884 / 18929509 / +0.5% 48197126 / 45005346 / +7.1% 0.39 / 0.42 / -6.2%
tpch_q04/datafusion:vortex-file-compressed 9928011 / 9960014 / -0.3% 33657029 / 32757144 / +2.7% 0.29 / 0.30 / -3.0%
tpch_q05/datafusion:vortex-file-compressed 36111464 / 36614870 / -1.4% 68951479 / 65587881 / +5.1% 0.52 / 0.56 / -6.2%
tpch_q06/datafusion:vortex-file-compressed 5678881 / 5786652 / -1.9% 30390832 / 27586895 / +10.2% 🔴 0.19 / 0.21 / -10.9%
tpch_q07/datafusion:vortex-file-compressed 50923429 / 50863130 / +0.1% 85395947 / 74722179 / +14.3% 🔴 0.60 / 0.68 / -12.4%
tpch_q08/datafusion:vortex-file-compressed 51808355 / 50859301 / +1.9% 84133022 / 73670061 / +14.2% 🔴 0.62 / 0.69 / -10.8%
tpch_q09/datafusion:vortex-file-compressed 49350272 / 48898580 / +0.9% 81597784 / 79500316 / +2.6% 0.60 / 0.62 / -1.7%
tpch_q10/datafusion:vortex-file-compressed 16891304 / 17267444 / -2.2% 53116699 / 49498379 / +7.3% 0.32 / 0.35 / -8.8%
tpch_q11/datafusion:vortex-file-compressed 14808903 / 14771811 / +0.3% 34296970 / 35201708 / -2.6% 0.43 / 0.42 / +2.9%
tpch_q12/datafusion:vortex-file-compressed 22074145 / 22344932 / -1.2% 45529963 / 42530539 / +7.1% 0.48 / 0.53 / -7.7%
tpch_q13/datafusion:vortex-file-compressed 19390068 / 19730472 / -1.7% 41642816 / 41636472 / +0.0% 0.47 / 0.47 / -1.7%
tpch_q14/datafusion:vortex-file-compressed 14588511 / 14660024 / -0.5% 42684859 / 40207107 / +6.2% 0.34 / 0.36 / -6.3%
tpch_q15/datafusion:vortex-file-compressed 17953516 / 18097942 / -0.8% 46218649 / 43600119 / +6.0% 0.39 / 0.42 / -6.4%
tpch_q16/datafusion:vortex-file-compressed 18574884 / 18553658 / +0.1% 40153424 / 40544205 / -1.0% 0.46 / 0.46 / +1.1%
tpch_q17/datafusion:vortex-file-compressed 27931156 / 27579487 / +1.3% 63208184 / 58499144 / +8.0% 0.44 / 0.47 / -6.3%
tpch_q18/datafusion:vortex-file-compressed 36477876 / 36476509 / +0.0% 58784805 / 55663303 / +5.6% 0.62 / 0.66 / -5.3%
tpch_q19/datafusion:vortex-file-compressed 14576897 / 14044953 / +3.8% 42653558 / 40672442 / +4.9% 0.34 / 0.35 / -1.0%
tpch_q20/datafusion:vortex-file-compressed 20258675 / 20210037 / +0.2% 46217360 / 43253934 / +6.9% 0.44 / 0.47 / -6.2%
tpch_q21/datafusion:vortex-file-compressed 37997712 / 38314153 / -0.8% 69931000 / 68090204 / +2.7% 0.54 / 0.56 / -3.4%
tpch_q22/datafusion:vortex-file-compressed 11681752 / 11722141 / -0.3% 35427489 / 33798314 / +4.8% 0.33 / 0.35 / -4.9%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72521823 / 72649925 / -0.2% 91447024 / 89611150 / +2.0% 0.79 / 0.81 / -2.2%
tpch_q02/datafusion:parquet 74765352 / 75910236 / -1.5% 94736912 / 92886241 / +2.0% 0.79 / 0.82 / -3.4%
tpch_q03/datafusion:parquet 90592082 / 90225177 / +0.4% 115216509 / 114151627 / +0.9% 0.79 / 0.79 / -0.5%
tpch_q04/datafusion:parquet 43815467 / 43850857 / -0.1% 67280648 / 64248788 / +4.7% 0.65 / 0.68 / -4.6%
tpch_q05/datafusion:parquet 115380638 / 116129847 / -0.6% 149127592 / 144643373 / +3.1% 0.77 / 0.80 / -3.6%
tpch_q06/datafusion:parquet 32655857 / 33010731 / -1.1% 54315858 / 51946316 / +4.6% 0.60 / 0.64 / -5.4%
tpch_q07/datafusion:parquet 120098421 / 123261452 / -2.6% 151147117 / 150779942 / +0.2% 0.79 / 0.82 / -2.8%
tpch_q08/datafusion:parquet 128104542 / 129404177 / -1.0% 155452962 / 157210034 / -1.1% 0.82 / 0.82 / +0.1%
tpch_q09/datafusion:parquet 145785170 / 145942284 / -0.1% 179717200 / 180316768 / -0.3% 0.81 / 0.81 / +0.2%
tpch_q10/datafusion:parquet 110298318 / 109438472 / +0.8% 140619222 / 136182639 / +3.3% 0.78 / 0.80 / -2.4%
tpch_q11/datafusion:parquet 60122677 / 60534173 / -0.7% 84221447 / 83340566 / +1.1% 0.71 / 0.73 / -1.7%
tpch_q12/datafusion:parquet 65698443 / 66607970 / -1.4% 91916898 / 90732579 / +1.3% 0.71 / 0.73 / -2.6%
tpch_q13/datafusion:parquet 190301178 / 189997683 / +0.2% 219500581 / 213591970 / +2.8% 0.87 / 0.89 / -2.5%
tpch_q14/datafusion:parquet 49045040 / 48720891 / +0.7% 77864100 / 73811061 / +5.5% 0.63 / 0.66 / -4.6%
tpch_q15/datafusion:parquet 77104266 / 77362954 / -0.3% 101709734 / 100836800 / +0.9% 0.76 / 0.77 / -1.2%
tpch_q16/datafusion:parquet 43321118 / 43588457 / -0.6% 66256983 / 60075658 / +10.3% 🔴 0.65 / 0.73 / -9.9%
tpch_q17/datafusion:parquet 126584387 / 127241586 / -0.5% 155011875 / 152137592 / +1.9% 0.82 / 0.84 / -2.4%
tpch_q18/datafusion:parquet 132087237 / 132606500 / -0.4% 157005031 / 156469283 / +0.3% 0.84 / 0.85 / -0.7%
tpch_q19/datafusion:parquet 60197168 / 59972272 / +0.4% 90305849 / 84468732 / +6.9% 0.67 / 0.71 / -6.1%
tpch_q20/datafusion:parquet 79155406 / 79639511 / -0.6% 109125751 / 102625730 / +6.3% 0.73 / 0.78 / -6.5%
tpch_q21/datafusion:parquet 124230655 / 124189847 / +0.0% 150320231 / 148070499 / +1.5% 0.83 / 0.84 / -1.5%
tpch_q22/datafusion:parquet 54221882 / 54137327 / +0.2% 76123944 / 75356970 / +1.0% 0.71 / 0.72 / -0.9%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11299159 / 9812366 / +15.2% 🔴 21998543 / 21661920 / +1.6% 0.51 / 0.45 / +13.4%
tpch_q02/duckdb:vortex-file-compressed 15471838 / 15492221 / -0.1% 24972060 / 24125085 / +3.5% 0.62 / 0.64 / -3.5%
tpch_q03/duckdb:vortex-file-compressed 19554985 / 20071119 / -2.6% 36047371 / 35773424 / +0.8% 0.54 / 0.56 / -3.3%
tpch_q04/duckdb:vortex-file-compressed 12865669 / 12628818 / +1.9% 25328243 / 25963535 / -2.4% 0.51 / 0.49 / +4.4%
tpch_q05/duckdb:vortex-file-compressed 20797952 / 21200921 / -1.9% 35572817 / 33215572 / +7.1% 0.58 / 0.64 / -8.4%
tpch_q06/duckdb:vortex-file-compressed 5633234 / 5579277 / +1.0% 16388289 / 15957648 / +2.7% 0.34 / 0.35 / -1.7%
tpch_q07/duckdb:vortex-file-compressed 25251438 / 25183969 / +0.3% 41092932 / 40987389 / +0.3% 0.61 / 0.61 / +0.0%
tpch_q08/duckdb:vortex-file-compressed 21343754 / 21749132 / -1.9% 38598360 / 37891961 / +1.9% 0.55 / 0.57 / -3.7%
tpch_q09/duckdb:vortex-file-compressed 22504965 / 22709382 / -0.9% 41604352 / 40203197 / +3.5% 0.54 / 0.56 / -4.2%
tpch_q10/duckdb:vortex-file-compressed 23227667 / 23367992 / -0.6% 40821188 / 40277251 / +1.4% 0.57 / 0.58 / -1.9%
tpch_q11/duckdb:vortex-file-compressed 8048567 / 7912507 / +1.7% 17244186 / 15383829 / +12.1% 🔴 0.47 / 0.51 / -9.3%
tpch_q12/duckdb:vortex-file-compressed 16547070 / 16601889 / -0.3% 31542372 / 31005305 / +1.7% 0.52 / 0.54 / -2.0%
tpch_q13/duckdb:vortex-file-compressed 21106028 / 20912337 / +0.9% 33048976 / 32300544 / +2.3% 0.64 / 0.65 / -1.4%
tpch_q14/duckdb:vortex-file-compressed 12072224 / 12333121 / -2.1% 24422957 / 23780732 / +2.7% 0.49 / 0.52 / -4.7%
tpch_q15/duckdb:vortex-file-compressed 9237255 / 9200714 / +0.4% 20116459 / 21111122 / -4.7% 0.46 / 0.44 / +5.4%
tpch_q16/duckdb:vortex-file-compressed 18949547 / 18914641 / +0.2% 25775092 / 26053295 / -1.1% 0.74 / 0.73 / +1.3%
tpch_q17/duckdb:vortex-file-compressed 14116066 / 14098225 / +0.1% 28639612 / 28365521 / +1.0% 0.49 / 0.50 / -0.8%
tpch_q18/duckdb:vortex-file-compressed 26784740 / 28125292 / -4.8% 36527016 / 35975637 / +1.5% 0.73 / 0.78 / -6.2%
tpch_q19/duckdb:vortex-file-compressed 12322825 / 12304278 / +0.2% 26724839 / 25523341 / +4.7% 0.46 / 0.48 / -4.4%
tpch_q20/duckdb:vortex-file-compressed 15753545 / 15452844 / +1.9% 33175695 / 31059796 / +6.8% 0.47 / 0.50 / -4.6%
tpch_q21/duckdb:vortex-file-compressed 39315265 / 38695059 / +1.6% 59611184 / 57369665 / +3.9% 0.66 / 0.67 / -2.2%
tpch_q22/duckdb:vortex-file-compressed 18775732 / 18694416 / +0.4% 30342049 / 28842061 / +5.2% 0.62 / 0.65 / -4.5%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 57400057 / 57556672 / -0.3% 65459821 / 63340485 / +3.3% 0.88 / 0.91 / -3.5%
tpch_q02/duckdb:parquet 58167156 / 58326361 / -0.3% 66039605 / 66004486 / +0.1% 0.88 / 0.88 / -0.3%
tpch_q03/duckdb:parquet 81638741 / 82112643 / -0.6% 93167196 / 91312322 / +2.0% 0.88 / 0.90 / -2.6%
tpch_q04/duckdb:parquet 45152702 / 45456755 / -0.7% 55189286 / 53758557 / +2.7% 0.82 / 0.85 / -3.2%
tpch_q05/duckdb:parquet 91411559 / 91632555 / -0.2% 102016618 / 101427642 / +0.6% 0.90 / 0.90 / -0.8%
tpch_q06/duckdb:parquet 26375659 / 26044499 / +1.3% 32601793 / 31343996 / +4.0% 0.81 / 0.83 / -2.6%
tpch_q07/duckdb:parquet 86787498 / 87150506 / -0.4% 98278505 / 98095735 / +0.2% 0.88 / 0.89 / -0.6%
tpch_q08/duckdb:parquet 104471025 / 104845142 / -0.4% 115764408 / 115812972 / -0.0% 0.90 / 0.91 / -0.3%
tpch_q09/duckdb:parquet 133717915 / 133992653 / -0.2% 146146752 / 145668201 / +0.3% 0.91 / 0.92 / -0.5%
tpch_q10/duckdb:parquet 136233329 / 137218029 / -0.7% 149074479 / 148230552 / +0.6% 0.91 / 0.93 / -1.3%
tpch_q11/duckdb:parquet 34800685 / 34872538 / -0.2% 40762638 / 40969514 / -0.5% 0.85 / 0.85 / +0.3%
tpch_q12/duckdb:parquet 46948069 / 47129541 / -0.4% 54631717 / 54097457 / +1.0% 0.86 / 0.87 / -1.4%
tpch_q13/duckdb:parquet 266075255 / 267357503 / -0.5% 274424273 / 275153403 / -0.3% 0.97 / 0.97 / -0.2%
tpch_q14/duckdb:parquet 52495295 / 52476647 / +0.0% 62835456 / 62041009 / +1.3% 0.84 / 0.85 / -1.2%
tpch_q15/duckdb:parquet 42873180 / 43040820 / -0.4% 52035184 / 51846645 / +0.4% 0.82 / 0.83 / -0.8%
tpch_q16/duckdb:parquet 53221420 / 53674566 / -0.8% 59695964 / 60418549 / -1.2% 0.89 / 0.89 / +0.4%
tpch_q17/duckdb:parquet 61351126 / 61479715 / -0.2% 72914398 / 72339881 / +0.8% 0.84 / 0.85 / -1.0%
tpch_q18/duckdb:parquet 93661141 / 94219985 / -0.6% 103251383 / 101337208 / +1.9% 0.91 / 0.93 / -2.4%
tpch_q19/duckdb:parquet 58903886 / 60846398 / -3.2% 69261683 / 69347580 / -0.1% 0.85 / 0.88 / -3.1%
tpch_q20/duckdb:parquet 78875055 / 79278565 / -0.5% 91331168 / 89422401 / +2.1% 0.86 / 0.89 / -2.6%
tpch_q21/duckdb:parquet 139060364 / 139290847 / -0.2% 148795349 / 149008553 / -0.1% 0.93 / 0.93 / -0.0%
tpch_q22/duckdb:parquet 70301569 / 70596803 / -0.4% 79352039 / 79845844 / -0.6% 0.89 / 0.88 / +0.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR ba0ba3e7 vs base 86d28450
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.995x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 84296171 / 85174911 / -1.0% 142920848 / 153169728 / -6.7% 0.59 / 0.56 / +6.1%
tpch_q02/datafusion:vortex-file-compressed 63271937 / 64326162 / -1.6% 97273395 / 95205395 / +2.2% 0.65 / 0.68 / -3.7%
tpch_q03/datafusion:vortex-file-compressed 60881034 / 61234203 / -0.6% 115059012 / 111220656 / +3.5% 0.53 / 0.55 / -3.9%
tpch_q04/datafusion:vortex-file-compressed 33189458 / 33376377 / -0.6% 74193838 / 75977976 / -2.3% 0.45 / 0.44 / +1.8%
tpch_q05/datafusion:vortex-file-compressed 115253367 / 115430200 / -0.2% 179195479 / 180202530 / -0.6% 0.64 / 0.64 / +0.4%
tpch_q06/datafusion:vortex-file-compressed 13479254 / 13888918 / -2.9% 69782547 / 69851617 / -0.1% 0.19 / 0.20 / -2.9%
tpch_q07/datafusion:vortex-file-compressed 132201461 / 132550888 / -0.3% 180874296 / 194243629 / -6.9% 0.73 / 0.68 / +7.1%
tpch_q08/datafusion:vortex-file-compressed 139529794 / 139458562 / +0.1% 211485133 / 208259602 / +1.5% 0.66 / 0.67 / -1.5%
tpch_q09/datafusion:vortex-file-compressed 183887613 / 183322215 / +0.3% 263022283 / 306927890 / -14.3% 🟢 0.70 / 0.60 / +17.1%
tpch_q10/datafusion:vortex-file-compressed 69952916 / 70433280 / -0.7% 137792733 / 136887222 / +0.7% 0.51 / 0.51 / -1.3%
tpch_q11/datafusion:vortex-file-compressed 42598407 / 42810299 / -0.5% 66403249 / 67146170 / -1.1% 0.64 / 0.64 / +0.6%
tpch_q12/datafusion:vortex-file-compressed 43608094 / 43254551 / +0.8% 95222607 / 91949491 / +3.6% 0.46 / 0.47 / -2.6%
tpch_q13/datafusion:vortex-file-compressed 42370022 / 42683939 / -0.7% 78006418 / 71646180 / +8.9% 0.54 / 0.60 / -8.8%
tpch_q14/datafusion:vortex-file-compressed 23788340 / 23859980 / -0.3% 101543056 / 96416423 / +5.3% 0.23 / 0.25 / -5.3%
tpch_q15/datafusion:vortex-file-compressed 34488463 / 34601169 / -0.3% 94158888 / 94734445 / -0.6% 0.37 / 0.37 / +0.3%
tpch_q16/datafusion:vortex-file-compressed 36071447 / 36380590 / -0.8% 67612041 / 67199000 / +0.6% 0.53 / 0.54 / -1.5%
tpch_q17/datafusion:vortex-file-compressed 170254448 / 173976578 / -2.1% 225709754 / 220254465 / +2.5% 0.75 / 0.79 / -4.5%
tpch_q18/datafusion:vortex-file-compressed 195811649 / 197276992 / -0.7% 259787035 / 272633218 / -4.7% 0.75 / 0.72 / +4.2%
tpch_q19/datafusion:vortex-file-compressed 35702223 / 35706395 / -0.0% 100139494 / 93647803 / +6.9% 0.36 / 0.38 / -6.5%
tpch_q20/datafusion:vortex-file-compressed 60064994 / 60879279 / -1.3% 124477739 / 122517728 / +1.6% 0.48 / 0.50 / -2.9%
tpch_q21/datafusion:vortex-file-compressed 173456820 / 175547370 / -1.2% 236911591 / 236141489 / +0.3% 0.73 / 0.74 / -1.5%
tpch_q22/datafusion:vortex-file-compressed 25342363 / 25265192 / +0.3% 50708606 / 55136271 / -8.0% 0.50 / 0.46 / +9.1%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 85051499 / 84757988 / +0.3% 131688617 / 133731002 / -1.5% 0.65 / 0.63 / +1.9%
tpch_q02/datafusion:parquet 173658182 / 173185246 / +0.3% 202493168 / 200529425 / +1.0% 0.86 / 0.86 / -0.7%
tpch_q03/datafusion:parquet 136369988 / 136238179 / +0.1% 184505879 / 189349890 / -2.6% 0.74 / 0.72 / +2.7%
tpch_q04/datafusion:parquet 56554723 / 56960291 / -0.7% 88912854 / 100442903 / -11.5% 🟢 0.64 / 0.57 / +12.2%
tpch_q05/datafusion:parquet 171644846 / 171365237 / +0.2% 229895527 / 237250275 / -3.1% 0.75 / 0.72 / +3.4%
tpch_q06/datafusion:parquet 36530300 / 36362516 / +0.5% 76285573 / 80262386 / -5.0% 0.48 / 0.45 / +5.7%
tpch_q07/datafusion:parquet 218472745 / 218441076 / +0.0% 276832067 / 277324410 / -0.2% 0.79 / 0.79 / +0.2%
tpch_q08/datafusion:parquet 222473107 / 223513914 / -0.5% 284707376 / 293561803 / -3.0% 0.78 / 0.76 / +2.6%
tpch_q09/datafusion:parquet 312588978 / 313222892 / -0.2% 378459441 / 378338369 / +0.0% 0.83 / 0.83 / -0.2%
tpch_q10/datafusion:parquet 390065051 / 392554102 / -0.6% 447078861 / 450361552 / -0.7% 0.87 / 0.87 / +0.1%
tpch_q11/datafusion:parquet 126584061 / 124963789 / +1.3% 149618908 / 153532666 / -2.5% 0.85 / 0.81 / +3.9%
tpch_q12/datafusion:parquet 81964473 / 82155400 / -0.2% 118278383 / 128953792 / -8.3% 0.69 / 0.64 / +8.8%
tpch_q13/datafusion:parquet 219492027 / 219372155 / +0.1% 249955867 / 252591728 / -1.0% 0.88 / 0.87 / +1.1%
tpch_q14/datafusion:parquet 85126607 / 84975560 / +0.2% 190245144 / 195246176 / -2.6% 0.45 / 0.44 / +2.8%
tpch_q15/datafusion:parquet 104393553 / 105272684 / -0.8% 157615348 / 161596761 / -2.5% 0.66 / 0.65 / +1.7%
tpch_q16/datafusion:parquet 94374796 / 95595972 / -1.3% 122082856 / 124484069 / -1.9% 0.77 / 0.77 / +0.7%
tpch_q17/datafusion:parquet 208577182 / 209985594 / -0.7% 261209910 / 266790292 / -2.1% 0.80 / 0.79 / +1.5%
tpch_q18/datafusion:parquet 279839747 / 278733373 / +0.4% 322249489 / 327743516 / -1.7% 0.87 / 0.85 / +2.1%
tpch_q19/datafusion:parquet 105466332 / 105728160 / -0.2% 166764944 / 168834386 / -1.2% 0.63 / 0.63 / +1.0%
tpch_q20/datafusion:parquet 185871417 / 185545416 / +0.2% 257972670 / 242194211 / +6.5% 0.72 / 0.77 / -6.0%
tpch_q21/datafusion:parquet 242522805 / 243619893 / -0.5% 310786386 / 322884349 / -3.7% 0.78 / 0.75 / +3.4%
tpch_q22/datafusion:parquet 193627804 / 192942898 / +0.4% 215064413 / 219473919 / -2.0% 0.90 / 0.88 / +2.4%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 42064833 / 42501746 / -1.0% 82987152 / 79363470 / +4.6% 0.51 / 0.54 / -5.3%
tpch_q02/duckdb:vortex-file-compressed 29442135 / 29442794 / -0.0% 42583955 / 45428210 / -6.3% 0.69 / 0.65 / +6.7%
tpch_q03/duckdb:vortex-file-compressed 57531573 / 57426138 / +0.2% 110158043 / 110984059 / -0.7% 0.52 / 0.52 / +0.9%
tpch_q04/duckdb:vortex-file-compressed 52887931 / 52725007 / +0.3% 93532686 / 93393735 / +0.1% 0.57 / 0.56 / +0.2%
tpch_q05/duckdb:vortex-file-compressed 72486246 / 72974104 / -0.7% 121938445 / 121235719 / +0.6% 0.59 / 0.60 / -1.2%
tpch_q06/duckdb:vortex-file-compressed 18953480 / 19391799 / -2.3% 64953039 / 66453325 / -2.3% 0.29 / 0.29 / -0.0%
tpch_q07/duckdb:vortex-file-compressed 57961018 / 58424133 / -0.8% 123408275 / 125861787 / -1.9% 0.47 / 0.46 / +1.2%
tpch_q08/duckdb:vortex-file-compressed 88515298 / 89874262 / -1.5% 142109311 / 142494205 / -0.3% 0.62 / 0.63 / -1.2%
tpch_q09/duckdb:vortex-file-compressed 107782817 / 107265265 / +0.5% 174824773 / 180395590 / -3.1% 0.62 / 0.59 / +3.7%
tpch_q10/duckdb:vortex-file-compressed 99244611 / 99088373 / +0.2% 154631814 / 154067195 / +0.4% 0.64 / 0.64 / -0.2%
tpch_q11/duckdb:vortex-file-compressed 14969718 / 14910262 / +0.4% 27318557 / 27991567 / -2.4% 0.55 / 0.53 / +2.9%
tpch_q12/duckdb:vortex-file-compressed 57162496 / 57295354 / -0.2% 103672303 / 104718422 / -1.0% 0.55 / 0.55 / +0.8%
tpch_q13/duckdb:vortex-file-compressed 76970702 / 77463335 / -0.6% 102964089 / 103633373 / -0.6% 0.75 / 0.75 / +0.0%
tpch_q14/duckdb:vortex-file-compressed 31049317 / 31517933 / -1.5% 80473374 / 76721100 / +4.9% 0.39 / 0.41 / -6.1%
tpch_q15/duckdb:vortex-file-compressed 26836553 / 26602946 / +0.9% 70612512 / 72607139 / -2.7% 0.38 / 0.37 / +3.7%
tpch_q16/duckdb:vortex-file-compressed 51993403 / 51590447 / +0.8% 62695148 / 63192755 / -0.8% 0.83 / 0.82 / +1.6%
tpch_q17/duckdb:vortex-file-compressed 43979161 / 44133726 / -0.4% 84677069 / 84842851 / -0.2% 0.52 / 0.52 / -0.2%
tpch_q18/duckdb:vortex-file-compressed 98732301 / 103015968 / -4.2% 128826221 / 130230908 / -1.1% 0.77 / 0.79 / -3.1%
tpch_q19/duckdb:vortex-file-compressed 32054503 / 31608049 / +1.4% 88313292 / 86969644 / +1.5% 0.36 / 0.36 / -0.1%
tpch_q20/duckdb:vortex-file-compressed 47822659 / 47926257 / -0.2% 104473538 / 103159689 / +1.3% 0.46 / 0.46 / -1.5%
tpch_q21/duckdb:vortex-file-compressed 103851388 / 104037089 / -0.2% 154202376 / 155125511 / -0.6% 0.67 / 0.67 / +0.4%
tpch_q22/duckdb:vortex-file-compressed 36090028 / 35738635 / +1.0% 54952002 / 54119579 / +1.5% 0.66 / 0.66 / -0.5%
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 72412096 / 72736661 / -0.4% 94730700 / 95397636 / -0.7% 0.76 / 0.76 / +0.3%
tpch_q02/duckdb:parquet 105385614 / 105971513 / -0.6% 117673209 / 117828072 / -0.1% 0.90 / 0.90 / -0.4%
tpch_q03/duckdb:parquet 118889048 / 120011080 / -0.9% 154933252 / 158217460 / -2.1% 0.77 / 0.76 / +1.2%
tpch_q04/duckdb:parquet 84674467 / 86233931 / -1.8% 107998348 / 110599885 / -2.4% 0.78 / 0.78 / +0.6%
tpch_q05/duckdb:parquet 150446842 / 150046723 / +0.3% 186495546 / 187165914 / -0.4% 0.81 / 0.80 / +0.6%
tpch_q06/duckdb:parquet 40534044 / 40925022 / -1.0% 68396740 / 69822215 / -2.0% 0.59 / 0.59 / +1.1%
tpch_q07/duckdb:parquet 128829133 / 121463161 / +6.1% 163582890 / 160736686 / +1.8% 0.79 / 0.76 / +4.2%
tpch_q08/duckdb:parquet 179443228 / 177025058 / +1.4% 231746304 / 221299585 / +4.7% 0.77 / 0.80 / -3.2%
tpch_q09/duckdb:parquet 283354056 / 285724350 / -0.8% 334116732 / 334673638 / -0.2% 0.85 / 0.85 / -0.7%
tpch_q10/duckdb:parquet 536024199 / 533686444 / +0.4% 575112111 / 567408419 / +1.4% 0.93 / 0.94 / -0.9%
tpch_q11/duckdb:parquet 51308202 / 51091665 / +0.4% 59977265 / 60451018 / -0.8% 0.86 / 0.85 / +1.2%
tpch_q12/duckdb:parquet 78722417 / 78189606 / +0.7% 102680932 / 101137702 / +1.5% 0.77 / 0.77 / -0.8%
tpch_q13/duckdb:parquet 353402830 / 352252173 / +0.3% 368251579 / 368336059 / -0.0% 0.96 / 0.96 / +0.3%
tpch_q14/duckdb:parquet 118727600 / 119079136 / -0.3% 165704142 / 166198916 / -0.3% 0.72 / 0.72 / +0.0%
tpch_q15/duckdb:parquet 72078051 / 71844243 / +0.3% 103095745 / 102535260 / +0.5% 0.70 / 0.70 / -0.2%
tpch_q16/duckdb:parquet 114966293 / 114576795 / +0.3% 123348772 / 122690345 / +0.5% 0.93 / 0.93 / -0.2%
tpch_q17/duckdb:parquet 101724473 / 99730469 / +2.0% 140967745 / 138921413 / +1.5% 0.72 / 0.72 / +0.5%
tpch_q18/duckdb:parquet 169716413 / 165030090 / +2.8% 184933942 / 188288221 / -1.8% 0.92 / 0.88 / +4.7%
tpch_q19/duckdb:parquet 114878037 / 114518424 / +0.3% 155138097 / 156587640 / -0.9% 0.74 / 0.73 / +1.3%
tpch_q20/duckdb:parquet 180180324 / 180187944 / -0.0% 222686794 / 222210440 / +0.2% 0.81 / 0.81 / -0.2%
tpch_q21/duckdb:parquet 193429024 / 195369890 / -1.0% 231258340 / 226368884 / +2.2% 0.84 / 0.86 / -3.1%
tpch_q22/duckdb:parquet 289275571 / 289284753 / -0.0% 306052469 / 304591293 / +0.5% 0.95 / 0.95 / -0.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR ba0ba3e7 vs base 86d28450
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.997x ➖
Parquet (geomean): hot 1.003x ➖ · cold 0.990x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24455388 / 24687290 / -0.9% 41894597 / 43212295 / -3.0% 0.58 / 0.57 / +2.2%
tpcds_q02/datafusion:vortex-file-compressed 47478752 / 47300606 / +0.4% 65127005 / 65444814 / -0.5% 0.73 / 0.72 / +0.9%
tpcds_q03/datafusion:vortex-file-compressed 11809603 / 11597571 / +1.8% 28203582 / 28756641 / -1.9% 0.42 / 0.40 / +3.8%
tpcds_q04/datafusion:vortex-file-compressed 124348498 / 124301298 / +0.0% 156498377 / 156674489 / -0.1% 0.79 / 0.79 / +0.2%
tpcds_q05/datafusion:vortex-file-compressed 59160572 / 59557491 / -0.7% 80567910 / 82443589 / -2.3% 0.73 / 0.72 / +1.6%
tpcds_q06/datafusion:vortex-file-compressed 22473434 / 22671258 / -0.9% 44336638 / 45617718 / -2.8% 0.51 / 0.50 / +2.0%
tpcds_q07/datafusion:vortex-file-compressed 31756086 / 31749328 / +0.0% 55006449 / 55598612 / -1.1% 0.58 / 0.57 / +1.1%
tpcds_q08/datafusion:vortex-file-compressed 24431312 / 24445854 / -0.1% 41785658 / 43434157 / -3.8% 0.58 / 0.56 / +3.9%
tpcds_q09/datafusion:vortex-file-compressed 17493285 / 17096207 / +2.3% 34494924 / 35426870 / -2.6% 0.51 / 0.48 / +5.1%
tpcds_q10/datafusion:vortex-file-compressed 27111593 / 27279060 / -0.6% 48304031 / 49507305 / -2.4% 0.56 / 0.55 / +1.9%
tpcds_q11/datafusion:vortex-file-compressed 64899913 / 64502962 / +0.6% 91359147 / 92254330 / -1.0% 0.71 / 0.70 / +1.6%
tpcds_q12/datafusion:vortex-file-compressed 16661973 / 16452993 / +1.3% 32309468 / 32790355 / -1.5% 0.52 / 0.50 / +2.8%
tpcds_q13/datafusion:vortex-file-compressed 31691926 / 32083721 / -1.2% 55500180 / 56603339 / -1.9% 0.57 / 0.57 / +0.7%
tpcds_q14/datafusion:vortex-file-compressed 498837238 / 494314830 / +0.9% 556337840 / 556185179 / +0.0% 0.90 / 0.89 / +0.9%
tpcds_q15/datafusion:vortex-file-compressed 15216890 / 15636116 / -2.7% 35747648 / 35974847 / -0.6% 0.43 / 0.43 / -2.1%
tpcds_q16/datafusion:vortex-file-compressed 20154534 / 19967354 / +0.9% 38662925 / 39295280 / -1.6% 0.52 / 0.51 / +2.6%
tpcds_q17/datafusion:vortex-file-compressed 59380837 / 56226692 / +5.6% 73999234 / 82604859 / -10.4% 🟢 0.80 / 0.68 / +17.9%
tpcds_q18/datafusion:vortex-file-compressed 67791751 / 67205628 / +0.9% 92462063 / 91574755 / +1.0% 0.73 / 0.73 / -0.1%
tpcds_q19/datafusion:vortex-file-compressed 17337107 / 17261219 / +0.4% 37417552 / 38802079 / -3.6% 0.46 / 0.44 / +4.2%
tpcds_q20/datafusion:vortex-file-compressed 18151100 / 17405819 / +4.3% 35168080 / 33692143 / +4.4% 0.52 / 0.52 / -0.1%
tpcds_q21/datafusion:vortex-file-compressed 15829410 / 15853820 / -0.2% 38669442 / 40650267 / -4.9% 0.41 / 0.39 / +5.0%
tpcds_q22/datafusion:vortex-file-compressed 57806508 / 58181508 / -0.6% 79875530 / 80371009 / -0.6% 0.72 / 0.72 / -0.0%
tpcds_q23/datafusion:vortex-file-compressed 69869196 / 70805574 / -1.3% 101789555 / 97353214 / +4.6% 0.69 / 0.73 / -5.6%
tpcds_q24/datafusion:vortex-file-compressed 67578265 / 67747830 / -0.3% 91631820 / 90788304 / +0.9% 0.74 / 0.75 / -1.2%
tpcds_q25/datafusion:vortex-file-compressed 49774406 / 53866747 / -7.6% 73460906 / 72130007 / +1.8% 0.68 / 0.75 / -9.3%
tpcds_q26/datafusion:vortex-file-compressed 31080364 / 30609699 / +1.5% 49483502 / 51095013 / -3.2% 0.63 / 0.60 / +4.8%
tpcds_q27/datafusion:vortex-file-compressed 60820312 / 60981780 / -0.3% 87407315 / 91235665 / -4.2% 0.70 / 0.67 / +4.1%
tpcds_q28/datafusion:vortex-file-compressed 18087790 / 17664228 / +2.4% 37607201 / 37995715 / -1.0% 0.48 / 0.46 / +3.5%
tpcds_q29/datafusion:vortex-file-compressed 53986875 / 51726623 / +4.4% 80015816 / 74858910 / +6.9% 0.67 / 0.69 / -2.4%
tpcds_q30/datafusion:vortex-file-compressed 26042974 / 26745166 / -2.6% 44353986 / 47953928 / -7.5% 0.59 / 0.56 / +5.3%
tpcds_q31/datafusion:vortex-file-compressed 57935368 / 58739718 / -1.4% 81808106 / 82740033 / -1.1% 0.71 / 0.71 / -0.2%
tpcds_q32/datafusion:vortex-file-compressed 13368510 / 13449827 / -0.6% 31309482 / 31383943 / -0.2% 0.43 / 0.43 / -0.4%
tpcds_q33/datafusion:vortex-file-compressed 27764427 / 27276628 / +1.8% 48868048 / 51420106 / -5.0% 0.57 / 0.53 / +7.1%
tpcds_q34/datafusion:vortex-file-compressed 17400764 / 17482892 / -0.5% 35742710 / 36522425 / -2.1% 0.49 / 0.48 / +1.7%
tpcds_q35/datafusion:vortex-file-compressed 34087444 / 34143028 / -0.2% 56589727 / 59259552 / -4.5% 0.60 / 0.58 / +4.5%
tpcds_q36/datafusion:vortex-file-compressed 47357262 / 47269735 / +0.2% 72360817 / 70219562 / +3.0% 0.65 / 0.67 / -2.8%
tpcds_q37/datafusion:vortex-file-compressed 12583992 / 12307852 / +2.2% 35964713 / 38917924 / -7.6% 0.35 / 0.32 / +10.6%
tpcds_q38/datafusion:vortex-file-compressed 29778991 / 29449669 / +1.1% 50081129 / 51051161 / -1.9% 0.59 / 0.58 / +3.1%
tpcds_q39/datafusion:vortex-file-compressed 61078810 / 62663240 / -2.5% 85225250 / 91436954 / -6.8% 0.72 / 0.69 / +4.6%
tpcds_q40/datafusion:vortex-file-compressed 24068015 / 24129724 / -0.3% 44563984 / 44949982 / -0.9% 0.54 / 0.54 / +0.6%
tpcds_q41/datafusion:vortex-file-compressed 16781960 / 17208380 / -2.5% 30569876 / 32243347 / -5.2% 0.55 / 0.53 / +2.9%
tpcds_q42/datafusion:vortex-file-compressed 11170977 / 11434566 / -2.3% 27128173 / 26880883 / +0.9% 0.41 / 0.43 / -3.2%
tpcds_q43/datafusion:vortex-file-compressed 12910732 / 12905462 / +0.0% 30075553 / 30936184 / -2.8% 0.43 / 0.42 / +2.9%
tpcds_q44/datafusion:vortex-file-compressed 25663278 / 26200804 / -2.1% 48947606 / 48958020 / -0.0% 0.52 / 0.54 / -2.0%
tpcds_q45/datafusion:vortex-file-compressed 18434518 / 18212030 / +1.2% 37328304 / 38164994 / -2.2% 0.49 / 0.48 / +3.5%
tpcds_q46/datafusion:vortex-file-compressed 22789009 / 22995070 / -0.9% 45901416 / 46538121 / -1.4% 0.50 / 0.49 / +0.5%
tpcds_q47/datafusion:vortex-file-compressed 78369684 / 77530782 / +1.1% 107997080 / 105920984 / +2.0% 0.73 / 0.73 / -0.9%
tpcds_q48/datafusion:vortex-file-compressed 29629812 / 29554059 / +0.3% 52815472 / 52947799 / -0.2% 0.56 / 0.56 / +0.5%
tpcds_q49/datafusion:vortex-file-compressed 60469202 / 57130593 / +5.8% 83655610 / 81395377 / +2.8% 0.72 / 0.70 / +3.0%
tpcds_q50/datafusion:vortex-file-compressed 31732716 / 32432821 / -2.2% 52456532 / 54640824 / -4.0% 0.60 / 0.59 / +1.9%
tpcds_q51/datafusion:vortex-file-compressed 66930280 / 67218254 / -0.4% 90584838 / 88738467 / +2.1% 0.74 / 0.76 / -2.5%
tpcds_q52/datafusion:vortex-file-compressed 11589918 / 11984244 / -3.3% 27690274 / 28276065 / -2.1% 0.42 / 0.42 / -1.2%
tpcds_q53/datafusion:vortex-file-compressed 17759902 / 17638958 / +0.7% 37412660 / 39006753 / -4.1% 0.47 / 0.45 / +5.0%
tpcds_q54/datafusion:vortex-file-compressed 32719776 / 32910616 / -0.6% 59476675 / 58142237 / +2.3% 0.55 / 0.57 / -2.8%
tpcds_q55/datafusion:vortex-file-compressed 11203922 / 11479518 / -2.4% 26256015 / 28335078 / -7.3% 0.43 / 0.41 / +5.3%
tpcds_q56/datafusion:vortex-file-compressed 26868874 / 26738644 / +0.5% 48138372 / 48659158 / -1.1% 0.56 / 0.55 / +1.6%
tpcds_q57/datafusion:vortex-file-compressed 77290604 / 76856174 / +0.6% 102787216 / 101930953 / +0.8% 0.75 / 0.75 / -0.3%
tpcds_q58/datafusion:vortex-file-compressed 40398842 / 40969094 / -1.4% 64784775 / 66817531 / -3.0% 0.62 / 0.61 / +1.7%
tpcds_q59/datafusion:vortex-file-compressed 30600742 / 30750162 / -0.5% 51428003 / 52468683 / -2.0% 0.60 / 0.59 / +1.5%
tpcds_q60/datafusion:vortex-file-compressed 26794069 / 26762504 / +0.1% 45480562 / 48875189 / -6.9% 0.59 / 0.55 / +7.6%
tpcds_q61/datafusion:vortex-file-compressed 22515026 / 23318575 / -3.4% 46051691 / 46397915 / -0.7% 0.49 / 0.50 / -2.7%
tpcds_q62/datafusion:vortex-file-compressed 17999603 / 18124872 / -0.7% 34478517 / 34572191 / -0.3% 0.52 / 0.52 / -0.4%
tpcds_q63/datafusion:vortex-file-compressed 17964042 / 17651884 / +1.8% 38245911 / 39595544 / -3.4% 0.47 / 0.45 / +5.4%
tpcds_q64/datafusion:vortex-file-compressed 223503860 / 223930755 / -0.2% 265147778 / 266475732 / -0.5% 0.84 / 0.84 / +0.3%
tpcds_q65/datafusion:vortex-file-compressed 76078992 / 73735142 / +3.2% 96302673 / 95999369 / +0.3% 0.79 / 0.77 / +2.9%
tpcds_q66/datafusion:vortex-file-compressed 52592245 / 52353340 / +0.5% 71968779 / 72683813 / -1.0% 0.73 / 0.72 / +1.5%
tpcds_q67/datafusion:vortex-file-compressed 58782651 / 58141668 / +1.1% 85884870 / 87936927 / -2.3% 0.68 / 0.66 / +3.5%
tpcds_q68/datafusion:vortex-file-compressed 22758998 / 22632066 / +0.6% 45980293 / 45907779 / +0.2% 0.49 / 0.49 / +0.4%
tpcds_q69/datafusion:vortex-file-compressed 27136547 / 27619850 / -1.7% 47978219 / 49470559 / -3.0% 0.57 / 0.56 / +1.3%
tpcds_q70/datafusion:vortex-file-compressed 23423413 / 23080734 / +1.5% 44017514 / 46462929 / -5.3% 0.53 / 0.50 / +7.1%
tpcds_q71/datafusion:vortex-file-compressed 19190239 / 18197870 / +5.5% 39746511 / 39084799 / +1.7% 0.48 / 0.47 / +3.7%
tpcds_q72/datafusion:vortex-file-compressed 350139868 / 367523632 / -4.7% 394082974 / 381714395 / +3.2% 0.89 / 0.96 / -7.7%
tpcds_q73/datafusion:vortex-file-compressed 16060950 / 16280496 / -1.3% 37157792 / 36796407 / +1.0% 0.43 / 0.44 / -2.3%
tpcds_q74/datafusion:vortex-file-compressed 45434630 / 45139797 / +0.7% 72656028 / 73002071 / -0.5% 0.63 / 0.62 / +1.1%
tpcds_q75/datafusion:vortex-file-compressed 138464284 / 138410610 / +0.0% 164540034 / 166184200 / -1.0% 0.84 / 0.83 / +1.0%
tpcds_q76/datafusion:vortex-file-compressed 26600170 / 26330606 / +1.0% 45713873 / 46826219 / -2.4% 0.58 / 0.56 / +3.5%
tpcds_q77/datafusion:vortex-file-compressed 46416820 / 45777255 / +1.4% 64616056 / 68917662 / -6.2% 0.72 / 0.66 / +8.1%
tpcds_q78/datafusion:vortex-file-compressed 68388620 / 68641546 / -0.4% 98441502 / 97419202 / +1.0% 0.69 / 0.70 / -1.4%
tpcds_q79/datafusion:vortex-file-compressed 19661671 / 19743303 / -0.4% 42349100 / 42493861 / -0.3% 0.46 / 0.46 / -0.1%
tpcds_q80/datafusion:vortex-file-compressed 75485753 / 73892038 / +2.2% 108290812 / 108767810 / -0.4% 0.70 / 0.68 / +2.6%
tpcds_q81/datafusion:vortex-file-compressed 26907472 / 27554158 / -2.3% 45909420 / 44729321 / +2.6% 0.59 / 0.62 / -4.9%
tpcds_q82/datafusion:vortex-file-compressed 12387346 / 12050717 / +2.8% 33575922 / 36044150 / -6.8% 0.37 / 0.33 / +10.3%
tpcds_q83/datafusion:vortex-file-compressed 34846438 / 35414627 / -1.6% 54252855 / 56479346 / -3.9% 0.64 / 0.63 / +2.4%
tpcds_q84/datafusion:vortex-file-compressed 11655856 / 11632196 / +0.2% 26400676 / 27545188 / -4.2% 0.44 / 0.42 / +4.5%
tpcds_q85/datafusion:vortex-file-compressed 56673488 / 57706786 / -1.8% 82653011 / 83059676 / -0.5% 0.69 / 0.69 / -1.3%
tpcds_q86/datafusion:vortex-file-compressed 16790315 / 16575030 / +1.3% 33567940 / 33349485 / +0.7% 0.50 / 0.50 / +0.6%
tpcds_q87/datafusion:vortex-file-compressed 29768154 / 29657272 / +0.4% 51284964 / 50447374 / +1.7% 0.58 / 0.59 / -1.3%
tpcds_q88/datafusion:vortex-file-compressed 31749430 / 31836374 / -0.3% 61515287 / 64449914 / -4.6% 0.52 / 0.49 / +4.5%
tpcds_q89/datafusion:vortex-file-compressed 21071117 / 20785233 / +1.4% 41275492 / 43262790 / -4.6% 0.51 / 0.48 / +6.3%
tpcds_q90/datafusion:vortex-file-compressed 10365870 / 10390572 / -0.2% 26174730 / 25491524 / +2.7% 0.40 / 0.41 / -2.8%
tpcds_q91/datafusion:vortex-file-compressed 15715763 / 15989087 / -1.7% 34141465 / 36510084 / -6.5% 0.46 / 0.44 / +5.1%
tpcds_q92/datafusion:vortex-file-compressed 13457244 / 13483572 / -0.2% 30266632 / 30108748 / +0.5% 0.44 / 0.45 / -0.7%
tpcds_q93/datafusion:vortex-file-compressed 22348302 / 22276023 / +0.3% 42960737 / 43518847 / -1.3% 0.52 / 0.51 / +1.6%
tpcds_q94/datafusion:vortex-file-compressed 18843924 / 18921212 / -0.4% 37458444 / 38952662 / -3.8% 0.50 / 0.49 / +3.6%
tpcds_q95/datafusion:vortex-file-compressed 44929008 / 45428216 / -1.1% 65181086 / 65255944 / -0.1% 0.69 / 0.70 / -1.0%
tpcds_q96/datafusion:vortex-file-compressed 8596184 / 8525919 / +0.8% 24285412 / 25286539 / -4.0% 0.35 / 0.34 / +5.0%
tpcds_q97/datafusion:vortex-file-compressed 21373256 / 21278044 / +0.4% 41593340 / 41989025 / -0.9% 0.51 / 0.51 / +1.4%
tpcds_q98/datafusion:vortex-file-compressed 16961159 / 17208700 / -1.4% 36731885 / 37315736 / -1.6% 0.46 / 0.46 / +0.1%
tpcds_q99/datafusion:vortex-file-compressed 20766102 / 20955358 / -0.9% 36426135 / 37464745 / -2.8% 0.57 / 0.56 / +1.9%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43776732 / 42342319 / +3.4% 59014165 / 61257652 / -3.7% 0.74 / 0.69 / +7.3%
tpcds_q02/datafusion:parquet 54266086 / 55143505 / -1.6% 71620763 / 71476375 / +0.2% 0.76 / 0.77 / -1.8%
tpcds_q03/datafusion:parquet 19176774 / 19098391 / +0.4% 31671759 / 33627129 / -5.8% 0.61 / 0.57 / +6.6%
tpcds_q04/datafusion:parquet 179667919 / 180666028 / -0.6% 209539968 / 211741840 / -1.0% 0.86 / 0.85 / +0.5%
tpcds_q05/datafusion:parquet 68383640 / 66529618 / +2.8% 89252875 / 92241974 / -3.2% 0.77 / 0.72 / +6.2%
tpcds_q06/datafusion:parquet 33623806 / 33628342 / -0.0% 47981025 / 50137144 / -4.3% 0.70 / 0.67 / +4.5%
tpcds_q07/datafusion:parquet 47020431 / 47217184 / -0.4% 65324226 / 69904227 / -6.6% 0.72 / 0.68 / +6.6%
tpcds_q08/datafusion:parquet 30950066 / 30913066 / +0.1% 47219951 / 49497045 / -4.6% 0.66 / 0.62 / +4.9%
tpcds_q09/datafusion:parquet 32775769 / 32876206 / -0.3% 45219785 / 44073974 / +2.6% 0.72 / 0.75 / -2.8%
tpcds_q10/datafusion:parquet 45545868 / 44661752 / +2.0% 58312928 / 62768689 / -7.1% 0.78 / 0.71 / +9.8%
tpcds_q11/datafusion:parquet 98869328 / 98031128 / +0.9% 118708187 / 122627150 / -3.2% 0.83 / 0.80 / +4.2%
tpcds_q12/datafusion:parquet 23620240 / 23681144 / -0.3% 36768173 / 37271207 / -1.3% 0.64 / 0.64 / +1.1%
tpcds_q13/datafusion:parquet 46919302 / 46760892 / +0.3% 70632375 / 68587697 / +3.0% 0.66 / 0.68 / -2.6%
tpcds_q14/datafusion:parquet 536757778 / 536077758 / +0.1% 584186517 / 585032257 / -0.1% 0.92 / 0.92 / +0.3%
tpcds_q15/datafusion:parquet 23765045 / 23624702 / +0.6% 38426047 / 39603827 / -3.0% 0.62 / 0.60 / +3.7%
tpcds_q16/datafusion:parquet 37101860 / 36747863 / +1.0% 50681961 / 52689085 / -3.8% 0.73 / 0.70 / +5.0%
tpcds_q17/datafusion:parquet 74828679 / 73959180 / +1.2% 97927296 / 102263877 / -4.2% 0.76 / 0.72 / +5.7%
tpcds_q18/datafusion:parquet 66081462 / 69627221 / -5.1% 88780850 / 90772334 / -2.2% 0.74 / 0.77 / -3.0%
tpcds_q19/datafusion:parquet 29571226 / 29077212 / +1.7% 43185395 / 45263845 / -4.6% 0.68 / 0.64 / +6.6%
tpcds_q20/datafusion:parquet 25271992 / 24886894 / +1.5% 36269887 / 38405351 / -5.6% 0.70 / 0.65 / +7.5%
tpcds_q21/datafusion:parquet 20188724 / 20065650 / +0.6% 32801390 / 37065857 / -11.5% 🟢 0.62 / 0.54 / +13.7%
tpcds_q22/datafusion:parquet 77521893 / 78090590 / -0.7% 90557674 / 89588759 / +1.1% 0.86 / 0.87 / -1.8%
tpcds_q23/datafusion:parquet 90229583 / 91370088 / -1.2% 113686328 / 118731384 / -4.2% 0.79 / 0.77 / +3.1%
tpcds_q24/datafusion:parquet 91010972 / 90964400 / +0.1% 118359300 / 119517905 / -1.0% 0.77 / 0.76 / +1.0%
tpcds_q25/datafusion:parquet 80025754 / 80358559 / -0.4% 102560021 / 102675966 / -0.1% 0.78 / 0.78 / -0.3%
tpcds_q26/datafusion:parquet 43368404 / 43489990 / -0.3% 60954016 / 60944621 / +0.0% 0.71 / 0.71 / -0.3%
tpcds_q27/datafusion:parquet 79854630 / 76661392 / +4.2% 98932984 / 101548547 / -2.6% 0.81 / 0.75 / +6.9%
tpcds_q28/datafusion:parquet 28784851 / 28869528 / -0.3% 42687288 / 43223698 / -1.2% 0.67 / 0.67 / +1.0%
tpcds_q29/datafusion:parquet 75390092 / 75743942 / -0.5% 95152090 / 97558525 / -2.5% 0.79 / 0.78 / +2.1%
tpcds_q30/datafusion:parquet 45569030 / 44615652 / +2.1% 57843191 / 58130476 / -0.5% 0.79 / 0.77 / +2.6%
tpcds_q31/datafusion:parquet 78291862 / 79813010 / -1.9% 101427264 / 100512358 / +0.9% 0.77 / 0.79 / -2.8%
tpcds_q32/datafusion:parquet 26177594 / 26560209 / -1.4% 42173034 / 41720128 / +1.1% 0.62 / 0.64 / -2.5%
tpcds_q33/datafusion:parquet 37392766 / 37202648 / +0.5% 57810497 / 54260124 / +6.5% 0.65 / 0.69 / -5.7%
tpcds_q34/datafusion:parquet 24761188 / 24728300 / +0.1% 36129723 / 37096927 / -2.6% 0.69 / 0.67 / +2.8%
tpcds_q35/datafusion:parquet 50663983 / 51381563 / -1.4% 64657317 / 63391867 / +2.0% 0.78 / 0.81 / -3.3%
tpcds_q36/datafusion:parquet 52068309 / 51937457 / +0.3% 70920796 / 77782117 / -8.8% 0.73 / 0.67 / +10.0%
tpcds_q37/datafusion:parquet 21084650 / 21044048 / +0.2% 34905390 / 34584565 / +0.9% 0.60 / 0.61 / -0.7%
tpcds_q38/datafusion:parquet 44649924 / 43839286 / +1.8% 60666865 / 60808205 / -0.2% 0.74 / 0.72 / +2.1%
tpcds_q39/datafusion:parquet 67929324 / 67749282 / +0.3% 85674702 / 86423052 / -0.9% 0.79 / 0.78 / +1.1%
tpcds_q40/datafusion:parquet 31504462 / 30565510 / +3.1% 51361236 / 51444265 / -0.2% 0.61 / 0.59 / +3.2%
tpcds_q41/datafusion:parquet 19707168 / 19575210 / +0.7% 30975380 / 32251896 / -4.0% 0.64 / 0.61 / +4.8%
tpcds_q42/datafusion:parquet 18061686 / 17910118 / +0.8% 31510994 / 32901640 / -4.2% 0.57 / 0.54 / +5.3%
tpcds_q43/datafusion:parquet 19252354 / 19461452 / -1.1% 32117647 / 33673707 / -4.6% 0.60 / 0.58 / +3.7%
tpcds_q44/datafusion:parquet 34869627 / 35232180 / -1.0% 51227901 / 51276848 / -0.1% 0.68 / 0.69 / -0.9%
tpcds_q45/datafusion:parquet 27742594 / 27121640 / +2.3% 41206092 / 42458151 / -2.9% 0.67 / 0.64 / +5.4%
tpcds_q46/datafusion:parquet 29570774 / 28905914 / +2.3% 45347904 / 47551843 / -4.6% 0.65 / 0.61 / +7.3%
tpcds_q47/datafusion:parquet 96462436 / 97806382 / -1.4% 122054253 / 121136656 / +0.8% 0.79 / 0.81 / -2.1%
tpcds_q48/datafusion:parquet 41909610 / 42273042 / -0.9% 60094879 / 62354353 / -3.6% 0.70 / 0.68 / +2.9%
tpcds_q49/datafusion:parquet 70975446 / 72611421 / -2.3% 94044531 / 95787900 / -1.8% 0.75 / 0.76 / -0.4%
tpcds_q50/datafusion:parquet 48828519 / 47612320 / +2.6% 68223261 / 69150564 / -1.3% 0.72 / 0.69 / +3.9%
tpcds_q51/datafusion:parquet 75594908 / 75853469 / -0.3% 96171210 / 95914921 / +0.3% 0.79 / 0.79 / -0.6%
tpcds_q52/datafusion:parquet 18484022 / 18385981 / +0.5% 30242069 / 30554583 / -1.0% 0.61 / 0.60 / +1.6%
tpcds_q53/datafusion:parquet 22728252 / 22418438 / +1.4% 40192824 / 40214746 / -0.1% 0.57 / 0.56 / +1.4%
tpcds_q54/datafusion:parquet 52978275 / 51970315 / +1.9% 76986058 / 70571297 / +9.1% 0.69 / 0.74 / -6.6%
tpcds_q55/datafusion:parquet 18131564 / 18148016 / -0.1% 29649888 / 31191927 / -4.9% 0.61 / 0.58 / +5.1%
tpcds_q56/datafusion:parquet 41930934 / 42652264 / -1.7% 57236278 / 55948874 / +2.3% 0.73 / 0.76 / -3.9%
tpcds_q57/datafusion:parquet 102697962 / 101451746 / +1.2% 118438463 / 121596455 / -2.6% 0.87 / 0.83 / +3.9%
tpcds_q58/datafusion:parquet 65524846 / 65430919 / +0.1% 84133403 / 83030083 / +1.3% 0.78 / 0.79 / -1.2%
tpcds_q59/datafusion:parquet 48315409 / 47638021 / +1.4% 63312831 / 66443994 / -4.7% 0.76 / 0.72 / +6.4%
tpcds_q60/datafusion:parquet 41062980 / 41047952 / +0.0% 54968432 / 55011590 / -0.1% 0.75 / 0.75 / +0.1%
tpcds_q61/datafusion:parquet 36479083 / 36443764 / +0.1% 52425562 / 53052265 / -1.2% 0.70 / 0.69 / +1.3%
tpcds_q62/datafusion:parquet 25272952 / 25283660 / -0.0% 38877379 / 39250911 / -1.0% 0.65 / 0.64 / +0.9%
tpcds_q63/datafusion:parquet 22329476 / 22481886 / -0.7% 40655606 / 39633332 / +2.6% 0.55 / 0.57 / -3.2%
tpcds_q64/datafusion:parquet 289607780 / 289545083 / +0.0% 327989663 / 331287990 / -1.0% 0.88 / 0.87 / +1.0%
tpcds_q65/datafusion:parquet 120089206 / 124238052 / -3.3% 139803121 / 142370344 / -1.8% 0.86 / 0.87 / -1.6%
tpcds_q66/datafusion:parquet 60282615 / 60263691 / +0.0% 76883409 / 75719793 / +1.5% 0.78 / 0.80 / -1.5%
tpcds_q67/datafusion:parquet 68616352 / 68501276 / +0.2% 94438635 / 91884823 / +2.8% 0.73 / 0.75 / -2.5%
tpcds_q68/datafusion:parquet 29461649 / 29613206 / -0.5% 48060062 / 50252279 / -4.4% 0.61 / 0.59 / +4.0%
tpcds_q69/datafusion:parquet 44774602 / 43927584 / +1.9% 53889366 / 59147697 / -8.9% 0.83 / 0.74 / +11.9%
tpcds_q70/datafusion:parquet 81497674 / 80179342 / +1.6% 99829724 / 97546241 / +2.3% 0.82 / 0.82 / -0.7%
tpcds_q71/datafusion:parquet 24956210 / 24823230 / +0.5% 36617066 / 38402843 / -4.7% 0.68 / 0.65 / +5.4%
tpcds_q72/datafusion:parquet 526014912 / 519913581 / +1.2% 547932261 / 561251180 / -2.4% 0.96 / 0.93 / +3.6%
tpcds_q73/datafusion:parquet 23697068 / 23683572 / +0.1% 36124368 / 37546492 / -3.8% 0.66 / 0.63 / +4.0%
tpcds_q74/datafusion:parquet 69298686 / 70495023 / -1.7% 88030794 / 91979620 / -4.3% 0.79 / 0.77 / +2.7%
tpcds_q75/datafusion:parquet 155036538 / 156539555 / -1.0% 182338938 / 181039135 / +0.7% 0.85 / 0.86 / -1.7%
tpcds_q76/datafusion:parquet 33465266 / 33150843 / +0.9% 46393157 / 47958055 / -3.3% 0.72 / 0.69 / +4.4%
tpcds_q77/datafusion:parquet 55992489 / 56218003 / -0.4% 75858613 / 76144449 / -0.4% 0.74 / 0.74 / -0.0%
tpcds_q78/datafusion:parquet 87783557 / 84765258 / +3.6% 120413917 / 121484930 / -0.9% 0.73 / 0.70 / +4.5%
tpcds_q79/datafusion:parquet 27151500 / 27162186 / -0.0% 42262271 / 42948828 / -1.6% 0.64 / 0.63 / +1.6%
tpcds_q80/datafusion:parquet 80645276 / 81147727 / -0.6% 110103770 / 111124998 / -0.9% 0.73 / 0.73 / +0.3%
tpcds_q81/datafusion:parquet 39100748 / 39547937 / -1.1% 52994307 / 52108316 / +1.7% 0.74 / 0.76 / -2.8%
tpcds_q82/datafusion:parquet 21834086 / 22473788 / -2.8% 34970703 / 37454058 / -6.6% 0.62 / 0.60 / +4.1%
tpcds_q83/datafusion:parquet 59539983 / 58400199 / +2.0% 73140138 / 74534367 / -1.9% 0.81 / 0.78 / +3.9%
tpcds_q84/datafusion:parquet 26536780 / 26365668 / +0.6% 41758132 / 42981957 / -2.8% 0.64 / 0.61 / +3.6%
tpcds_q85/datafusion:parquet 81395146 / 81489800 / -0.1% 104608238 / 105772414 / -1.1% 0.78 / 0.77 / +1.0%
tpcds_q86/datafusion:parquet 20393536 / 20928072 / -2.6% 33121186 / 34173359 / -3.1% 0.62 / 0.61 / +0.5%
tpcds_q87/datafusion:parquet 45090200 / 44274236 / +1.8% 63034131 / 61295388 / +2.8% 0.72 / 0.72 / -1.0%
tpcds_q88/datafusion:parquet 37370110 / 38060078 / -1.8% 51050991 / 51975992 / -1.8% 0.73 / 0.73 / -0.0%
tpcds_q89/datafusion:parquet 26123150 / 26132446 / -0.0% 41706893 / 42520178 / -1.9% 0.63 / 0.61 / +1.9%
tpcds_q90/datafusion:parquet 14752086 / 14483539 / +1.9% 27744161 / 27687013 / +0.2% 0.53 / 0.52 / +1.6%
tpcds_q91/datafusion:parquet 32085919 / 31445510 / +2.0% 46538033 / 46667621 / -0.3% 0.69 / 0.67 / +2.3%
tpcds_q92/datafusion:parquet 26825154 / 25611174 / +4.7% 41498024 / 42875566 / -3.2% 0.65 / 0.60 / +8.2%
tpcds_q93/datafusion:parquet 27406950 / 27857986 / -1.6% 46908454 / 47925748 / -2.1% 0.58 / 0.58 / +0.5%
tpcds_q94/datafusion:parquet 34753463 / 35214121 / -1.3% 49576592 / 50346595 / -1.5% 0.70 / 0.70 / +0.2%
tpcds_q95/datafusion:parquet 63707358 / 63717786 / -0.0% 77031905 / 79546237 / -3.2% 0.83 / 0.80 / +3.2%
tpcds_q96/datafusion:parquet 12412954 / 12557131 / -1.1% 24494047 / 25641121 / -4.5% 0.51 / 0.49 / +3.5%
tpcds_q97/datafusion:parquet 35226162 / 34640522 / +1.7% 48433433 / 53031210 / -8.7% 0.73 / 0.65 / +11.3%
tpcds_q98/datafusion:parquet 24799688 / 25360528 / -2.2% 40127575 / 41318138 / -2.9% 0.62 / 0.61 / +0.7%
tpcds_q99/datafusion:parquet 29942719 / 29853403 / +0.3% 41868324 / 43599623 / -4.0% 0.72 / 0.68 / +4.4%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 17430470 / 17173180 / +1.5% 27183450 / 25902512 / +4.9% 0.64 / 0.66 / -3.3%
tpcds_q02/duckdb:vortex-file-compressed 16103998 / 15762133 / +2.2% 23960959 / 23438621 / +2.2% 0.67 / 0.67 / -0.1%
tpcds_q03/duckdb:vortex-file-compressed 7204522 / 7047554 / +2.2% 17057601 / 16407443 / +4.0% 0.42 / 0.43 / -1.7%
tpcds_q04/duckdb:vortex-file-compressed 48384500 / 47948043 / +0.9% 58754228 / 57402020 / +2.4% 0.82 / 0.84 / -1.4%
tpcds_q05/duckdb:vortex-file-compressed 23398116 / 23499506 / -0.4% 32145380 / 32184654 / -0.1% 0.73 / 0.73 / -0.3%
tpcds_q06/duckdb:vortex-file-compressed 28193151 / 27929844 / +0.9% 41733976 / 42200850 / -1.1% 0.68 / 0.66 / +2.1%
tpcds_q07/duckdb:vortex-file-compressed 14415569 / 14134780 / +2.0% 26514337 / 26002791 / +2.0% 0.54 / 0.54 / +0.0%
tpcds_q08/duckdb:vortex-file-compressed 18789861 / 18722682 / +0.4% 27576385 / 27360223 / +0.8% 0.68 / 0.68 / -0.4%
tpcds_q09/duckdb:vortex-file-compressed 18051830 / 17694484 / +2.0% 29001227 / 28794139 / +0.7% 0.62 / 0.61 / +1.3%
tpcds_q10/duckdb:vortex-file-compressed 32953507 / 32774893 / +0.5% 47024848 / 46947099 / +0.2% 0.70 / 0.70 / +0.4%
tpcds_q11/duckdb:vortex-file-compressed 39449380 / 39390268 / +0.2% 48386376 / 47541809 / +1.8% 0.82 / 0.83 / -1.6%
tpcds_q12/duckdb:vortex-file-compressed 10536567 / 10502147 / +0.3% 18364420 / 18335227 / +0.2% 0.57 / 0.57 / +0.2%
tpcds_q13/duckdb:vortex-file-compressed 21302086 / 21123294 / +0.8% 35190612 / 35118340 / +0.2% 0.61 / 0.60 / +0.6%
tpcds_q14/duckdb:vortex-file-compressed 58475508 / 58572963 / -0.2% 69469323 / 68636204 / +1.2% 0.84 / 0.85 / -1.4%
tpcds_q15/duckdb:vortex-file-compressed 27434472 / 27460500 / -0.1% 35789971 / 35407478 / +1.1% 0.77 / 0.78 / -1.2%
tpcds_q16/duckdb:vortex-file-compressed 36010944 / 35931396 / +0.2% 47737532 / 47368058 / +0.8% 0.75 / 0.76 / -0.6%
tpcds_q17/duckdb:vortex-file-compressed 26173898 / 25725354 / +1.7% 41674793 / 40699964 / +2.4% 0.63 / 0.63 / -0.6%
tpcds_q18/duckdb:vortex-file-compressed 33077642 / 32740176 / +1.0% 44005344 / 43961821 / +0.1% 0.75 / 0.74 / +0.9%
tpcds_q19/duckdb:vortex-file-compressed 90167310 / 89878690 / +0.3% 101980371 / 102468806 / -0.5% 0.88 / 0.88 / +0.8%
tpcds_q20/duckdb:vortex-file-compressed 11277932 / 11259968 / +0.2% 19069588 / 19404303 / -1.7% 0.59 / 0.58 / +1.9%
tpcds_q21/duckdb:vortex-file-compressed 10455901 / 10460080 / -0.0% 22589934 / 21635040 / +4.4% 0.46 / 0.48 / -4.3%
tpcds_q22/duckdb:vortex-file-compressed 18686686 / 18843970 / -0.8% 29192024 / 29806857 / -2.1% 0.64 / 0.63 / +1.3%
tpcds_q23/duckdb:vortex-file-compressed 39683551 / 39388912 / +0.7% 51419900 / 50334015 / +2.2% 0.77 / 0.78 / -1.4%
tpcds_q24/duckdb:vortex-file-compressed 28823678 / 28662630 / +0.6% 40252705 / 40382030 / -0.3% 0.72 / 0.71 / +0.9%
tpcds_q25/duckdb:vortex-file-compressed 24219060 / 24283157 / -0.3% 39460747 / 38754656 / +1.8% 0.61 / 0.63 / -2.0%
tpcds_q26/duckdb:vortex-file-compressed 13527598 / 13541502 / -0.1% 22305105 / 22490696 / -0.8% 0.61 / 0.60 / +0.7%
tpcds_q27/duckdb:vortex-file-compressed 17216918 / 16929184 / +1.7% 29695741 / 28768180 / +3.2% 0.58 / 0.59 / -1.5%
tpcds_q28/duckdb:vortex-file-compressed 15674989 / 15507686 / +1.1% 24474233 / 24664351 / -0.8% 0.64 / 0.63 / +1.9%
tpcds_q29/duckdb:vortex-file-compressed 24170900 / 24170279 / +0.0% 39058601 / 38229981 / +2.2% 0.62 / 0.63 / -2.1%
tpcds_q30/duckdb:vortex-file-compressed 16700179 / 16483946 / +1.3% 25597792 / 25868349 / -1.0% 0.65 / 0.64 / +2.4%
tpcds_q31/duckdb:vortex-file-compressed 18982631 / 19083316 / -0.5% 27597372 / 27044491 / +2.0% 0.69 / 0.71 / -2.5%
tpcds_q32/duckdb:vortex-file-compressed 13421454 / 13267185 / +1.2% 21818595 / 22526237 / -3.1% 0.62 / 0.59 / +4.4%
tpcds_q33/duckdb:vortex-file-compressed 18017990 / 17590376 / +2.4% 26684600 / 26241882 / +1.7% 0.68 / 0.67 / +0.7%
tpcds_q34/duckdb:vortex-file-compressed 12934464 / 12943280 / -0.1% 23267965 / 23656525 / -1.6% 0.56 / 0.55 / +1.6%
tpcds_q35/duckdb:vortex-file-compressed 29180362 / 29627446 / -1.5% 41094256 / 41716209 / -1.5% 0.71 / 0.71 / -0.0%
tpcds_q36/duckdb:vortex-file-compressed 15310713 / 15484970 / -1.1% 26879838 / 25961145 / +3.5% 0.57 / 0.60 / -4.5%
tpcds_q37/duckdb:vortex-file-compressed 9519454 / 9651904 / -1.4% 24731767 / 23714996 / +4.3% 0.38 / 0.41 / -5.4%
tpcds_q38/duckdb:vortex-file-compressed 25271462 / 25481895 / -0.8% 33280560 / 32749468 / +1.6% 0.76 / 0.78 / -2.4%
tpcds_q39/duckdb:vortex-file-compressed 20386894 / 21054850 / -3.2% 33221493 / 32234148 / +3.1% 0.61 / 0.65 / -6.1%
tpcds_q40/duckdb:vortex-file-compressed 14373436 / 14563654 / -1.3% 21799835 / 22160925 / -1.6% 0.66 / 0.66 / +0.3%
tpcds_q41/duckdb:vortex-file-compressed 15662047 / 15518768 / +0.9% 24492227 / 23893171 / +2.5% 0.64 / 0.65 / -1.5%
tpcds_q42/duckdb:vortex-file-compressed 7217678 / 7267848 / -0.7% 16183935 / 16513911 / -2.0% 0.45 / 0.44 / +1.3%
tpcds_q43/duckdb:vortex-file-compressed 10546588 / 10447340 / +0.9% 19799291 / 19687457 / +0.6% 0.53 / 0.53 / +0.4%
tpcds_q44/duckdb:vortex-file-compressed 14971163 / 15883547 / -5.7% 27306359 / 26993546 / +1.2% 0.55 / 0.59 / -6.8%
tpcds_q45/duckdb:vortex-file-compressed 25182769 / 25261136 / -0.3% 34218426 / 33359239 / +2.6% 0.74 / 0.76 / -2.8%
tpcds_q46/duckdb:vortex-file-compressed 20409370 / 19814184 / +3.0% 29380832 / 28817494 / +2.0% 0.69 / 0.69 / +1.0%
tpcds_q47/duckdb:vortex-file-compressed 36896296 / 36637049 / +0.7% 47533141 / 46404112 / +2.4% 0.78 / 0.79 / -1.7%
tpcds_q48/duckdb:vortex-file-compressed 24328202 / 24327780 / +0.0% 38139160 / 37594501 / +1.4% 0.64 / 0.65 / -1.4%
tpcds_q49/duckdb:vortex-file-compressed 20810286 / 20819132 / -0.0% 35179948 / 33665641 / +4.5% 0.59 / 0.62 / -4.3%
tpcds_q50/duckdb:vortex-file-compressed 17647850 / 17667423 / -0.1% 30889524 / 30248978 / +2.1% 0.57 / 0.58 / -2.2%
tpcds_q51/duckdb:vortex-file-compressed 51602229 / 51051447 / +1.1% 82144905 / 60498634 / +35.8% 🔴 0.63 / 0.84 / -25.6%
tpcds_q52/duckdb:vortex-file-compressed 7465866 / 7374062 / +1.2% 16333322 / 16175803 / +1.0% 0.46 / 0.46 / +0.3%
tpcds_q53/duckdb:vortex-file-compressed 12202844 / 12070824 / +1.1% 21709162 / 21681895 / +0.1% 0.56 / 0.56 / +1.0%
tpcds_q54/duckdb:vortex-file-compressed 20597696 / 20524428 / +0.4% 29793655 / 29714622 / +0.3% 0.69 / 0.69 / +0.1%
tpcds_q55/duckdb:vortex-file-compressed 7285795 / 7146766 / +1.9% 16179596 / 16343647 / -1.0% 0.45 / 0.44 / +3.0%
tpcds_q56/duckdb:vortex-file-compressed 18088036 / 18066162 / +0.1% 27542064 / 27712758 / -0.6% 0.66 / 0.65 / +0.7%
tpcds_q57/duckdb:vortex-file-compressed 27647983 / 27204833 / +1.6% 36555835 / 35974720 / +1.6% 0.76 / 0.76 / +0.0%
tpcds_q58/duckdb:vortex-file-compressed 20458720 / 20563898 / -0.5% 29998298 / 29624803 / +1.3% 0.68 / 0.69 / -1.8%
tpcds_q59/duckdb:vortex-file-compressed 20378540 / 20737125 / -1.7% 29019025 / 29129596 / -0.4% 0.70 / 0.71 / -1.4%
tpcds_q60/duckdb:vortex-file-compressed 18624326 / 18838308 / -1.1% 29379452 / 28334606 / +3.7% 0.63 / 0.66 / -4.7%
tpcds_q61/duckdb:vortex-file-compressed 23915752 / 24020490 / -0.4% 35146968 / 33983049 / +3.4% 0.68 / 0.71 / -3.7%
tpcds_q62/duckdb:vortex-file-compressed 12472045 / 12457608 / +0.1% 20325292 / 20560806 / -1.1% 0.61 / 0.61 / +1.3%
tpcds_q63/duckdb:vortex-file-compressed 11502747 / 11540182 / -0.3% 20981440 / 20976929 / +0.0% 0.55 / 0.55 / -0.3%
tpcds_q64/duckdb:vortex-file-compressed 50797532 / 51397340 / -1.2% 72725704 / 71832998 / +1.2% 0.70 / 0.72 / -2.4%
tpcds_q65/duckdb:vortex-file-compressed 15460843 / 15832538 / -2.3% 26062052 / 25205279 / +3.4% 0.59 / 0.63 / -5.6%
tpcds_q66/duckdb:vortex-file-compressed 31576168 / 30902808 / +2.2% 42321401 / 41136252 / +2.9% 0.75 / 0.75 / -0.7%
tpcds_q67/duckdb:vortex-file-compressed 64752273 / 64602119 / +0.2% 74610036 / 73547075 / +1.4% 0.87 / 0.88 / -1.2%
tpcds_q68/duckdb:vortex-file-compressed 20061322 / 19919454 / +0.7% 30148336 / 28560245 / +5.6% 0.67 / 0.70 / -4.6%
tpcds_q69/duckdb:vortex-file-compressed 22890126 / 23109414 / -0.9% 38713260 / 38548230 / +0.4% 0.59 / 0.60 / -1.4%
tpcds_q70/duckdb:vortex-file-compressed 16521350 / 16159616 / +2.2% 26577779 / 27039094 / -1.7% 0.62 / 0.60 / +4.0%
tpcds_q71/duckdb:vortex-file-compressed 13259845 / 13129306 / +1.0% 22562613 / 22269462 / +1.3% 0.59 / 0.59 / -0.3%
tpcds_q72/duckdb:vortex-file-compressed 57917166 / 57611030 / +0.5% 72544354 / 73446933 / -1.2% 0.80 / 0.78 / +1.8%
tpcds_q73/duckdb:vortex-file-compressed 11842361 / 11751231 / +0.8% 22060193 / 22075123 / -0.1% 0.54 / 0.53 / +0.8%
tpcds_q74/duckdb:vortex-file-compressed 27215454 / 27339758 / -0.5% 35128163 / 35846843 / -2.0% 0.77 / 0.76 / +1.6%
tpcds_q75/duckdb:vortex-file-compressed 29340906 / 29134621 / +0.7% 41453143 / 42167283 / -1.7% 0.71 / 0.69 / +2.4%
tpcds_q76/duckdb:vortex-file-compressed 12717766 / 12827996 / -0.9% 22450173 / 22704042 / -1.1% 0.57 / 0.57 / +0.3%
tpcds_q77/duckdb:vortex-file-compressed 21522554 / 21616440 / -0.4% 31350625 / 33176472 / -5.5% 0.69 / 0.65 / +5.4%
tpcds_q78/duckdb:vortex-file-compressed 43805791 / 44523978 / -1.6% 53992330 / 53273958 / +1.3% 0.81 / 0.84 / -2.9%
tpcds_q79/duckdb:vortex-file-compressed 13790198 / 14003784 / -1.5% 22621536 / 22858041 / -1.0% 0.61 / 0.61 / -0.5%
tpcds_q80/duckdb:vortex-file-compressed 37949674 / 37680340 / +0.7% 51034679 / 52302852 / -2.4% 0.74 / 0.72 / +3.2%
tpcds_q81/duckdb:vortex-file-compressed 21882488 / 21738764 / +0.7% 28996266 / 30457146 / -4.8% 0.75 / 0.71 / +5.7%
tpcds_q82/duckdb:vortex-file-compressed 9922862 / 9962672 / -0.4% 25038664 / 24068440 / +4.0% 0.40 / 0.41 / -4.3%
tpcds_q83/duckdb:vortex-file-compressed 17777295 / 17733908 / +0.2% 25438806 / 25763049 / -1.3% 0.70 / 0.69 / +1.5%
tpcds_q84/duckdb:vortex-file-compressed 16233821 / 16072916 / +1.0% 25121809 / 24022630 / +4.6% 0.65 / 0.67 / -3.4%
tpcds_q85/duckdb:vortex-file-compressed 25288279 / 25193112 / +0.4% 39013769 / 38088257 / +2.4% 0.65 / 0.66 / -2.0%
tpcds_q86/duckdb:vortex-file-compressed 10280612 / 10163340 / +1.2% 19052618 / 18589480 / +2.5% 0.54 / 0.55 / -1.3%
tpcds_q87/duckdb:vortex-file-compressed 26912176 / 27316706 / -1.5% 33608865 / 33955488 / -1.0% 0.80 / 0.80 / -0.5%
tpcds_q88/duckdb:vortex-file-compressed 38625176 / 38624630 / +0.0% 48513062 / 48555916 / -0.1% 0.80 / 0.80 / +0.1%
tpcds_q89/duckdb:vortex-file-compressed 12700406 / 12861707 / -1.3% 22280293 / 22391424 / -0.5% 0.57 / 0.57 / -0.8%
tpcds_q90/duckdb:vortex-file-compressed 8486956 / 8682876 / -2.3% 14908140 / 15514286 / -3.9% 0.57 / 0.56 / +1.7%
tpcds_q91/duckdb:vortex-file-compressed 14557006 / 14287434 / +1.9% 22377536 / 21450299 / +4.3% 0.65 / 0.67 / -2.3%
tpcds_q92/duckdb:vortex-file-compressed 13794658 / 13631990 / +1.2% 22152655 / 23644250 / -6.3% 0.62 / 0.58 / +8.0%
tpcds_q93/duckdb:vortex-file-compressed 10996182 / 10896584 / +0.9% 26895627 / 26377670 / +2.0% 0.41 / 0.41 / -1.0%
tpcds_q94/duckdb:vortex-file-compressed 32619366 / 32627535 / -0.0% 42610713 / 42690499 / -0.2% 0.77 / 0.76 / +0.2%
tpcds_q95/duckdb:vortex-file-compressed 43709894 / 43428090 / +0.6% 53708131 / 53528092 / +0.3% 0.81 / 0.81 / +0.3%
tpcds_q96/duckdb:vortex-file-compressed 6781816 / 6757290 / +0.4% 15391721 / 15633301 / -1.5% 0.44 / 0.43 / +1.9%
tpcds_q97/duckdb:vortex-file-compressed 24054798 / 23745697 / +1.3% 32443177 / 31032927 / +4.5% 0.74 / 0.77 / -3.1%
tpcds_q98/duckdb:vortex-file-compressed 11817548 / 11944710 / -1.1% 20642882 / 20915332 / -1.3% 0.57 / 0.57 / +0.2%
tpcds_q99/duckdb:vortex-file-compressed 15368764 / 15219243 / +1.0% 23729812 / 23405034 / +1.4% 0.65 / 0.65 / -0.4%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 27054485 / 27151114 / -0.4% 34708859 / 35051980 / -1.0% 0.78 / 0.77 / +0.6%
tpcds_q02/duckdb:parquet 19263087 / 19351326 / -0.5% 26090982 / 25929519 / +0.6% 0.74 / 0.75 / -1.1%
tpcds_q03/duckdb:parquet 10910932 / 10887706 / +0.2% 18267376 / 18128570 / +0.8% 0.60 / 0.60 / -0.5%
tpcds_q04/duckdb:parquet 131293110 / 131087405 / +0.2% 139718074 / 141933791 / -1.6% 0.94 / 0.92 / +1.7%
tpcds_q05/duckdb:parquet 31037182 / 30651534 / +1.3% 37566422 / 36513571 / +2.9% 0.83 / 0.84 / -1.6%
tpcds_q06/duckdb:parquet 31893825 / 31570260 / +1.0% 42472091 / 42508912 / -0.1% 0.75 / 0.74 / +1.1%
tpcds_q07/duckdb:parquet 33155259 / 35438342 / -6.4% 43241089 / 42628769 / +1.4% 0.77 / 0.83 / -7.8%
tpcds_q08/duckdb:parquet 22414859 / 22307310 / +0.5% 29735786 / 28026302 / +6.1% 0.75 / 0.80 / -5.3%
tpcds_q09/duckdb:parquet 29922746 / 29201413 / +2.5% 33487915 / 34875698 / -4.0% 0.89 / 0.84 / +6.7%
tpcds_q10/duckdb:parquet 40627622 / 40322321 / +0.8% 49557918 / 49695726 / -0.3% 0.82 / 0.81 / +1.0%
tpcds_q11/duckdb:parquet 75202810 / 74757432 / +0.6% 80981390 / 83480496 / -3.0% 0.93 / 0.90 / +3.7%
tpcds_q12/duckdb:parquet 15999548 / 15944139 / +0.3% 22440533 / 22440182 / +0.0% 0.71 / 0.71 / +0.3%
tpcds_q13/duckdb:parquet 32370352 / 32905201 / -1.6% 43784837 / 43479223 / +0.7% 0.74 / 0.76 / -2.3%
tpcds_q14/duckdb:parquet 72405938 / 72731968 / -0.4% 76689452 / 77024240 / -0.4% 0.94 / 0.94 / -0.0%
tpcds_q15/duckdb:parquet 18637589 / 18549017 / +0.5% 25693880 / 25507585 / +0.7% 0.73 / 0.73 / -0.3%
tpcds_q16/duckdb:parquet 43698460 / 43857800 / -0.4% 51383854 / 51522944 / -0.3% 0.85 / 0.85 / -0.1%
tpcds_q17/duckdb:parquet 38096812 / 38111378 / -0.0% 45423446 / 45381460 / +0.1% 0.84 / 0.84 / -0.1%
tpcds_q18/duckdb:parquet 51514268 / 51456594 / +0.1% 60345351 / 59772617 / +1.0% 0.85 / 0.86 / -0.8%
tpcds_q19/duckdb:parquet 20554914 / 20376523 / +0.9% 29022547 / 29242768 / -0.8% 0.71 / 0.70 / +1.6%
tpcds_q20/duckdb:parquet 17175671 / 17302372 / -0.7% 22772390 / 22854888 / -0.4% 0.75 / 0.76 / -0.4%
tpcds_q21/duckdb:parquet 12169703 / 12063131 / +0.9% 19108239 / 19307994 / -1.0% 0.64 / 0.62 / +1.9%
tpcds_q22/duckdb:parquet 22416118 / 22501341 / -0.4% 29503336 / 29365882 / +0.5% 0.76 / 0.77 / -0.8%
tpcds_q23/duckdb:parquet 46577540 / 45772992 / +1.8% 52733312 / 52193452 / +1.0% 0.88 / 0.88 / +0.7%
tpcds_q24/duckdb:parquet 33043374 / 32811496 / +0.7% 41158635 / 41213196 / -0.1% 0.80 / 0.80 / +0.8%
tpcds_q25/duckdb:parquet 33606760 / 33671594 / -0.2% 41562041 / 41968323 / -1.0% 0.81 / 0.80 / +0.8%
tpcds_q26/duckdb:parquet 31089166 / 31172440 / -0.3% 39339244 / 39343781 / -0.0% 0.79 / 0.79 / -0.3%
tpcds_q27/duckdb:parquet 36934569 / 35747910 / +3.3% 45034160 / 44653730 / +0.9% 0.82 / 0.80 / +2.4%
tpcds_q28/duckdb:parquet 28266726 / 29321746 / -3.6% 35499727 / 34921868 / +1.7% 0.80 / 0.84 / -5.2%
tpcds_q29/duckdb:parquet 35497628 / 35413647 / +0.2% 44420883 / 44464694 / -0.1% 0.80 / 0.80 / +0.3%
tpcds_q30/duckdb:parquet 40533527 / 40181442 / +0.9% 50356655 / 50314137 / +0.1% 0.80 / 0.80 / +0.8%
tpcds_q31/duckdb:parquet 38741722 / 38627317 / +0.3% 47251148 / 47131796 / +0.3% 0.82 / 0.82 / +0.0%
tpcds_q32/duckdb:parquet 17390122 / 17357146 / +0.2% 24409543 / 24501030 / -0.4% 0.71 / 0.71 / +0.6%
tpcds_q33/duckdb:parquet 24676300 / 24601088 / +0.3% 32451131 / 31719428 / +2.3% 0.76 / 0.78 / -2.0%
tpcds_q34/duckdb:parquet 18263788 / 18280992 / -0.1% 26378654 / 26778336 / -1.5% 0.69 / 0.68 / +1.4%
tpcds_q35/duckdb:parquet 39375978 / 39546849 / -0.4% 48707802 / 49311428 / -1.2% 0.81 / 0.80 / +0.8%
tpcds_q36/duckdb:parquet 42996686 / 42860846 / +0.3% 53048597 / 52538453 / +1.0% 0.81 / 0.82 / -0.6%
tpcds_q37/duckdb:parquet 14583162 / 14766494 / -1.2% 22583509 / 22540356 / +0.2% 0.65 / 0.66 / -1.4%
tpcds_q38/duckdb:parquet 32254206 / 31967878 / +0.9% 37426902 / 38921066 / -3.8% 0.86 / 0.82 / +4.9%
tpcds_q39/duckdb:parquet 25235389 / 25084314 / +0.6% 32622375 / 32988817 / -1.1% 0.77 / 0.76 / +1.7%
tpcds_q40/duckdb:parquet 18101120 / 18070956 / +0.2% 24426829 / 24613730 / -0.8% 0.74 / 0.73 / +0.9%
tpcds_q41/duckdb:parquet 13971554 / 13965888 / +0.0% 21670315 / 21919007 / -1.1% 0.64 / 0.64 / +1.2%
tpcds_q42/duckdb:parquet 10441836 / 10450338 / -0.1% 17697924 / 17983569 / -1.6% 0.59 / 0.58 / +1.5%
tpcds_q43/duckdb:parquet 13507062 / 13620982 / -0.8% 20955637 / 21190619 / -1.1% 0.64 / 0.64 / +0.3%
tpcds_q44/duckdb:parquet 22764788 / 23654498 / -3.8% 30104875 / 31796630 / -5.3% 0.76 / 0.74 / +1.6%
tpcds_q45/duckdb:parquet 23576826 / 23428490 / +0.6% 31299729 / 31292443 / +0.0% 0.75 / 0.75 / +0.6%
tpcds_q46/duckdb:parquet 38102052 / 38068368 / +0.1% 46972555 / 47485177 / -1.1% 0.81 / 0.80 / +1.2%
tpcds_q47/duckdb:parquet 37794178 / 37168632 / +1.7% 45822125 / 45630400 / +0.4% 0.82 / 0.81 / +1.3%
tpcds_q48/duckdb:parquet 30749673 / 30794356 / -0.1% 40294354 / 40453509 / -0.4% 0.76 / 0.76 / +0.2%
tpcds_q49/duckdb:parquet 32309801 / 32350882 / -0.1% 40879793 / 40758561 / +0.3% 0.79 / 0.79 / -0.4%
tpcds_q50/duckdb:parquet 21630498 / 21430934 / +0.9% 29471792 / 28922648 / +1.9% 0.73 / 0.74 / -0.9%
tpcds_q51/duckdb:parquet 56571015 / 56744974 / -0.3% 82842191 / 64584816 / +28.3% 🔴 0.68 / 0.88 / -22.3%
tpcds_q52/duckdb:parquet 10571682 / 10692106 / -1.1% 17935009 / 18029275 / -0.5% 0.59 / 0.59 / -0.6%
tpcds_q53/duckdb:parquet 15372511 / 15348161 / +0.2% 23108490 / 23097695 / +0.0% 0.67 / 0.66 / +0.1%
tpcds_q54/duckdb:parquet 27197968 / 27321884 / -0.5% 35819629 / 35706636 / +0.3% 0.76 / 0.77 / -0.8%
tpcds_q55/duckdb:parquet 10558482 / 10420075 / +1.3% 17901572 / 17605648 / +1.7% 0.59 / 0.59 / -0.3%
tpcds_q56/duckdb:parquet 27122280 / 27164322 / -0.2% 34300058 / 34074681 / +0.7% 0.79 / 0.80 / -0.8%
tpcds_q57/duckdb:parquet 33783222 / 33369650 / +1.2% 40175188 / 39725359 / +1.1% 0.84 / 0.84 / +0.1%
tpcds_q58/duckdb:parquet 26676114 / 26149400 / +2.0% 33689787 / 33149447 / +1.6% 0.79 / 0.79 / +0.4%
tpcds_q59/duckdb:parquet 25031792 / 24663471 / +1.5% 32300036 / 32305242 / -0.0% 0.77 / 0.76 / +1.5%
tpcds_q60/duckdb:parquet 30289040 / 29514860 / +2.6% 35674197 / 35806117 / -0.4% 0.85 / 0.82 / +3.0%
tpcds_q61/duckdb:parquet 26772316 / 25588530 / +4.6% 31454369 / 31812552 / -1.1% 0.85 / 0.80 / +5.8%
tpcds_q62/duckdb:parquet 14276290 / 14264402 / +0.1% 20585059 / 20532096 / +0.3% 0.69 / 0.69 / -0.2%
tpcds_q63/duckdb:parquet 14645118 / 14530180 / +0.8% 22662323 / 23039280 / -1.6% 0.65 / 0.63 / +2.5%
tpcds_q64/duckdb:parquet 77238298 / 76909780 / +0.4% 89696852 / 88301909 / +1.6% 0.86 / 0.87 / -1.1%
tpcds_q65/duckdb:parquet 21801297 / 21043978 / +3.6% 27103397 / 27371941 / -1.0% 0.80 / 0.77 / +4.6%
tpcds_q66/duckdb:parquet 39883396 / 39927610 / -0.1% 48628998 / 47920509 / +1.5% 0.82 / 0.83 / -1.6%
tpcds_q67/duckdb:parquet 67873366 / 67596123 / +0.4% 75514327 / 75441341 / +0.1% 0.90 / 0.90 / +0.3%
tpcds_q68/duckdb:parquet 30606880 / 30764161 / -0.5% 39582316 / 40337666 / -1.9% 0.77 / 0.76 / +1.4%
tpcds_q69/duckdb:parquet 28389469 / 28571794 / -0.6% 37763847 / 38306856 / -1.4% 0.75 / 0.75 / +0.8%
tpcds_q70/duckdb:parquet 21280576 / 21228001 / +0.2% 29888802 / 29676423 / +0.7% 0.71 / 0.72 / -0.5%
tpcds_q71/duckdb:parquet 18222696 / 18397745 / -1.0% 26098837 / 26192244 / -0.4% 0.70 / 0.70 / -0.6%
tpcds_q72/duckdb:parquet 60240044 / 60272744 / -0.1% 69053363 / 68867489 / +0.3% 0.87 / 0.88 / -0.3%
tpcds_q73/duckdb:parquet 16114388 / 16036103 / +0.5% 23981387 / 23710452 / +1.1% 0.67 / 0.68 / -0.6%
tpcds_q74/duckdb:parquet 92355786 / 93142810 / -0.8% 101233337 / 101785242 / -0.5% 0.91 / 0.92 / -0.3%
tpcds_q75/duckdb:parquet 46600048 / 48594782 / -4.1% 56039544 / 55430388 / +1.1% 0.83 / 0.88 / -5.1%
tpcds_q76/duckdb:parquet 19167340 / 18586348 / +3.1% 25632213 / 25924289 / -1.1% 0.75 / 0.72 / +4.3%
tpcds_q77/duckdb:parquet 27574440 / 26872267 / +2.6% 33833498 / 34521297 / -2.0% 0.82 / 0.78 / +4.7%
tpcds_q78/duckdb:parquet 82653903 / 82598830 / +0.1% 93119438 / 91314327 / +2.0% 0.89 / 0.90 / -1.9%
tpcds_q79/duckdb:parquet 23090480 / 23199056 / -0.5% 32422415 / 33429268 / -3.0% 0.71 / 0.69 / +2.6%
tpcds_q80/duckdb:parquet 41948409 / 40304808 / +4.1% 48081464 / 47879405 / +0.4% 0.87 / 0.84 / +3.6%
tpcds_q81/duckdb:parquet 40928591 / 40928608 / -0.0% 50045478 / 49657216 / +0.8% 0.82 / 0.82 / -0.8%
tpcds_q82/duckdb:parquet 15668490 / 15562666 / +0.7% 23831891 / 23535976 / +1.3% 0.66 / 0.66 / -0.6%
tpcds_q83/duckdb:parquet 22008258 / 21926512 / +0.4% 28377785 / 28156123 / +0.8% 0.78 / 0.78 / -0.4%
tpcds_q84/duckdb:parquet 24370105 / 24487694 / -0.5% 31030171 / 31249540 / -0.7% 0.79 / 0.78 / +0.2%
tpcds_q85/duckdb:parquet 35523030 / 35153371 / +1.1% 43113247 / 44380971 / -2.9% 0.82 / 0.79 / +4.0%
tpcds_q86/duckdb:parquet 13403120 / 13319567 / +0.6% 19683282 / 20095728 / -2.1% 0.68 / 0.66 / +2.7%
tpcds_q87/duckdb:parquet 33932893 / 33921820 / +0.0% 38774718 / 39070850 / -0.8% 0.88 / 0.87 / +0.8%
tpcds_q88/duckdb:parquet 43121160 / 41809521 / +3.1% 46698643 / 50654187 / -7.8% 0.92 / 0.83 / +11.9%
tpcds_q89/duckdb:parquet 15541810 / 15482904 / +0.4% 23974406 / 23562482 / +1.7% 0.65 / 0.66 / -1.3%
tpcds_q90/duckdb:parquet 10854131 / 10810198 / +0.4% 17527883 / 17112204 / +2.4% 0.62 / 0.63 / -2.0%
tpcds_q91/duckdb:parquet 23000076 / 23009729 / -0.0% 31743005 / 31974160 / -0.7% 0.72 / 0.72 / +0.7%
tpcds_q92/duckdb:parquet 18843208 / 18695550 / +0.8% 26404037 / 27019054 / -2.3% 0.71 / 0.69 / +3.1%
tpcds_q93/duckdb:parquet 15283037 / 15203718 / +0.5% 22943681 / 22886900 / +0.2% 0.67 / 0.66 / +0.3%
tpcds_q94/duckdb:parquet 37630426 / 37460170 / +0.5% 44920181 / 45406333 / -1.1% 0.84 / 0.82 / +1.5%
tpcds_q95/duckdb:parquet 48026596 / 47795798 / +0.5% 53949640 / 54092054 / -0.3% 0.89 / 0.88 / +0.7%
tpcds_q96/duckdb:parquet 9016469 / 8950840 / +0.7% 15630271 / 15462815 / +1.1% 0.58 / 0.58 / -0.3%
tpcds_q97/duckdb:parquet 29241886 / 28903360 / +1.2% 36631239 / 36639803 / -0.0% 0.80 / 0.79 / +1.2%
tpcds_q98/duckdb:parquet 18768237 / 18607434 / +0.9% 26504275 / 26725809 / -0.8% 0.71 / 0.70 / +1.7%
tpcds_q99/duckdb:parquet 20331192 / 20241120 / +0.4% 26009762 / 26735551 / -2.7% 0.78 / 0.76 / +3.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR ba0ba3e7 vs base 86d28450
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.988x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.990x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1253394 / 1220028 / +2.7% 21282220 / 21674258 / -1.8% 0.06 / 0.06 / +4.6%
clickbench_q01/datafusion:vortex-file-compressed 6017432 / 5973806 / +0.7% 33019332 / 33536717 / -1.5% 0.18 / 0.18 / +2.3%
clickbench_q02/datafusion:vortex-file-compressed 9735352 / 9554024 / +1.9% 36945354 / 41520099 / -11.0% 🟢 0.26 / 0.23 / +14.5%
clickbench_q03/datafusion:vortex-file-compressed 11767709 / 11139780 / +5.6% 52204987 / 52589213 / -0.7% 0.23 / 0.21 / +6.4%
clickbench_q04/datafusion:vortex-file-compressed 55540334 / 56420758 / -1.6% 90627510 / 88518912 / +2.4% 0.61 / 0.64 / -3.9%
clickbench_q05/datafusion:vortex-file-compressed 74563685 / 75603954 / -1.4% 116187442 / 120811773 / -3.8% 0.64 / 0.63 / +2.5%
clickbench_q06/datafusion:vortex-file-compressed 1222512 / 1229600 / -0.6% 21473999 / 21810912 / -1.5% 0.06 / 0.06 / +1.0%
clickbench_q07/datafusion:vortex-file-compressed 9165634 / 9034759 / +1.4% 32125134 / 31946865 / +0.6% 0.29 / 0.28 / +0.9%
clickbench_q08/datafusion:vortex-file-compressed 75542711 / 75343414 / +0.3% 109191581 / 116108419 / -6.0% 0.69 / 0.65 / +6.6%
clickbench_q09/datafusion:vortex-file-compressed 172903133 / 167314690 / +3.3% 201090092 / 203635592 / -1.3% 0.86 / 0.82 / +4.6%
clickbench_q10/datafusion:vortex-file-compressed 22782567 / 23043782 / -1.1% 67619795 / 66366948 / +1.9% 0.34 / 0.35 / -3.0%
clickbench_q11/datafusion:vortex-file-compressed 23824040 / 25242898 / -5.6% 70623832 / 67724854 / +4.3% 0.34 / 0.37 / -9.5%
clickbench_q12/datafusion:vortex-file-compressed 71753156 / 72373272 / -0.9% 112955439 / 116577471 / -3.1% 0.64 / 0.62 / +2.3%
clickbench_q13/datafusion:vortex-file-compressed 116824188 / 117401208 / -0.5% 174477599 / 190779069 / -8.5% 0.67 / 0.62 / +8.8%
clickbench_q14/datafusion:vortex-file-compressed 74997710 / 75403998 / -0.5% 118600792 / 117740610 / +0.7% 0.63 / 0.64 / -1.3%
clickbench_q15/datafusion:vortex-file-compressed 62989225 / 60413037 / +4.3% 95839710 / 97333217 / -1.5% 0.66 / 0.62 / +5.9%
clickbench_q16/datafusion:vortex-file-compressed 147743203 / 148977540 / -0.8% 202572175 / 207871441 / -2.5% 0.73 / 0.72 / +1.8%
clickbench_q17/datafusion:vortex-file-compressed 147336375 / 148797968 / -1.0% 207419131 / 206768495 / +0.3% 0.71 / 0.72 / -1.3%
clickbench_q18/datafusion:vortex-file-compressed 287429730 / 286979576 / +0.2% 371172445 / 382006466 / -2.8% 0.77 / 0.75 / +3.1%
clickbench_q19/datafusion:vortex-file-compressed 7159852 / 7426776 / -3.6% 48867955 / 47733676 / +2.4% 0.15 / 0.16 / -5.8%
clickbench_q20/datafusion:vortex-file-compressed 58933598 / 62563822 / -5.8% 225016186 / 226466979 / -0.6% 0.26 / 0.28 / -5.2%
clickbench_q21/datafusion:vortex-file-compressed 87870637 / 89215851 / -1.5% 267812819 / 275122753 / -2.7% 0.33 / 0.32 / +1.2%
clickbench_q22/datafusion:vortex-file-compressed 96664972 / 97949555 / -1.3% 339610091 / 338561147 / +0.3% 0.28 / 0.29 / -1.6%
clickbench_q23/datafusion:vortex-file-compressed 194491657 / 192782750 / +0.9% 402738087 / 473913831 / -15.0% 🟢 0.48 / 0.41 / +18.7%
clickbench_q24/datafusion:vortex-file-compressed 15138626 / 15152696 / -0.1% 65324569 / 64491179 / +1.3% 0.23 / 0.23 / -1.4%
clickbench_q25/datafusion:vortex-file-compressed 17715811 / 18038338 / -1.8% 56793248 / 59605881 / -4.7% 0.31 / 0.30 / +3.1%
clickbench_q26/datafusion:vortex-file-compressed 14971895 / 15214922 / -1.6% 64256122 / 64793721 / -0.8% 0.23 / 0.23 / -0.8%
clickbench_q27/datafusion:vortex-file-compressed 96110867 / 95142298 / +1.0% 240256393 / 239828952 / +0.2% 0.40 / 0.40 / +0.8%
clickbench_q28/datafusion:vortex-file-compressed 553661462 / 554109804 / -0.1% 624279062 / 618682889 / +0.9% 0.89 / 0.90 / -1.0%
clickbench_q29/datafusion:vortex-file-compressed 23130870 / 22919218 / +0.9% 50816597 / 49939679 / +1.8% 0.46 / 0.46 / -0.8%
clickbench_q30/datafusion:vortex-file-compressed 57404744 / 56385698 / +1.8% 106931025 / 107340507 / -0.4% 0.54 / 0.53 / +2.2%
clickbench_q31/datafusion:vortex-file-compressed 65588237 / 66572034 / -1.5% 151645371 / 152615047 / -0.6% 0.43 / 0.44 / -0.8%
clickbench_q32/datafusion:vortex-file-compressed 282242428 / 280748778 / +0.5% 381502252 / 383587235 / -0.5% 0.74 / 0.73 / +1.1%
clickbench_q33/datafusion:vortex-file-compressed 316870469 / 319009940 / -0.7% 428684568 / 425687885 / +0.7% 0.74 / 0.75 / -1.4%
clickbench_q34/datafusion:vortex-file-compressed 317510128 / 319589486 / -0.7% 431822746 / 439675191 / -1.8% 0.74 / 0.73 / +1.2%
clickbench_q35/datafusion:vortex-file-compressed 54077337 / 55501538 / -2.6% 84520359 / 87512229 / -3.4% 0.64 / 0.63 / +0.9%
clickbench_q36/datafusion:vortex-file-compressed 37384344 / 37178062 / +0.6% 65937866 / 65254963 / +1.0% 0.57 / 0.57 / -0.5%
clickbench_q37/datafusion:vortex-file-compressed 21804328 / 21830388 / -0.1% 47312477 / 47883502 / -1.2% 0.46 / 0.46 / +1.1%
clickbench_q38/datafusion:vortex-file-compressed 11706245 / 11387847 / +2.8% 39220244 / 39582466 / -0.9% 0.30 / 0.29 / +3.7%
clickbench_q39/datafusion:vortex-file-compressed 77345357 / 78414770 / -1.4% 108853237 / 109844437 / -0.9% 0.71 / 0.71 / -0.5%
clickbench_q40/datafusion:vortex-file-compressed 11148920 / 11021198 / +1.2% 36233135 / 37948872 / -4.5% 0.31 / 0.29 / +5.9%
clickbench_q41/datafusion:vortex-file-compressed 10606012 / 10629516 / -0.2% 35462432 / 35296888 / +0.5% 0.30 / 0.30 / -0.7%
clickbench_q42/datafusion:vortex-file-compressed 10670194 / 10769342 / -0.9% 35409901 / 36159716 / -2.1% 0.30 / 0.30 / +1.2%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1229223 / 1278446 / -3.9% 50174540 / 50367646 / -0.4% 0.02 / 0.03 / -3.5%
clickbench_q01/datafusion:parquet 15858300 / 15638294 / +1.4% 71319858 / 72021558 / -1.0% 0.22 / 0.22 / +2.4%
clickbench_q02/datafusion:parquet 18294565 / 18570496 / -1.5% 79990335 / 80729194 / -0.9% 0.23 / 0.23 / -0.6%
clickbench_q03/datafusion:parquet 16982205 / 16633708 / +2.1% 79795719 / 78585652 / +1.5% 0.21 / 0.21 / +0.5%
clickbench_q04/datafusion:parquet 62621243 / 62178540 / +0.7% 127421267 / 128932884 / -1.2% 0.49 / 0.48 / +1.9%
clickbench_q05/datafusion:parquet 88800599 / 87242511 / +1.8% 156906233 / 160080961 / -2.0% 0.57 / 0.54 / +3.8%
clickbench_q06/datafusion:parquet 1260096 / 1267656 / -0.6% 50885547 / 50661928 / +0.4% 0.02 / 0.03 / -1.0%
clickbench_q07/datafusion:parquet 16607534 / 16751974 / -0.9% 66516671 / 69676464 / -4.5% 0.25 / 0.24 / +3.8%
clickbench_q08/datafusion:parquet 85659162 / 86477425 / -0.9% 157259047 / 161289107 / -2.5% 0.54 / 0.54 / +1.6%
clickbench_q09/datafusion:parquet 188145928 / 187874939 / +0.1% 268635882 / 276106707 / -2.7% 0.70 / 0.68 / +2.9%
clickbench_q10/datafusion:parquet 36409117 / 36145609 / +0.7% 102711150 / 102318529 / +0.4% 0.35 / 0.35 / +0.3%
clickbench_q11/datafusion:parquet 42984763 / 42641455 / +0.8% 110870236 / 112380744 / -1.3% 0.39 / 0.38 / +2.2%
clickbench_q12/datafusion:parquet 95624349 / 96239916 / -0.6% 163460214 / 170227269 / -4.0% 0.59 / 0.57 / +3.5%
clickbench_q13/datafusion:parquet 149867312 / 149505066 / +0.2% 231487542 / 228298872 / +1.4% 0.65 / 0.65 / -1.1%
clickbench_q14/datafusion:parquet 101942698 / 102481892 / -0.5% 174344547 / 177342769 / -1.7% 0.58 / 0.58 / +1.2%
clickbench_q15/datafusion:parquet 72114454 / 72201290 / -0.1% 131150119 / 131350399 / -0.2% 0.55 / 0.55 / +0.0%
clickbench_q16/datafusion:parquet 156236095 / 156277466 / -0.0% 234220320 / 237306189 / -1.3% 0.67 / 0.66 / +1.3%
clickbench_q17/datafusion:parquet 156792386 / 156135178 / +0.4% 233726500 / 237587402 / -1.6% 0.67 / 0.66 / +2.1%
clickbench_q18/datafusion:parquet 308353031 / 308914885 / -0.2% 408588997 / 421389766 / -3.0% 0.75 / 0.73 / +2.9%
clickbench_q19/datafusion:parquet 18494310 / 18390138 / +0.6% 75248877 / 76532636 / -1.7% 0.25 / 0.24 / +2.3%
clickbench_q20/datafusion:parquet 175985953 / 179474111 / -1.9% 283038780 / 299760897 / -5.6% 0.62 / 0.60 / +3.8%
clickbench_q21/datafusion:parquet 172278158 / 175194641 / -1.7% 298630565 / 317886158 / -6.1% 0.58 / 0.55 / +4.7%
clickbench_q22/datafusion:parquet 261231532 / 262889431 / -0.6% 426735810 / 456091213 / -6.4% 0.61 / 0.58 / +6.2%
clickbench_q23/datafusion:parquet 1012307654 / 1008756454 / +0.4% 1197224736 / 1202891311 / -0.5% 0.85 / 0.84 / +0.8%
clickbench_q24/datafusion:parquet 29781650 / 29920270 / -0.5% 89176806 / 91883252 / -2.9% 0.33 / 0.33 / +2.6%
clickbench_q25/datafusion:parquet 36539890 / 38514290 / -5.1% 101918636 / 105586335 / -3.5% 0.36 / 0.36 / -1.7%
clickbench_q26/datafusion:parquet 29869628 / 30388694 / -1.7% 87866269 / 91161871 / -3.6% 0.34 / 0.33 / +2.0%
clickbench_q27/datafusion:parquet 192817096 / 193115801 / -0.2% 288719752 / 306852201 / -5.9% 0.67 / 0.63 / +6.1%
clickbench_q28/datafusion:parquet 617229498 / 617621464 / -0.1% 713178542 / 708948603 / +0.6% 0.87 / 0.87 / -0.7%
clickbench_q29/datafusion:parquet 29880808 / 28757429 / +3.9% 90532248 / 89948156 / +0.6% 0.33 / 0.32 / +3.2%
clickbench_q30/datafusion:parquet 89332925 / 89675864 / -0.4% 176966728 / 177046345 / -0.0% 0.50 / 0.51 / -0.3%
clickbench_q31/datafusion:parquet 102875818 / 104260654 / -1.3% 196492381 / 199351641 / -1.4% 0.52 / 0.52 / +0.1%
clickbench_q32/datafusion:parquet 309453863 / 309347774 / +0.0% 425724824 / 432472285 / -1.6% 0.73 / 0.72 / +1.6%
clickbench_q33/datafusion:parquet 374803724 / 380883966 / -1.6% 477638265 / 484132679 / -1.3% 0.78 / 0.79 / -0.3%
clickbench_q34/datafusion:parquet 377133961 / 379240288 / -0.6% 478919019 / 481301704 / -0.5% 0.79 / 0.79 / -0.1%
clickbench_q35/datafusion:parquet 63432416 / 63863621 / -0.7% 125521201 / 129418163 / -3.0% 0.51 / 0.49 / +2.4%
clickbench_q36/datafusion:parquet 73122389 / 73461886 / -0.5% 133802395 / 136630029 / -2.1% 0.55 / 0.54 / +1.6%
clickbench_q37/datafusion:parquet 35400316 / 35360474 / +0.1% 90319653 / 93261516 / -3.2% 0.39 / 0.38 / +3.4%
clickbench_q38/datafusion:parquet 46986636 / 47775680 / -1.7% 111237691 / 109300538 / +1.8% 0.42 / 0.44 / -3.4%
clickbench_q39/datafusion:parquet 143389404 / 144215040 / -0.6% 211604676 / 212076072 / -0.2% 0.68 / 0.68 / -0.4%
clickbench_q40/datafusion:parquet 19895939 / 19946303 / -0.3% 76388602 / 79065058 / -3.4% 0.26 / 0.25 / +3.2%
clickbench_q41/datafusion:parquet 18642010 / 18636714 / +0.0% 75719013 / 76995573 / -1.7% 0.25 / 0.24 / +1.7%
clickbench_q42/datafusion:parquet 19223706 / 19320620 / -0.5% 74664239 / 75840969 / -1.6% 0.26 / 0.25 / +1.1%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2458638 / 2407370 / +2.1% 25383460 / 25132463 / +1.0% 0.10 / 0.10 / +1.1%
clickbench_q01/duckdb:vortex-file-compressed 7638642 / 7492321 / +2.0% 31695763 / 30475404 / +4.0% 0.24 / 0.25 / -2.0%
clickbench_q02/duckdb:vortex-file-compressed 8157070 / 8057568 / +1.2% 36726640 / 38231044 / -3.9% 0.22 / 0.21 / +5.4%
clickbench_q03/duckdb:vortex-file-compressed 16072939 / 16328920 / -1.6% 63106592 / 60534611 / +4.2% 0.25 / 0.27 / -5.6%
clickbench_q04/duckdb:vortex-file-compressed 56957335 / 56722300 / +0.4% 102565011 / 101302886 / +1.2% 0.56 / 0.56 / -0.8%
clickbench_q05/duckdb:vortex-file-compressed 66574578 / 65875834 / +1.1% 95264155 / 97439846 / -2.2% 0.70 / 0.68 / +3.4%
clickbench_q06/duckdb:vortex-file-compressed 2765447 / 2790182 / -0.9% 29938324 / 30073644 / -0.4% 0.09 / 0.09 / -0.4%
clickbench_q07/duckdb:vortex-file-compressed 8669208 / 8942654 / -3.1% 31045195 / 32197569 / -3.6% 0.28 / 0.28 / +0.5%
clickbench_q08/duckdb:vortex-file-compressed 68826400 / 67377972 / +2.1% 112980426 / 114116890 / -1.0% 0.61 / 0.59 / +3.2%
clickbench_q09/duckdb:vortex-file-compressed 89465753 / 89875592 / -0.5% 136134268 / 138290965 / -1.6% 0.66 / 0.65 / +1.1%
clickbench_q10/duckdb:vortex-file-compressed 27387856 / 27601402 / -0.8% 73190324 / 70249815 / +4.2% 0.37 / 0.39 / -4.8%
clickbench_q11/duckdb:vortex-file-compressed 30195910 / 29908612 / +1.0% 77048406 / 78004021 / -1.2% 0.39 / 0.38 / +2.2%
clickbench_q12/duckdb:vortex-file-compressed 71898500 / 72683954 / -1.1% 101818199 / 102984993 / -1.1% 0.71 / 0.71 / +0.1%
clickbench_q13/duckdb:vortex-file-compressed 129923278 / 129840674 / +0.1% 170953952 / 170297284 / +0.4% 0.76 / 0.76 / -0.3%
clickbench_q14/duckdb:vortex-file-compressed 77233352 / 76971584 / +0.3% 106628201 / 106230847 / +0.4% 0.72 / 0.72 / -0.0%
clickbench_q15/duckdb:vortex-file-compressed 77422358 / 77119268 / +0.4% 118961247 / 119607263 / -0.5% 0.65 / 0.64 / +0.9%
clickbench_q16/duckdb:vortex-file-compressed 144731750 / 142548076 / +1.5% 180380311 / 188044957 / -4.1% 0.80 / 0.76 / +5.8%
clickbench_q17/duckdb:vortex-file-compressed 144220372 / 143511750 / +0.5% 181668160 / 182930057 / -0.7% 0.79 / 0.78 / +1.2%
clickbench_q18/duckdb:vortex-file-compressed 264668889 / 268464565 / -1.4% 327785206 / 323261005 / +1.4% 0.81 / 0.83 / -2.8%
clickbench_q19/duckdb:vortex-file-compressed 9388548 / 9348416 / +0.4% 44444802 / 44658047 / -0.5% 0.21 / 0.21 / +0.9%
clickbench_q20/duckdb:vortex-file-compressed 64892190 / 65973470 / -1.6% 175635580 / 176917485 / -0.7% 0.37 / 0.37 / -0.9%
clickbench_q21/duckdb:vortex-file-compressed 99127532 / 98167174 / +1.0% 278058426 / 285834352 / -2.7% 0.36 / 0.34 / +3.8%
clickbench_q22/duckdb:vortex-file-compressed 177182538 / 177872394 / -0.4% 444157489 / 450049805 / -1.3% 0.40 / 0.40 / +0.9%
clickbench_q23/duckdb:vortex-file-compressed 35223676 / 35508708 / -0.8% 91972319 / 91628951 / +0.4% 0.38 / 0.39 / -1.2%
clickbench_q24/duckdb:vortex-file-compressed 14636824 / 14264630 / +2.6% 40019413 / 40770297 / -1.8% 0.37 / 0.35 / +4.5%
clickbench_q25/duckdb:vortex-file-compressed 18831126 / 18987558 / -0.8% 54879419 / 54400101 / +0.9% 0.34 / 0.35 / -1.7%
clickbench_q26/duckdb:vortex-file-compressed 11523506 / 11679654 / -1.3% 38665916 / 38163190 / +1.3% 0.30 / 0.31 / -2.6%
clickbench_q27/duckdb:vortex-file-compressed 54353168 / 55682408 / -2.4% 224294580 / 230571885 / -2.7% 0.24 / 0.24 / +0.3%
clickbench_q28/duckdb:vortex-file-compressed 455751710 / 455314495 / +0.1% 525918672 / 529938269 / -0.8% 0.87 / 0.86 / +0.9%
clickbench_q29/duckdb:vortex-file-compressed 18245866 / 18184402 / +0.3% 48044724 / 47847900 / +0.4% 0.38 / 0.38 / -0.1%
clickbench_q30/duckdb:vortex-file-compressed 60338254 / 60645910 / -0.5% 112405753 / 114236892 / -1.6% 0.54 / 0.53 / +1.1%
clickbench_q31/duckdb:vortex-file-compressed 111571022 / 112370664 / -0.7% 178460277 / 203748287 / -12.4% 🟢 0.63 / 0.55 / +13.4%
clickbench_q32/duckdb:vortex-file-compressed 374759324 / 376222158 / -0.4% 411959482 / 426084820 / -3.3% 0.91 / 0.88 / +3.0%
clickbench_q33/duckdb:vortex-file-compressed 354130058 / 351008509 / +0.9% 453345108 / 455610605 / -0.5% 0.78 / 0.77 / +1.4%
clickbench_q34/duckdb:vortex-file-compressed 364384394 / 365181889 / -0.2% 468789424 / 471479069 / -0.6% 0.78 / 0.77 / +0.4%
clickbench_q35/duckdb:vortex-file-compressed 57845806 / 57191353 / +1.1% 95659321 / 92734296 / +3.2% 0.60 / 0.62 / -1.9%
clickbench_q36/duckdb:vortex-file-compressed 12471950 / 12443283 / +0.2% 34579077 / 34897446 / -0.9% 0.36 / 0.36 / +1.2%
clickbench_q37/duckdb:vortex-file-compressed 8660356 / 8635323 / +0.3% 30106511 / 30444751 / -1.1% 0.29 / 0.28 / +1.4%
clickbench_q38/duckdb:vortex-file-compressed 9659800 / 9345020 / +3.4% 31250851 / 31729626 / -1.5% 0.31 / 0.29 / +5.0%
clickbench_q39/duckdb:vortex-file-compressed 20740318 / 20543147 / +1.0% 43404152 / 42021683 / +3.3% 0.48 / 0.49 / -2.3%
clickbench_q40/duckdb:vortex-file-compressed 7686521 / 7527940 / +2.1% 28994119 / 29252815 / -0.9% 0.27 / 0.26 / +3.0%
clickbench_q41/duckdb:vortex-file-compressed 8331544 / 8346122 / -0.2% 30894217 / 30350558 / +1.8% 0.27 / 0.27 / -1.9%
clickbench_q42/duckdb:vortex-file-compressed 7415811 / 7533392 / -1.6% 30220937 / 31455951 / -3.9% 0.25 / 0.24 / +2.5%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 12722955 / 13426008 / -5.2% 19800008 / 19347414 / +2.3% 0.64 / 0.69 / -7.4%
clickbench_q01/duckdb:parquet 19116153 / 19316454 / -1.0% 25648449 / 25665748 / -0.1% 0.75 / 0.75 / -1.0%
clickbench_q02/duckdb:parquet 27469530 / 27190449 / +1.0% 37463671 / 39979552 / -6.3% 0.73 / 0.68 / +7.8%
clickbench_q03/duckdb:parquet 26452570 / 26915046 / -1.7% 37644583 / 39875149 / -5.6% 0.70 / 0.67 / +4.1%
clickbench_q04/duckdb:parquet 65031512 / 64787566 / +0.4% 84292924 / 78185926 / +7.8% 0.77 / 0.83 / -6.9%
clickbench_q05/duckdb:parquet 90063474 / 91424254 / -1.5% 105030217 / 107450199 / -2.3% 0.86 / 0.85 / +0.8%
clickbench_q06/duckdb:parquet 25332129 / 25465234 / -0.5% 34775114 / 32886848 / +5.7% 0.73 / 0.77 / -5.9%
clickbench_q07/duckdb:parquet 21282360 / 21720726 / -2.0% 28629442 / 28706869 / -0.3% 0.74 / 0.76 / -1.8%
clickbench_q08/duckdb:parquet 78668308 / 78871923 / -0.3% 94240671 / 92672970 / +1.7% 0.83 / 0.85 / -1.9%
clickbench_q09/duckdb:parquet 105437704 / 105190155 / +0.2% 125645118 / 120187422 / +4.5% 0.84 / 0.88 / -4.1%
clickbench_q10/duckdb:parquet 45833426 / 45055436 / +1.7% 60061344 / 61242201 / -1.9% 0.76 / 0.74 / +3.7%
clickbench_q11/duckdb:parquet 50527812 / 51410316 / -1.7% 66988228 / 69168751 / -3.2% 0.75 / 0.74 / +1.5%
clickbench_q12/duckdb:parquet 98793164 / 97803842 / +1.0% 118181619 / 115390197 / +2.4% 0.84 / 0.85 / -1.4%
clickbench_q13/duckdb:parquet 159103372 / 157940829 / +0.7% 182484283 / 182817866 / -0.2% 0.87 / 0.86 / +0.9%
clickbench_q14/duckdb:parquet 108309436 / 108915196 / -0.6% 131020035 / 127989036 / +2.4% 0.83 / 0.85 / -2.9%
clickbench_q15/duckdb:parquet 91809898 / 91634282 / +0.2% 105395035 / 104077376 / +1.3% 0.87 / 0.88 / -1.1%
clickbench_q16/duckdb:parquet 186555468 / 185260800 / +0.7% 196114389 / 193723934 / +1.2% 0.95 / 0.96 / -0.5%
clickbench_q17/duckdb:parquet 179211056 / 177238120 / +1.1% 199616142 / 191758783 / +4.1% 0.90 / 0.92 / -2.9%
clickbench_q18/duckdb:parquet 313595774 / 311149968 / +0.8% 340233073 / 338261345 / +0.6% 0.92 / 0.92 / +0.2%
clickbench_q19/duckdb:parquet 24093320 / 23751874 / +1.4% 32265863 / 31893224 / +1.2% 0.75 / 0.74 / +0.3%
clickbench_q20/duckdb:parquet 193563742 / 190078830 / +1.8% 245064678 / 243587179 / +0.6% 0.79 / 0.78 / +1.2%
clickbench_q21/duckdb:parquet 232662804 / 236455034 / -1.6% 282028349 / 275815343 / +2.3% 0.82 / 0.86 / -3.8%
clickbench_q22/duckdb:parquet 340986602 / 331072582 / +3.0% 375619839 / 378995909 / -0.9% 0.91 / 0.87 / +3.9%
clickbench_q23/duckdb:parquet 181633078 / 175808444 / +3.3% 227754394 / 245209982 / -7.1% 0.80 / 0.72 / +11.2%
clickbench_q24/duckdb:parquet 36355626 / 37418146 / -2.8% 44777092 / 43272008 / +3.5% 0.81 / 0.86 / -6.1%
clickbench_q25/duckdb:parquet 47835024 / 47980645 / -0.3% 64943299 / 68115503 / -4.7% 0.74 / 0.70 / +4.6%
clickbench_q26/duckdb:parquet 37639762 / 37394507 / +0.7% 46894600 / 55382039 / -15.3% 🟢 0.80 / 0.68 / +18.9%
clickbench_q27/duckdb:parquet 196290570 / 208129659 / -5.7% 238819573 / 241099958 / -0.9% 0.82 / 0.86 / -4.8%
clickbench_q28/duckdb:parquet 854491248 / 848095684 / +0.8% 845206988 / 841377187 / +0.5% 1.01 / 1.01 / +0.3%
clickbench_q29/duckdb:parquet 31519080 / 31190084 / +1.1% 38008460 / 40598113 / -6.4% 0.83 / 0.77 / +7.9%
clickbench_q30/duckdb:parquet 110982184 / 110483201 / +0.5% 141017892 / 139126910 / +1.4% 0.79 / 0.79 / -0.9%
clickbench_q31/duckdb:parquet 164281428 / 167539416 / -1.9% 183815261 / 186090483 / -1.2% 0.89 / 0.90 / -0.7%
clickbench_q32/duckdb:parquet 411281442 / 400311426 / +2.7% 417400492 / 425760781 / -2.0% 0.99 / 0.94 / +4.8%
clickbench_q33/duckdb:parquet 507607632 / 490377829 / +3.5% 486008554 / 469347796 / +3.5% 1.04 / 1.04 / -0.0%
clickbench_q34/duckdb:parquet 477579405 / 476517630 / +0.2% 477689121 / 470156851 / +1.6% 1.00 / 1.01 / -1.4%
clickbench_q35/duckdb:parquet 67428980 / 66454170 / +1.5% 83514678 / 83499060 / +0.0% 0.81 / 0.80 / +1.4%
clickbench_q36/duckdb:parquet 37091040 / 37195508 / -0.3% 44797119 / 46271386 / -3.2% 0.83 / 0.80 / +3.0%
clickbench_q37/duckdb:parquet 28179886 / 28503856 / -1.1% 36468868 / 37201197 / -2.0% 0.77 / 0.77 / +0.8%
clickbench_q38/duckdb:parquet 30398720 / 30401374 / -0.0% 39903891 / 38282767 / +4.2% 0.76 / 0.79 / -4.1%
clickbench_q39/duckdb:parquet 63341818 / 63057300 / +0.5% 71759742 / 70719520 / +1.5% 0.88 / 0.89 / -1.0%
clickbench_q40/duckdb:parquet 18204628 / 18528203 / -1.7% 26147209 / 26541765 / -1.5% 0.70 / 0.70 / -0.3%
clickbench_q41/duckdb:parquet 18248839 / 17808202 / +2.5% 27058083 / 25661283 / +5.4% 0.67 / 0.69 / -2.8%
clickbench_q42/duckdb:parquet 18656854 / 18378606 / +1.5% 27910132 / 26807322 / +4.1% 0.67 / 0.69 / -2.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR ba0ba3e7 vs base 86d28450
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.8%
Engines: DataFusion No clear signal (+11.1%, environment too noisy confidence) · DuckDB No clear signal (-6.8%, environment too noisy confidence)
Vortex (geomean): hot 1.112x ➖ · cold 1.095x ➖
Parquet (geomean): hot 1.093x ➖ · cold 1.126x ➖
Shifts: Parquet (control) +9.3% · Median polish +10.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.214x ➖, 0↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 248327822 / 229289188 / +8.3% 898385845 / 889500560 / +1.0% 0.28 / 0.26 / +7.2%
tpch_q02/datafusion:vortex-file-compressed 424523574 / 396853211 / +7.0% 712646328 / 728624363 / -2.2% 0.60 / 0.54 / +9.4%
tpch_q03/datafusion:vortex-file-compressed 454272794 / 358876241 / +26.6% 1313482304 / 971879568 / +35.1% 🔴 0.35 / 0.37 / -6.3%
tpch_q04/datafusion:vortex-file-compressed 222204595 / 240961942 / -7.8% 446917262 / 433865292 / +3.0% 0.50 / 0.56 / -10.5%
tpch_q05/datafusion:vortex-file-compressed 465508660 / 577801679 / -19.4% 830508660 / 645735619 / +28.6% 0.56 / 0.89 / -37.4%
tpch_q06/datafusion:vortex-file-compressed 383758552 / 272832221 / +40.7% 🔴 547058968 / 391591041 / +39.7% 🔴 0.70 / 0.70 / +0.7%
tpch_q07/datafusion:vortex-file-compressed 445826254 / 411993851 / +8.2% 722941252 / 533053584 / +35.6% 🔴 0.62 / 0.77 / -20.2%
tpch_q08/datafusion:vortex-file-compressed 499240868 / 498411755 / +0.2% 810434683 / 674308603 / +20.2% 0.62 / 0.74 / -16.7%
tpch_q09/datafusion:vortex-file-compressed 636416820 / 484122704 / +31.5% 🔴 824204324 / 585706004 / +40.7% 🔴 0.77 / 0.83 / -6.6%
tpch_q10/datafusion:vortex-file-compressed 504078923 / 388256512 / +29.8% 719041214 / 517264335 / +39.0% 🔴 0.70 / 0.75 / -6.6%
tpch_q11/datafusion:vortex-file-compressed 338917405 / 293935643 / +15.3% 546396279 / 398210614 / +37.2% 🔴 0.62 / 0.74 / -16.0%
tpch_q12/datafusion:vortex-file-compressed 387614943 / 381118814 / +1.7% 651485247 / 561125194 / +16.1% 0.59 / 0.68 / -12.4%
tpch_q13/datafusion:vortex-file-compressed 206882640 / 147445591 / +40.3% 🔴 387308935 / 450138181 / -14.0% 0.53 / 0.33 / +63.1%
tpch_q14/datafusion:vortex-file-compressed 322936053 / 190240521 / +69.8% 🔴 432662522 / 351372885 / +23.1% 0.75 / 0.54 / +37.9%
tpch_q15/datafusion:vortex-file-compressed 379232294 / 353228111 / +7.4% 605060517 / 553781146 / +9.3% 0.63 / 0.64 / -1.7%
tpch_q16/datafusion:vortex-file-compressed 145675122 / 136111389 / +7.0% 302385255 / 288872661 / +4.7% 0.48 / 0.47 / +2.2%
tpch_q17/datafusion:vortex-file-compressed 373974203 / 342611397 / +9.2% 673777134 / 491384587 / +37.1% 🔴 0.56 / 0.70 / -20.4%
tpch_q18/datafusion:vortex-file-compressed 631361811 / 322317661 / +95.9% 🔴 606306754 / 484380641 / +25.2% 1.04 / 0.67 / +56.5%
tpch_q19/datafusion:vortex-file-compressed 448293073 / 368563176 / +21.6% 608839992 / 507122440 / +20.1% 0.74 / 0.73 / +1.3%
tpch_q20/datafusion:vortex-file-compressed 378298850 / 322992883 / +17.1% 654020977 / 494808570 / +32.2% 🔴 0.58 / 0.65 / -11.4%
tpch_q21/datafusion:vortex-file-compressed 1070527303 / 489628113 / +118.6% 🔴 1282174602 / 628026743 / +104.2% 🔴 0.83 / 0.78 / +7.1%
tpch_q22/datafusion:vortex-file-compressed 187648544 / 160837178 / +16.7% 413488388 / 364869747 / +13.3% 0.45 / 0.44 / +3.0%
datafusion / parquet / ns (1.092x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 165477361 / 170609578 / -3.0% 590139476 / 509941777 / +15.7% 0.28 / 0.33 / -16.2%
tpch_q02/datafusion:parquet 332477401 / 369173435 / -9.9% 581526542 / 642300318 / -9.5% 0.57 / 0.57 / -0.5%
tpch_q03/datafusion:parquet 281963292 / 250909194 / +12.4% 847064343 / 720222925 / +17.6% 0.33 / 0.35 / -4.5%
tpch_q04/datafusion:parquet 225288162 / 208747262 / +7.9% 409303358 / 438656446 / -6.7% 0.55 / 0.48 / +15.7%
tpch_q05/datafusion:parquet 408426835 / 356315389 / +14.6% 537484077 / 464853868 / +15.6% 0.76 / 0.77 / -0.9%
tpch_q06/datafusion:parquet 149843120 / 194652541 / -23.0% 238241700 / 325131706 / -26.7% 0.63 / 0.60 / +5.1%
tpch_q07/datafusion:parquet 428686005 / 376980473 / +13.7% 817752546 / 532786676 / +53.5% 🔴 0.52 / 0.71 / -25.9%
tpch_q08/datafusion:parquet 486259639 / 462493231 / +5.1% 655432273 / 518412052 / +26.4% 0.74 / 0.89 / -16.8%
tpch_q09/datafusion:parquet 434738295 / 429757248 / +1.2% 557406206 / 725293464 / -23.1% 0.78 / 0.59 / +31.6%
tpch_q10/datafusion:parquet 347218846 / 328188336 / +5.8% 569096375 / 456690300 / +24.6% 0.61 / 0.72 / -15.1%
tpch_q11/datafusion:parquet 299104440 / 256757797 / +16.5% 395810024 / 367216333 / +7.8% 0.76 / 0.70 / +8.1%
tpch_q12/datafusion:parquet 213380803 / 181528402 / +17.5% 463376892 / 402857212 / +15.0% 0.46 / 0.45 / +2.2%
tpch_q13/datafusion:parquet 376761415 / 370164150 / +1.8% 546503886 / 482455760 / +13.3% 0.69 / 0.77 / -10.1%
tpch_q14/datafusion:parquet 180112628 / 148164852 / +21.6% 467793098 / 253501907 / +84.5% 🔴 0.39 / 0.58 / -34.1%
tpch_q15/datafusion:parquet 380364103 / 339586127 / +12.0% 549112379 / 504036139 / +8.9% 0.69 / 0.67 / +2.8%
tpch_q16/datafusion:parquet 124510047 / 104557700 / +19.1% 267177668 / 196406107 / +36.0% 🔴 0.47 / 0.53 / -12.5%
tpch_q17/datafusion:parquet 350320263 / 278307727 / +25.9% 471456156 / 421288313 / +11.9% 0.74 / 0.66 / +12.5%
tpch_q18/datafusion:parquet 467738308 / 370720806 / +26.2% 838399888 / 556627855 / +50.6% 🔴 0.56 / 0.67 / -16.2%
tpch_q19/datafusion:parquet 200853117 / 170006136 / +18.1% 412851859 / 303433460 / +36.1% 🔴 0.49 / 0.56 / -13.2%
tpch_q20/datafusion:parquet 284320632 / 281855287 / +0.9% 435357486 / 346346895 / +25.7% 0.65 / 0.81 / -19.7%
tpch_q21/datafusion:parquet 418253383 / 354643848 / +17.9% 582436465 / 479808548 / +21.4% 0.72 / 0.74 / -2.8%
tpch_q22/datafusion:parquet 195138370 / 168638354 / +15.7% 365927936 / 356306752 / +2.7% 0.53 / 0.47 / +12.7%
duckdb / vortex-file-compressed / ns (1.019x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 207017774 / 198256707 / +4.4% 254388382 / 316333376 / -19.6% 0.81 / 0.63 / +29.8%
tpch_q02/duckdb:vortex-file-compressed 235982604 / 228577667 / +3.2% 224554094 / 254795563 / -11.9% 1.05 / 0.90 / +17.1%
tpch_q03/duckdb:vortex-file-compressed 467364867 / 502657914 / -7.0% 494046442 / 527943427 / -6.4% 0.95 / 0.95 / -0.6%
tpch_q04/duckdb:vortex-file-compressed 242437620 / 325860909 / -25.6% 451279093 / 266827796 / +69.1% 🔴 0.54 / 1.22 / -56.0%
tpch_q05/duckdb:vortex-file-compressed 409645514 / 391736883 / +4.6% 538516514 / 484468133 / +11.2% 0.76 / 0.81 / -5.9%
tpch_q06/duckdb:vortex-file-compressed 320620559 / 300788624 / +6.6% 309128015 / 300026123 / +3.0% 1.04 / 1.00 / +3.5%
tpch_q07/duckdb:vortex-file-compressed 313350007 / 310010961 / +1.1% 387330572 / 325014422 / +19.2% 0.81 / 0.95 / -15.2%
tpch_q08/duckdb:vortex-file-compressed 527932519 / 458002924 / +15.3% 531609533 / 516967942 / +2.8% 0.99 / 0.89 / +12.1%
tpch_q09/duckdb:vortex-file-compressed 426143264 / 369422991 / +15.4% 383431888 / 819480539 / -53.2% 🟢 1.11 / 0.45 / +146.5%
tpch_q10/duckdb:vortex-file-compressed 476721183 / 409368956 / +16.5% 551870738 / 573775695 / -3.8% 0.86 / 0.71 / +21.1%
tpch_q11/duckdb:vortex-file-compressed 217364841 / 172808157 / +25.8% 295932840 / 238785072 / +23.9% 0.73 / 0.72 / +1.5%
tpch_q12/duckdb:vortex-file-compressed 423820038 / 480487619 / -11.8% 585581233 / 780808561 / -25.0% 0.72 / 0.62 / +17.6%
tpch_q13/duckdb:vortex-file-compressed 168460122 / 148915362 / +13.1% 193194945 / 180010430 / +7.3% 0.87 / 0.83 / +5.4%
tpch_q14/duckdb:vortex-file-compressed 184072762 / 173706470 / +6.0% 279135374 / 234911443 / +18.8% 0.66 / 0.74 / -10.8%
tpch_q15/duckdb:vortex-file-compressed 191584576 / 179603891 / +6.7% 269377806 / 250785007 / +7.4% 0.71 / 0.72 / -0.7%
tpch_q16/duckdb:vortex-file-compressed 135436604 / 137723941 / -1.7% 186223629 / 235635727 / -21.0% 0.73 / 0.58 / +24.4%
tpch_q17/duckdb:vortex-file-compressed 311625285 / 325893435 / -4.4% 438262552 / 301887474 / +45.2% 🔴 0.71 / 1.08 / -34.1%
tpch_q18/duckdb:vortex-file-compressed 280709668 / 275689476 / +1.8% 333134612 / 308764570 / +7.9% 0.84 / 0.89 / -5.6%
tpch_q19/duckdb:vortex-file-compressed 423466283 / 361572928 / +17.1% 457626496 / 461797596 / -0.9% 0.93 / 0.78 / +18.2%
tpch_q20/duckdb:vortex-file-compressed 369252345 / 371243917 / -0.5% 537699076 / 665197037 / -19.2% 0.69 / 0.56 / +23.0%
tpch_q21/duckdb:vortex-file-compressed 633205452 / 517191781 / +22.4% 601129194 / 580826325 / +3.5% 1.05 / 0.89 / +18.3%
tpch_q22/duckdb:vortex-file-compressed 177905237 / 295255667 / -39.7% 🟢 230811400 / 385179048 / -40.1% 🟢 0.77 / 0.77 / +0.6%
duckdb / parquet / ns (1.093x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 185937644 / 205533124 / -9.5% 251934623 / 270188864 / -6.8% 0.74 / 0.76 / -3.0%
tpch_q02/duckdb:parquet 383545301 / 342566927 / +12.0% 413475322 / 382192393 / +8.2% 0.93 / 0.90 / +3.5%
tpch_q03/duckdb:parquet 667011260 / 414933262 / +60.8% 🔴 713822025 / 472165687 / +51.2% 🔴 0.93 / 0.88 / +6.3%
tpch_q04/duckdb:parquet 321649798 / 338472552 / -5.0% 424359623 / 446903202 / -5.0% 0.76 / 0.76 / +0.1%
tpch_q05/duckdb:parquet 605271318 / 481090197 / +25.8% 759703941 / 599298434 / +26.8% 0.80 / 0.80 / -0.8%
tpch_q06/duckdb:parquet 135763339 / 161321926 / -15.8% 186895889 / 203188358 / -8.0% 0.73 / 0.79 / -8.5%
tpch_q07/duckdb:parquet 457488935 / 491347411 / -6.9% 550624113 / 630711649 / -12.7% 0.83 / 0.78 / +6.7%
tpch_q08/duckdb:parquet 657195160 / 619559458 / +6.1% 720230679 / 634504991 / +13.5% 0.91 / 0.98 / -6.6%
tpch_q09/duckdb:parquet 574585437 / 551206603 / +4.2% 592938294 / 641340035 / -7.5% 0.97 / 0.86 / +12.8%
tpch_q10/duckdb:parquet 687847188 / 535807167 / +28.4% 677480971 / 580069841 / +16.8% 1.02 / 0.92 / +9.9%
tpch_q11/duckdb:parquet 288445229 / 250377879 / +15.2% 293816255 / 249025265 / +18.0% 0.98 / 1.01 / -2.4%
tpch_q12/duckdb:parquet 248425127 / 241373543 / +2.9% 388805802 / 357783251 / +8.7% 0.64 / 0.67 / -5.3%
tpch_q13/duckdb:parquet 490003019 / 440725564 / +11.2% 671618808 / 493557699 / +36.1% 🔴 0.73 / 0.89 / -18.3%
tpch_q14/duckdb:parquet 283430407 / 271404494 / +4.4% 320540841 / 306259955 / +4.7% 0.88 / 0.89 / -0.2%
tpch_q15/duckdb:parquet 200321363 / 184348752 / +8.7% 293717022 / 246434691 / +19.2% 0.68 / 0.75 / -8.8%
tpch_q16/duckdb:parquet 236083751 / 275488041 / -14.3% 249523848 / 322706734 / -22.7% 0.95 / 0.85 / +10.8%
tpch_q17/duckdb:parquet 312813896 / 299017714 / +4.6% 336248525 / 308963730 / +8.8% 0.93 / 0.97 / -3.9%
tpch_q18/duckdb:parquet 374840465 / 343993931 / +9.0% 423407597 / 384025760 / +10.3% 0.89 / 0.90 / -1.2%
tpch_q19/duckdb:parquet 295038059 / 245021947 / +20.4% 458950728 / 362914584 / +26.5% 0.64 / 0.68 / -4.8%
tpch_q20/duckdb:parquet 526855950 / 428775213 / +22.9% 568075171 / 528532095 / +7.5% 0.93 / 0.81 / +14.3%
tpch_q21/duckdb:parquet 635402697 / 462641027 / +37.3% 🔴 678608935 / 528142766 / +28.5% 0.94 / 0.88 / +6.9%
tpch_q22/duckdb:parquet 309090675 / 279245782 / +10.7% 383075747 / 333155336 / +15.0% 0.81 / 0.84 / -3.7%

@robert3005
robert3005 force-pushed the rk/split-array-12-remove-array-session branch from ba0ba3e to 523fe18 Compare October 23, 2026 11:19
`vortex_array::array_session()` was a shared constructor that every test,
bench and doc example called, whatever it needed from the session. Callers now
build the session they need: `VortexSession::empty()` creates vortex-array's
session variables on first use, and callers register anything else
themselves.

Tests share their module's session through a `static SESSION: LazyLock<_>`
built with the setup those tests need. Tests that change their session after
setting it up, need a different setup, or create a `RuntimeSession` (which
holds the runtime current at creation) keep a local session.

Benches build their session the same way, in a `static SESSION` that registers
vortex-array's session variables explicitly, and force it in `main` before the
harness starts, so no benchmark iteration pays for session setup.

Signed-off-by: Claude <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Ps4mp7KF5c4p66aoSoXx5j
…roundtrip

The test was added with the three-argument signature after try_new gained an
ExecutionCtx parameter, so vortex-file's tests do not compile on develop.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Ps4mp7KF5c4p66aoSoXx5j
Signed-off-by: Claude <noreply@anthropic.com>
@robert3005
robert3005 force-pushed the rk/split-array-12-remove-array-session branch from 523fe18 to 1860149 Compare October 23, 2026 14:45

static SESSION: LazyLock<VortexSession> = LazyLock::new(|| {
let session = vortex_array::array_session();
let session = VortexSession::empty()

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

instead of explicitly writing the for every benchmark in fastlanes... can we just have a helper?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

or just do vortex_array::initialize(session)?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the whole point is that after the split vortex_array::initialize is not enough and I would like to have targeted instantiations for given tests

@connortsui20 connortsui20 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yolo

@robert3005
robert3005 merged commit d834a11 into develop Oct 23, 2026
109 of 111 checks passed
@robert3005
robert3005 deleted the rk/split-array-12-remove-array-session branch October 23, 2026 16:04
connortsui20 added a commit that referenced this pull request Oct 23, 2026
#10223, #10332 and #10333 closed on 2026-10-23, and new PRs replace
them. Note that the local rewrite needs a rebase over #10681 and new
branch names.

Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants