Skip to content

Speed up PolarSignals scans: spread filtered V2 splits and export primitive dictionaries natively - #10761

Draft
joseph-isaacs wants to merge 7 commits into
developfrom
ji/jolly-shannon-f0erx1
Draft

joseph-isaacs wants to merge 7 commits into
developfrom
ji/jolly-shannon-f0erx1

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Summary

On PolarSignals with DataFusion, scan V2 from #10706 was 1.79x slower than V1 (geomean). This PR fixes that. It also speeds up both V1 and V2 by making the Arrow dictionary export cheaper; that export was ~90% of scan CPU on these queries for both scans. V2 and V1 now perform about the same on PolarSignals.

CI action/bench-sql on a47ec03 against develop (CI's PolarSignals job runs V1):

Suite Vortex hot geomean Notes
PolarSignals 0.564x q00 −80%, q01 −71%, q02 −74%, q03 −65%, q08 −38%; no regressions
TPC-H SF1 / SF10 / S3 1.004x / 0.996x / 0.988x no clear signal
TPC-DS SF1 0.999x no clear signal
ClickBench, FineWeb 0.992x, 0.992x no clear signal

Local runs at SF1 on 4 cores, median of 3 rounds × 5 iterations, sides alternated:

PolarSignals V1 before V2 before V1 after V2 after
q01 1067 ms 2927 ms 107 ms 108 ms
total 4.44 s 10.62 s 1.40 s 1.39 s

Changes

  • Filtered V2 splits (vortex-layout). Filtered scans used fixed ~1M-row chunks. A DataFusion byte-range partition of a ~1M-row file was therefore one chunk, so when the selected rows sat in one partition, a single thread did all the work. Chunks are now sized two ways:

    • by the serialized bytes the projection reads per row, cached per projection in ScanCache;
    • by the partition's rows per thread.

    Cheap projections over large ranges keep the 1M-row chunks.

  • No re-concatenation (vortex-layout). ProjectionMorsel emitted its pieces as one ChunkedArray, which the Arrow export then concatenated, re-merging nested dictionaries. Pieces are now separate batches; only pieces under 4,096 rows are grouped.

  • Primitive dictionary export (vortex-arrow). This replaces arrow_cast, which hashed each value with SipHash and built an ArrowError per value. The export now uses, in order of preference:

    • a dense table for keys spanning fewer than 65,536 values;
    • the values themselves with sequential codes, when a sample shows nearly every value is distinct (Arrow dictionaries may contain duplicates);
    • an FxHash map sized from the sample.

    The full min/max scan runs only when the sample's range could fit the dense table. Nulls stay in the codes. Other types, and codes that would overflow, fall back to arrow_cast.

  • Bit-packed arrays exported as dictionaries (vortex-arrow, vortex-fastlanes). A bit-packed array without patches holds only values in 0..2^bit_width, so the unpacked values serve directly as codes into that range. This applies up to 16-bit widths. BitPacked's CastKernel now also handles narrowing integer casts when there are no patches and the target type holds every value the bit width allows.

Tests cover nulls, float bit-equality, a full UInt8 code space, the overflow fallback, the all-distinct path, bit-packed export, and narrowing bit-packed casts.

The CodSpeed micro-benchmarks it flags don't run the code this PR changes; see the comment below.

🤖 Generated with Claude Code

https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC

…tion pieces

Filtered V2 scans used fixed 1,048,576-row chunks. A DataFusion byte-range
partition of a ~1M-row file then became a single chunk, so when the surviving
rows sat in one partition (PolarSignals time ranges) one thread did all the
work. Size filtered chunks by the serialized bytes the projection reads per row
and by the partition's rows per thread, keeping 1M-row chunks for cheap
projections over large ranges.

ProjectionMorsel also wrapped its pieces in a ChunkedArray, which the Arrow
export concatenated, re-merging nested dictionaries. Emit pieces as separate
batches, grouping only pieces under 4,096 rows.

PolarSignals SF1 on DataFusion, V2 vs V1 geomean: 1.79x -> 0.93x.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC
Signed-off-by: Claude <noreply@anthropic.com>
Exporting a non-dictionary Vortex array to an Arrow dictionary type went through
arrow_cast, which hashes each primitive value with SipHash and builds an
ArrowError per value. PolarSignals requests its nested `locations` fields as
dictionaries, so this was ~90% of scan CPU for both V1 and V2. Encode primitive
values directly, hashing their bits with FxHash and keeping nulls in the codes,
and fall back to arrow_cast for other types or when the codes overflow.

PolarSignals SF1 on DataFusion (V2): q00-q03 ~3.6x faster, total 4.28s -> 1.90s.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC
Signed-off-by: Claude <noreply@anthropic.com>
…ictionaries

Hash-map growth and hashing still dominated exporting PolarSignals' nested
dictionary fields. Keys spanning under 65,536 values (line numbers) are now
looked up in a dense table. When a sample of the values is nearly all distinct
(addresses), the values become the dictionary with sequential codes, reusing
their buffer, since Arrow dictionaries may hold duplicates. Other inputs hash
into a map sized from the sample.

PolarSignals SF1 on DataFusion (V2): q00-q03 another 22-31% faster.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC
Signed-off-by: Claude <noreply@anthropic.com>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Oct 23, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 23, 2026
@codspeed

codspeed Bot commented Oct 23, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 13.13%

4 warnings, 1 note

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ Unable to measure the execution of 1 benchmark

This benchmark measured no execution time, so its result is not comparable and counts as unchanged. This usually happens when the compiler removes the code under test.

Prevent compiler optimizations

See affected benchmarks

⚠️ 22 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ Base and head ran on different runner types

Some benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.

Learn more about Macro Runners

Open the report in CodSpeed to investigate

ℹ️ 40 benchmarks have no flamegraph

The flamegraph wasn't generated: the symbols of the profiling trace could not be resolved, because no information about the language frames was collected.

See affected benchmarks

⚡ 2 improved benchmarks
❌ 7 regressed benchmarks
✅ 2399 untouched benchmarks
⏩ 12 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Walltime filter_neon[8] 893 ns 1,417 ns -36.98%
❌ CPU Simulation chunked_dict_primitive_canonical_into[f64, (1000, 1000, 10)] 151.9 µs 205.4 µs -26.05%
❌ Walltime filter_neon[64] 1.7 µs 2.2 µs -22.97%
❌ Walltime filter_neon[80] 2.6 µs 3.2 µs -17.9%
❌ Walltime threshold_neon[80] 3.5 µs 4.1 µs -14.96%
❌ CPU Simulation test_repeated_scan_scalar_at[int_float] 371.1 µs 430.8 µs -13.86%
❌ Walltime words_gather_dispatch_avx512[65536] 886 ns 989 ns -10.41%
⚡ CPU Simulation test_repeated_scan_scalar_at[int] 318.8 µs 247.8 µs +28.68%
⚡ Walltime bitpack_blocked_compress_avx2 7.6 µs 6.7 µs +13.22%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/jolly-shannon-f0erx1 (a47ec03) with develop (91b38f4)

Open in CodSpeed

Footnotes

  1. 12 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@github-actions

github-actions Bot commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done a47ec03 clickbench-nvme 1 Explore Profiling Data
🟢 Done a47ec03 polarsignals 1 Explore Profiling Data
🟢 Done a47ec03 tpch-nvme-10 1 Explore Profiling Data
🟢 Done a47ec03 fineweb 1 Explore Profiling Data
🟢 Done a47ec03 tpch-nvme 1 Explore Profiling Data
🟢 Done a47ec03 tpch-s3 1 Explore Profiling Data
🟢 Done a47ec03 tpcds-nvme 1 Explore Profiling Data
Previous Runs (7)
Status Commit Job Attempt Link
🟢 Done e71f137 clickbench-nvme 1 Explore Profiling Data
🟢 Done e71f137 polarsignals 1 Explore Profiling Data
🟢 Done e71f137 tpch-nvme-10 1 Explore Profiling Data
🟢 Done e71f137 fineweb 1 Explore Profiling Data
🟢 Done e71f137 tpch-s3 1 Explore Profiling Data
🟢 Done e71f137 tpcds-nvme 1 Explore Profiling Data
🟢 Done e71f137 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR a47ec03e vs base 91b38f41
Vortex (geomean): hot 0.564x ✅ · cold 0.676x ✅


datafusion / vortex-file-compressed / ns (0.564x ✅, 5↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 8939062 / 44646204 / -80.0% 🟢 47762134 / 95821524 / -50.2% 🟢 0.19 / 0.47 / -59.8%
polarsignals_q01/datafusion:vortex-file-compressed 14804804 / 50699582 / -70.8% 🟢 65740887 / 124317433 / -47.1% 🟢 0.23 / 0.41 / -44.8%
polarsignals_q02/datafusion:vortex-file-compressed 11203297 / 43450589 / -74.2% 🟢 46322378 / 98609869 / -53.0% 🟢 0.24 / 0.44 / -45.1%
polarsignals_q03/datafusion:vortex-file-compressed 19380992 / 54938175 / -64.7% 🟢 64197456 / 123543830 / -48.0% 🟢 0.30 / 0.44 / -32.1%
polarsignals_q04/datafusion:vortex-file-compressed 9169086 / 9409490 / -2.6% 41402862 / 55649694 / -25.6% 🟢 0.22 / 0.17 / +31.0%
polarsignals_q05/datafusion:vortex-file-compressed 12101858 / 11489751 / +5.3% 46272158 / 59060675 / -21.7% 🟢 0.26 / 0.19 / +34.4%
polarsignals_q06/datafusion:vortex-file-compressed 23220785 / 23306920 / -0.4% 65380035 / 70498975 / -7.3% 0.36 / 0.33 / +7.4%
polarsignals_q07/datafusion:vortex-file-compressed 11078770 / 11165574 / -0.8% 52981624 / 59001119 / -10.2% 🟢 0.21 / 0.19 / +10.5%
polarsignals_q08/datafusion:vortex-file-compressed 60617094 / 97584026 / -37.9% 🟢 124261980 / 169982818 / -26.9% 🟢 0.49 / 0.57 / -15.0%
polarsignals_q09/datafusion:vortex-file-compressed 9916318 / 10123393 / -2.0% 48552688 / 55941657 / -13.2% 🟢 0.20 / 0.18 / +12.9%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR a47ec03e vs base 91b38f41
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-2.7%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.933x ➖
Parquet (geomean): hot 1.003x ➖ · cold 0.982x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.971x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6977018 / 6951709 / +0.4% 18237622 / 20652200 / -11.7% 🟢 0.38 / 0.34 / +13.7%
fineweb_q01/datafusion:vortex-file-compressed 9096889 / 8302029 / +9.6% 41107720 / 50240109 / -18.2% 🟢 0.22 / 0.17 / +33.9%
fineweb_q02/datafusion:vortex-file-compressed 9992530 / 9572970 / +4.4% 46343206 / 52378634 / -11.5% 🟢 0.22 / 0.18 / +18.0%
fineweb_q03/datafusion:vortex-file-compressed 19587669 / 20938096 / -6.4% 112004551 / 119278677 / -6.1% 0.17 / 0.18 / -0.4%
fineweb_q04/datafusion:vortex-file-compressed 66351518 / 66766084 / -0.6% 159014024 / 152090721 / +4.6% 0.42 / 0.44 / -4.9%
fineweb_q05/datafusion:vortex-file-compressed 66947650 / 66877409 / +0.1% 145275018 / 150275320 / -3.3% 0.46 / 0.45 / +3.6%
fineweb_q06/datafusion:vortex-file-compressed 19164555 / 19493638 / -1.7% 112977258 / 122978980 / -8.1% 0.17 / 0.16 / +7.0%
fineweb_q07/datafusion:vortex-file-compressed 17738086 / 18604721 / -4.7% 106221829 / 115393498 / -7.9% 0.17 / 0.16 / +3.6%
fineweb_q08/datafusion:vortex-file-compressed 8512455 / 11057914 / -23.0% 🟢 45047388 / 42950958 / +4.9% 0.19 / 0.26 / -26.6%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9462418 / 9455568 / +0.1% 32967423 / 32894130 / +0.2% 0.29 / 0.29 / -0.2%
fineweb_q01/datafusion:parquet 75296888 / 74452629 / +1.1% 154900750 / 165729676 / -6.5% 0.49 / 0.45 / +8.2%
fineweb_q02/datafusion:parquet 74654784 / 75776147 / -1.5% 162269515 / 167522751 / -3.1% 0.46 / 0.45 / +1.7%
fineweb_q03/datafusion:parquet 73765236 / 74476488 / -1.0% 162720233 / 161917653 / +0.5% 0.45 / 0.46 / -1.4%
fineweb_q04/datafusion:parquet 81071495 / 82012850 / -1.1% 154919799 / 161412774 / -4.0% 0.52 / 0.51 / +3.0%
fineweb_q05/datafusion:parquet 81396920 / 80227500 / +1.5% 157299487 / 164737059 / -4.5% 0.52 / 0.49 / +6.3%
fineweb_q06/datafusion:parquet 75412692 / 75790213 / -0.5% 156108411 / 169116940 / -7.7% 0.48 / 0.45 / +7.8%
fineweb_q07/datafusion:parquet 73992618 / 73702463 / +0.4% 158432646 / 157060670 / +0.9% 0.47 / 0.47 / -0.5%
fineweb_q08/datafusion:parquet 73783887 / 74263089 / -0.6% 152452327 / 158215167 / -3.6% 0.48 / 0.47 / +3.1%
duckdb / vortex-file-compressed / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 1998193 / 2063572 / -3.2% 6960111 / 7930115 / -12.2% 🟢 0.29 / 0.26 / +10.3%
fineweb_q01/duckdb:vortex-file-compressed 9293268 / 9418252 / -1.3% 36901378 / 38332551 / -3.7% 0.25 / 0.25 / +2.5%
fineweb_q02/duckdb:vortex-file-compressed 10989152 / 10602348 / +3.6% 37286804 / 38176661 / -2.3% 0.29 / 0.28 / +6.1%
fineweb_q03/duckdb:vortex-file-compressed 18907145 / 18876969 / +0.2% 100306473 / 112412876 / -10.8% 🟢 0.19 / 0.17 / +12.2%
fineweb_q04/duckdb:vortex-file-compressed 66841594 / 67667180 / -1.2% 114811067 / 122972639 / -6.6% 0.58 / 0.55 / +5.8%
fineweb_q05/duckdb:vortex-file-compressed 67469057 / 66211124 / +1.9% 109274489 / 115145163 / -5.1% 0.62 / 0.58 / +7.4%
fineweb_q06/duckdb:vortex-file-compressed 19202527 / 19244098 / -0.2% 104241848 / 110087598 / -5.3% 0.18 / 0.17 / +5.4%
fineweb_q07/duckdb:vortex-file-compressed 19570722 / 18161364 / +7.8% 95352178 / 110527274 / -13.7% 🟢 0.21 / 0.16 / +24.9%
fineweb_q08/duckdb:vortex-file-compressed 5610150 / 5384656 / +4.2% 13527790 / 13632605 / -0.8% 0.41 / 0.39 / +5.0%
duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24216781 / 23930970 / +1.2% 28717030 / 28333435 / +1.4% 0.84 / 0.84 / -0.2%
fineweb_q01/duckdb:parquet 55497724 / 56883585 / -2.4% 79106609 / 79466688 / -0.5% 0.70 / 0.72 / -2.0%
fineweb_q02/duckdb:parquet 62350876 / 59839240 / +4.2% 84032399 / 83002270 / +1.2% 0.74 / 0.72 / +2.9%
fineweb_q03/duckdb:parquet 119820494 / 119451768 / +0.3% 182567309 / 180808086 / +1.0% 0.66 / 0.66 / -0.7%
fineweb_q04/duckdb:parquet 164049201 / 164446966 / -0.2% 211673233 / 214353186 / -1.3% 0.78 / 0.77 / +1.0%
fineweb_q05/duckdb:parquet 159605503 / 157859342 / +1.1% 209302824 / 205031956 / +2.1% 0.76 / 0.77 / -1.0%
fineweb_q06/duckdb:parquet 90749808 / 87914567 / +3.2% 157034626 / 152609489 / +2.9% 0.58 / 0.58 / +0.3%
fineweb_q07/duckdb:parquet 90702711 / 90687684 / +0.0% 152037361 / 154624220 / -1.7% 0.60 / 0.59 / +1.7%
fineweb_q08/duckdb:parquet 29811367 / 29884269 / -0.2% 30958890 / 33903246 / -8.7% 0.96 / 0.88 / +9.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR a47ec03e vs base 91b38f41
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+1.7%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 0.984x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.992x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16465871 / 15738519 / +4.6% 43809660 / 48106480 / -8.9% 0.38 / 0.33 / +14.9%
tpch_q02/datafusion:vortex-file-compressed 16516739 / 17154319 / -3.7% 34764474 / 37970577 / -8.4% 0.48 / 0.45 / +5.2%
tpch_q03/datafusion:vortex-file-compressed 21021637 / 20590850 / +2.1% 49533552 / 51838444 / -4.4% 0.42 / 0.40 / +6.8%
tpch_q04/datafusion:vortex-file-compressed 12000176 / 11223533 / +6.9% 35219036 / 37475268 / -6.0% 0.34 / 0.30 / +13.8%
tpch_q05/datafusion:vortex-file-compressed 37683616 / 37637719 / +0.1% 66966389 / 70271999 / -4.7% 0.56 / 0.54 / +5.1%
tpch_q06/datafusion:vortex-file-compressed 7582616 / 7547681 / +0.5% 29891005 / 31482594 / -5.1% 0.25 / 0.24 / +5.8%
tpch_q07/datafusion:vortex-file-compressed 54114365 / 52488583 / +3.1% 84268013 / 84462883 / -0.2% 0.64 / 0.62 / +3.3%
tpch_q08/datafusion:vortex-file-compressed 52128757 / 51572318 / +1.1% 83485818 / 79774524 / +4.7% 0.62 / 0.65 / -3.4%
tpch_q09/datafusion:vortex-file-compressed 47119187 / 46742575 / +0.8% 75017215 / 82700737 / -9.3% 0.63 / 0.57 / +11.1%
tpch_q10/datafusion:vortex-file-compressed 18216609 / 17523638 / +4.0% 52375990 / 51080828 / +2.5% 0.35 / 0.34 / +1.4%
tpch_q11/datafusion:vortex-file-compressed 14993351 / 14681155 / +2.1% 35613695 / 36977291 / -3.7% 0.42 / 0.40 / +6.0%
tpch_q12/datafusion:vortex-file-compressed 21997325 / 22374045 / -1.7% 44641218 / 43651916 / +2.3% 0.49 / 0.51 / -3.9%
tpch_q13/datafusion:vortex-file-compressed 19578354 / 19519975 / +0.3% 39339690 / 41019071 / -4.1% 0.50 / 0.48 / +4.6%
tpch_q14/datafusion:vortex-file-compressed 14487874 / 14396930 / +0.6% 41676722 / 41242304 / +1.1% 0.35 / 0.35 / -0.4%
tpch_q15/datafusion:vortex-file-compressed 19101256 / 18601840 / +2.7% 47968516 / 46635312 / +2.9% 0.40 / 0.40 / -0.2%
tpch_q16/datafusion:vortex-file-compressed 18088812 / 18045651 / +0.2% 40684248 / 40948279 / -0.6% 0.44 / 0.44 / +0.9%
tpch_q17/datafusion:vortex-file-compressed 28900930 / 28926198 / -0.1% 59163713 / 60054664 / -1.5% 0.49 / 0.48 / +1.4%
tpch_q18/datafusion:vortex-file-compressed 36158528 / 36455641 / -0.8% 57988957 / 57829220 / +0.3% 0.62 / 0.63 / -1.1%
tpch_q19/datafusion:vortex-file-compressed 13257157 / 12974389 / +2.2% 42324316 / 40903657 / +3.5% 0.31 / 0.32 / -1.3%
tpch_q20/datafusion:vortex-file-compressed 21889649 / 21726805 / +0.7% 47382582 / 46438381 / +2.0% 0.46 / 0.47 / -1.3%
tpch_q21/datafusion:vortex-file-compressed 41607034 / 40938204 / +1.6% 75638596 / 74365040 / +1.7% 0.55 / 0.55 / -0.1%
tpch_q22/datafusion:vortex-file-compressed 11043253 / 10752123 / +2.7% 33469980 / 34982297 / -4.3% 0.33 / 0.31 / +7.3%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 69848051 / 69966790 / -0.2% 88133204 / 89220110 / -1.2% 0.79 / 0.78 / +1.1%
tpch_q02/datafusion:parquet 75272018 / 75553283 / -0.4% 91952746 / 94719527 / -2.9% 0.82 / 0.80 / +2.6%
tpch_q03/datafusion:parquet 82651135 / 82538932 / +0.1% 104184239 / 105656538 / -1.4% 0.79 / 0.78 / +1.6%
tpch_q04/datafusion:parquet 39742190 / 40149068 / -1.0% 58899455 / 59597329 / -1.2% 0.67 / 0.67 / +0.2%
tpch_q05/datafusion:parquet 111261487 / 111345454 / -0.1% 139651291 / 140768342 / -0.8% 0.80 / 0.79 / +0.7%
tpch_q06/datafusion:parquet 31735727 / 31910062 / -0.5% 49249404 / 50845111 / -3.1% 0.64 / 0.63 / +2.7%
tpch_q07/datafusion:parquet 114095157 / 114802354 / -0.6% 142081573 / 144515753 / -1.7% 0.80 / 0.79 / +1.1%
tpch_q08/datafusion:parquet 118819303 / 118862841 / -0.0% 149277420 / 148440182 / +0.6% 0.80 / 0.80 / -0.6%
tpch_q09/datafusion:parquet 138666793 / 138960208 / -0.2% 167733334 / 167999568 / -0.2% 0.83 / 0.83 / -0.1%
tpch_q10/datafusion:parquet 105660636 / 105753304 / -0.1% 133353903 / 132835924 / +0.4% 0.79 / 0.80 / -0.5%
tpch_q11/datafusion:parquet 60936898 / 60731846 / +0.3% 80565628 / 84415375 / -4.6% 0.76 / 0.72 / +5.1%
tpch_q12/datafusion:parquet 64506954 / 64238088 / +0.4% 86775575 / 88997837 / -2.5% 0.74 / 0.72 / +3.0%
tpch_q13/datafusion:parquet 146994110 / 147420011 / -0.3% 166544086 / 170509815 / -2.3% 0.88 / 0.86 / +2.1%
tpch_q14/datafusion:parquet 47951032 / 48267764 / -0.7% 75294047 / 78911286 / -4.6% 0.64 / 0.61 / +4.1%
tpch_q15/datafusion:parquet 74618005 / 75156014 / -0.7% 97261694 / 99670074 / -2.4% 0.77 / 0.75 / +1.7%
tpch_q16/datafusion:parquet 42993441 / 43828466 / -1.9% 62222145 / 63132640 / -1.4% 0.69 / 0.69 / -0.5%
tpch_q17/datafusion:parquet 123642782 / 123638980 / +0.0% 149362729 / 152586110 / -2.1% 0.83 / 0.81 / +2.2%
tpch_q18/datafusion:parquet 122182254 / 121874027 / +0.3% 143959419 / 145143297 / -0.8% 0.85 / 0.84 / +1.1%
tpch_q19/datafusion:parquet 58590939 / 58641795 / -0.1% 82428666 / 89109829 / -7.5% 0.71 / 0.66 / +8.0%
tpch_q20/datafusion:parquet 78533160 / 78834565 / -0.4% 103830144 / 103283555 / +0.5% 0.76 / 0.76 / -0.9%
tpch_q21/datafusion:parquet 116112615 / 116232618 / -0.1% 143553875 / 146430790 / -2.0% 0.81 / 0.79 / +1.9%
tpch_q22/datafusion:parquet 51425792 / 52086697 / -1.3% 69043400 / 74457940 / -7.3% 0.74 / 0.70 / +6.5%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 10103061 / 10231509 / -1.3% 23484428 / 20876781 / +12.5% 🔴 0.43 / 0.49 / -12.2%
tpch_q02/duckdb:vortex-file-compressed 14382541 / 14480728 / -0.7% 24270006 / 24045528 / +0.9% 0.59 / 0.60 / -1.6%
tpch_q03/duckdb:vortex-file-compressed 18573863 / 19251431 / -3.5% 33945142 / 35388585 / -4.1% 0.55 / 0.54 / +0.6%
tpch_q04/duckdb:vortex-file-compressed 12145779 / 11995454 / +1.3% 26073200 / 26333042 / -1.0% 0.47 / 0.46 / +2.3%
tpch_q05/duckdb:vortex-file-compressed 20035072 / 20025181 / +0.0% 33281202 / 34015038 / -2.2% 0.60 / 0.59 / +2.3%
tpch_q06/duckdb:vortex-file-compressed 5370837 / 5362092 / +0.2% 17540273 / 17303760 / +1.4% 0.31 / 0.31 / -1.2%
tpch_q07/duckdb:vortex-file-compressed 23901039 / 24074028 / -0.7% 40925213 / 41893167 / -2.3% 0.58 / 0.57 / +1.6%
tpch_q08/duckdb:vortex-file-compressed 20731761 / 20577172 / +0.8% 38267467 / 38275809 / -0.0% 0.54 / 0.54 / +0.8%
tpch_q09/duckdb:vortex-file-compressed 21432178 / 21869306 / -2.0% 39078397 / 41571355 / -6.0% 0.55 / 0.53 / +4.3%
tpch_q10/duckdb:vortex-file-compressed 22410564 / 22284441 / +0.6% 39238022 / 39455088 / -0.6% 0.57 / 0.56 / +1.1%
tpch_q11/duckdb:vortex-file-compressed 7319194 / 7290553 / +0.4% 14806297 / 14684987 / +0.8% 0.49 / 0.50 / -0.4%
tpch_q12/duckdb:vortex-file-compressed 15691570 / 15845876 / -1.0% 31067481 / 32963203 / -5.8% 0.51 / 0.48 / +5.1%
tpch_q13/duckdb:vortex-file-compressed 19662791 / 19576805 / +0.4% 30739996 / 31920387 / -3.7% 0.64 / 0.61 / +4.3%
tpch_q14/duckdb:vortex-file-compressed 11439279 / 11485841 / -0.4% 23349734 / 24580207 / -5.0% 0.49 / 0.47 / +4.8%
tpch_q15/duckdb:vortex-file-compressed 8645693 / 8478195 / +2.0% 19639218 / 19913142 / -1.4% 0.44 / 0.43 / +3.4%
tpch_q16/duckdb:vortex-file-compressed 17004387 / 17168758 / -1.0% 22779487 / 23008414 / -1.0% 0.75 / 0.75 / +0.0%
tpch_q17/duckdb:vortex-file-compressed 12748757 / 12897391 / -1.2% 26437286 / 25402366 / +4.1% 0.48 / 0.51 / -5.0%
tpch_q18/duckdb:vortex-file-compressed 25487653 / 25373705 / +0.4% 35410217 / 39625454 / -10.6% 🟢 0.72 / 0.64 / +12.4%
tpch_q19/duckdb:vortex-file-compressed 11622003 / 11733585 / -1.0% 27993601 / 26539607 / +5.5% 0.42 / 0.44 / -6.1%
tpch_q20/duckdb:vortex-file-compressed 14483489 / 14564665 / -0.6% 31967200 / 33648628 / -5.0% 0.45 / 0.43 / +4.7%
tpch_q21/duckdb:vortex-file-compressed 36545776 / 36792942 / -0.7% 54900104 / 55764389 / -1.5% 0.67 / 0.66 / +0.9%
tpch_q22/duckdb:vortex-file-compressed 16312377 / 16952036 / -3.8% 27049896 / 27131684 / -0.3% 0.60 / 0.62 / -3.5%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48301852 / 48251642 / +0.1% 55147214 / 55164631 / -0.0% 0.88 / 0.87 / +0.1%
tpch_q02/duckdb:parquet 48742729 / 48783460 / -0.1% 56169067 / 55820325 / +0.6% 0.87 / 0.87 / -0.7%
tpch_q03/duckdb:parquet 60018180 / 60667918 / -1.1% 70849971 / 69119964 / +2.5% 0.85 / 0.88 / -3.5%
tpch_q04/duckdb:parquet 35115425 / 35382307 / -0.8% 44108459 / 43392142 / +1.7% 0.80 / 0.82 / -2.4%
tpch_q05/duckdb:parquet 67363531 / 67840368 / -0.7% 79200648 / 77968096 / +1.6% 0.85 / 0.87 / -2.2%
tpch_q06/duckdb:parquet 21855141 / 21930988 / -0.3% 27360727 / 27867286 / -1.8% 0.80 / 0.79 / +1.5%
tpch_q07/duckdb:parquet 64410614 / 64383805 / +0.0% 75479511 / 74043178 / +1.9% 0.85 / 0.87 / -1.9%
tpch_q08/duckdb:parquet 75966536 / 76591745 / -0.8% 87942036 / 87675661 / +0.3% 0.86 / 0.87 / -1.1%
tpch_q09/duckdb:parquet 107897132 / 107471252 / +0.4% 120557685 / 120058090 / +0.4% 0.89 / 0.90 / -0.0%
tpch_q10/duckdb:parquet 106130760 / 106316309 / -0.2% 118377276 / 118309894 / +0.1% 0.90 / 0.90 / -0.2%
tpch_q11/duckdb:parquet 29701133 / 29636956 / +0.2% 35179961 / 35530152 / -1.0% 0.84 / 0.83 / +1.2%
tpch_q12/duckdb:parquet 37882174 / 38027743 / -0.4% 45221498 / 45749968 / -1.2% 0.84 / 0.83 / +0.8%
tpch_q13/duckdb:parquet 175356899 / 175937284 / -0.3% 182815473 / 184761102 / -1.1% 0.96 / 0.95 / +0.7%
tpch_q14/duckdb:parquet 42901557 / 42879502 / +0.1% 52028668 / 52102230 / -0.1% 0.82 / 0.82 / +0.2%
tpch_q15/duckdb:parquet 33023841 / 32933409 / +0.3% 42444974 / 42014293 / +1.0% 0.78 / 0.78 / -0.7%
tpch_q16/duckdb:parquet 47752688 / 47962857 / -0.4% 53199704 / 53586084 / -0.7% 0.90 / 0.90 / +0.3%
tpch_q17/duckdb:parquet 48295842 / 48375576 / -0.2% 58117175 / 58073554 / +0.1% 0.83 / 0.83 / -0.2%
tpch_q18/duckdb:parquet 74370567 / 74659392 / -0.4% 81789888 / 81773886 / +0.0% 0.91 / 0.91 / -0.4%
tpch_q19/duckdb:parquet 50590393 / 49644265 / +1.9% 60309750 / 55042738 / +9.6% 0.84 / 0.90 / -7.0%
tpch_q20/duckdb:parquet 63897863 / 63801312 / +0.2% 74922250 / 74366240 / +0.7% 0.85 / 0.86 / -0.6%
tpch_q21/duckdb:parquet 107491694 / 107079963 / +0.4% 117631867 / 117186547 / +0.4% 0.91 / 0.91 / +0.0%
tpch_q22/duckdb:parquet 50975335 / 51164501 / -0.4% 59762689 / 59083616 / +1.1% 0.85 / 0.87 / -1.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR a47ec03e vs base 91b38f41
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.993x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 88898244 / 89183817 / -0.3% 151559896 / 144436785 / +4.9% 0.59 / 0.62 / -5.0%
tpch_q02/datafusion:vortex-file-compressed 64577591 / 64234264 / +0.5% 97451647 / 99395975 / -2.0% 0.66 / 0.65 / +2.5%
tpch_q03/datafusion:vortex-file-compressed 65004935 / 67257552 / -3.3% 128223623 / 119854341 / +7.0% 0.51 / 0.56 / -9.7%
tpch_q04/datafusion:vortex-file-compressed 35179881 / 36148245 / -2.7% 74752451 / 71981001 / +3.9% 0.47 / 0.50 / -6.3%
tpch_q05/datafusion:vortex-file-compressed 116825131 / 119419361 / -2.2% 177053140 / 173851845 / +1.8% 0.66 / 0.69 / -3.9%
tpch_q06/datafusion:vortex-file-compressed 11558482 / 11360940 / +1.7% 58289890 / 56931470 / +2.4% 0.20 / 0.20 / -0.6%
tpch_q07/datafusion:vortex-file-compressed 135622054 / 136572476 / -0.7% 192612280 / 199363449 / -3.4% 0.70 / 0.69 / +2.8%
tpch_q08/datafusion:vortex-file-compressed 142126982 / 143076936 / -0.7% 316821283 / 221958263 / +42.7% 🔴 0.45 / 0.64 / -30.4%
tpch_q09/datafusion:vortex-file-compressed 182450523 / 181277381 / +0.6% 252296184 / 244761925 / +3.1% 0.72 / 0.74 / -2.4%
tpch_q10/datafusion:vortex-file-compressed 72363272 / 73273896 / -1.2% 137035550 / 141291634 / -3.0% 0.53 / 0.52 / +1.8%
tpch_q11/datafusion:vortex-file-compressed 43094294 / 43269137 / -0.4% 68730809 / 67355017 / +2.0% 0.63 / 0.64 / -2.4%
tpch_q12/datafusion:vortex-file-compressed 37430058 / 37033855 / +1.1% 84378883 / 81642718 / +3.4% 0.44 / 0.45 / -2.2%
tpch_q13/datafusion:vortex-file-compressed 43072175 / 41825440 / +3.0% 79114986 / 84287575 / -6.1% 0.54 / 0.50 / +9.7%
tpch_q14/datafusion:vortex-file-compressed 22850594 / 22449194 / +1.8% 85640620 / 86607574 / -1.1% 0.27 / 0.26 / +2.9%
tpch_q15/datafusion:vortex-file-compressed 36145893 / 35826508 / +0.9% 92946194 / 93794986 / -0.9% 0.39 / 0.38 / +1.8%
tpch_q16/datafusion:vortex-file-compressed 37143820 / 37594952 / -1.2% 67606950 / 65969288 / +2.5% 0.55 / 0.57 / -3.6%
tpch_q17/datafusion:vortex-file-compressed 172667475 / 173718283 / -0.6% 212748497 / 222515222 / -4.4% 0.81 / 0.78 / +4.0%
tpch_q18/datafusion:vortex-file-compressed 202960563 / 201950709 / +0.5% 265297246 / 272902610 / -2.8% 0.77 / 0.74 / +3.4%
tpch_q19/datafusion:vortex-file-compressed 32830833 / 31526872 / +4.1% 90995272 / 92764855 / -1.9% 0.36 / 0.34 / +6.2%
tpch_q20/datafusion:vortex-file-compressed 61982808 / 63198744 / -1.9% 117846781 / 121242886 / -2.8% 0.53 / 0.52 / +0.9%
tpch_q21/datafusion:vortex-file-compressed 177862489 / 182824741 / -2.7% 237885989 / 245473881 / -3.1% 0.75 / 0.74 / +0.4%
tpch_q22/datafusion:vortex-file-compressed 25547692 / 26426461 / -3.3% 56956558 / 55502787 / +2.6% 0.45 / 0.48 / -5.8%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 86337608 / 85908543 / +0.5% 126854746 / 136749566 / -7.2% 0.68 / 0.63 / +8.3%
tpch_q02/datafusion:parquet 172405398 / 172957435 / -0.3% 198263278 / 203189375 / -2.4% 0.87 / 0.85 / +2.2%
tpch_q03/datafusion:parquet 136136854 / 136992961 / -0.6% 187621761 / 185707432 / +1.0% 0.73 / 0.74 / -1.6%
tpch_q04/datafusion:parquet 57868929 / 57959077 / -0.2% 97814548 / 95036865 / +2.9% 0.59 / 0.61 / -3.0%
tpch_q05/datafusion:parquet 168455885 / 167739428 / +0.4% 231117059 / 233990344 / -1.2% 0.73 / 0.72 / +1.7%
tpch_q06/datafusion:parquet 37282696 / 37037317 / +0.7% 83443694 / 82345086 / +1.3% 0.45 / 0.45 / -0.7%
tpch_q07/datafusion:parquet 219103384 / 214618773 / +2.1% 278076657 / 277657701 / +0.2% 0.79 / 0.77 / +1.9%
tpch_q08/datafusion:parquet 217872466 / 220416748 / -1.2% 294902707 / 300131143 / -1.7% 0.74 / 0.73 / +0.6%
tpch_q09/datafusion:parquet 310803004 / 310811960 / -0.0% 382461278 / 381993092 / +0.1% 0.81 / 0.81 / -0.1%
tpch_q10/datafusion:parquet 318926391 / 319637696 / -0.2% 387007772 / 383357930 / +1.0% 0.82 / 0.83 / -1.2%
tpch_q11/datafusion:parquet 125252714 / 126035713 / -0.6% 151133282 / 152205232 / -0.7% 0.83 / 0.83 / +0.1%
tpch_q12/datafusion:parquet 83406839 / 83280636 / +0.2% 125590871 / 122526745 / +2.5% 0.66 / 0.68 / -2.3%
tpch_q13/datafusion:parquet 215349567 / 215190703 / +0.1% 249123513 / 248839269 / +0.1% 0.86 / 0.86 / -0.0%
tpch_q14/datafusion:parquet 85257206 / 87066062 / -2.1% 201440917 / 193193773 / +4.3% 0.42 / 0.45 / -6.1%
tpch_q15/datafusion:parquet 104857038 / 106519826 / -1.6% 159456740 / 159407848 / +0.0% 0.66 / 0.67 / -1.6%
tpch_q16/datafusion:parquet 94879270 / 95858665 / -1.0% 123703165 / 120188817 / +2.9% 0.77 / 0.80 / -3.8%
tpch_q17/datafusion:parquet 212349792 / 211750481 / +0.3% 270800074 / 269651107 / +0.4% 0.78 / 0.79 / -0.1%
tpch_q18/datafusion:parquet 268037592 / 271333441 / -1.2% 309704017 / 320259464 / -3.3% 0.87 / 0.85 / +2.2%
tpch_q19/datafusion:parquet 107558864 / 108469005 / -0.8% 170529656 / 168420852 / +1.3% 0.63 / 0.64 / -2.1%
tpch_q20/datafusion:parquet 188378437 / 187478932 / +0.5% 263403165 / 262601545 / +0.3% 0.72 / 0.71 / +0.2%
tpch_q21/datafusion:parquet 244230701 / 245423970 / -0.5% 308409012 / 310079518 / -0.5% 0.79 / 0.79 / +0.1%
tpch_q22/datafusion:parquet 152968696 / 153057312 / -0.1% 176080098 / 180198185 / -2.3% 0.87 / 0.85 / +2.3%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 35603423 / 35464962 / +0.4% 78962224 / 81022492 / -2.5% 0.45 / 0.44 / +3.0%
tpch_q02/duckdb:vortex-file-compressed 27270471 / 27630598 / -1.3% 42279546 / 43698264 / -3.2% 0.65 / 0.63 / +2.0%
tpch_q03/duckdb:vortex-file-compressed 54333027 / 54367073 / -0.1% 106259805 / 108306282 / -1.9% 0.51 / 0.50 / +1.9%
tpch_q04/duckdb:vortex-file-compressed 51790491 / 51531203 / +0.5% 90721624 / 90755044 / -0.0% 0.57 / 0.57 / +0.5%
tpch_q05/duckdb:vortex-file-compressed 68899245 / 69698703 / -1.1% 125117405 / 128050130 / -2.3% 0.55 / 0.54 / +1.2%
tpch_q06/duckdb:vortex-file-compressed 23282700 / 23101539 / +0.8% 76201180 / 75356045 / +1.1% 0.31 / 0.31 / -0.3%
tpch_q07/duckdb:vortex-file-compressed 58088676 / 58345646 / -0.4% 124740969 / 124696493 / +0.0% 0.47 / 0.47 / -0.5%
tpch_q08/duckdb:vortex-file-compressed 87984947 / 88027004 / -0.0% 151929922 / 155413040 / -2.2% 0.58 / 0.57 / +2.2%
tpch_q09/duckdb:vortex-file-compressed 109130663 / 109437181 / -0.3% 190412875 / 192007145 / -0.8% 0.57 / 0.57 / +0.6%
tpch_q10/duckdb:vortex-file-compressed 96745296 / 98116566 / -1.4% 159984184 / 153781889 / +4.0% 0.60 / 0.64 / -5.2%
tpch_q11/duckdb:vortex-file-compressed 14175659 / 14448910 / -1.9% 26838095 / 27832418 / -3.6% 0.53 / 0.52 / +1.7%
tpch_q12/duckdb:vortex-file-compressed 59500667 / 60224201 / -1.2% 113935002 / 113183978 / +0.7% 0.52 / 0.53 / -1.9%
tpch_q13/duckdb:vortex-file-compressed 70506197 / 72085346 / -2.2% 103353119 / 101086935 / +2.2% 0.68 / 0.71 / -4.3%
tpch_q14/duckdb:vortex-file-compressed 28696610 / 28907377 / -0.7% 73890547 / 77664399 / -4.9% 0.39 / 0.37 / +4.3%
tpch_q15/duckdb:vortex-file-compressed 24763589 / 25092285 / -1.3% 67279297 / 68894114 / -2.3% 0.37 / 0.36 / +1.1%
tpch_q16/duckdb:vortex-file-compressed 49159769 / 49033430 / +0.3% 60323902 / 59649218 / +1.1% 0.81 / 0.82 / -0.9%
tpch_q17/duckdb:vortex-file-compressed 36363801 / 36434417 / -0.2% 81326196 / 80413570 / +1.1% 0.45 / 0.45 / -1.3%
tpch_q18/duckdb:vortex-file-compressed 109360939 / 108843164 / +0.5% 135049464 / 139623767 / -3.3% 0.81 / 0.78 / +3.9%
tpch_q19/duckdb:vortex-file-compressed 36736299 / 37184139 / -1.2% 97513627 / 95174402 / +2.5% 0.38 / 0.39 / -3.6%
tpch_q20/duckdb:vortex-file-compressed 48309287 / 49151124 / -1.7% 109089368 / 110381686 / -1.2% 0.44 / 0.45 / -0.5%
tpch_q21/duckdb:vortex-file-compressed 95744995 / 95009556 / +0.8% 148187197 / 152499728 / -2.8% 0.65 / 0.62 / +3.7%
tpch_q22/duckdb:vortex-file-compressed 33282812 / 33153863 / +0.4% 52327575 / 53547145 / -2.3% 0.64 / 0.62 / +2.7%
duckdb / parquet / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68737392 / 69462374 / -1.0% 93872814 / 91507513 / +2.6% 0.73 / 0.76 / -3.5%
tpch_q02/duckdb:parquet 87418349 / 87912087 / -0.6% 98088070 / 99747781 / -1.7% 0.89 / 0.88 / +1.1%
tpch_q03/duckdb:parquet 110191609 / 111491532 / -1.2% 142962783 / 148007271 / -3.4% 0.77 / 0.75 / +2.3%
tpch_q04/duckdb:parquet 76929581 / 77881332 / -1.2% 99286307 / 100900028 / -1.6% 0.77 / 0.77 / +0.4%
tpch_q05/duckdb:parquet 124244305 / 135737516 / -8.5% 156383804 / 160460950 / -2.5% 0.79 / 0.85 / -6.1%
tpch_q06/duckdb:parquet 35779773 / 36132583 / -1.0% 62073267 / 60328109 / +2.9% 0.58 / 0.60 / -3.8%
tpch_q07/duckdb:parquet 116761493 / 118500608 / -1.5% 154605224 / 156738200 / -1.4% 0.76 / 0.76 / -0.1%
tpch_q08/duckdb:parquet 148453612 / 150366151 / -1.3% 193133455 / 197972244 / -2.4% 0.77 / 0.76 / +1.2%
tpch_q09/duckdb:parquet 237099950 / 237396006 / -0.1% 283075902 / 287112600 / -1.4% 0.84 / 0.83 / +1.3%
tpch_q10/duckdb:parquet 317531326 / 316322357 / +0.4% 343783248 / 342236993 / +0.5% 0.92 / 0.92 / -0.1%
tpch_q11/duckdb:parquet 43697558 / 43904108 / -0.5% 51162952 / 51574886 / -0.8% 0.85 / 0.85 / +0.3%
tpch_q12/duckdb:parquet 72133750 / 73011928 / -1.2% 93344966 / 93461193 / -0.1% 0.77 / 0.78 / -1.1%
tpch_q13/duckdb:parquet 294417491 / 292884222 / +0.5% 308060330 / 309511733 / -0.5% 0.96 / 0.95 / +1.0%
tpch_q14/duckdb:parquet 102523675 / 104193222 / -1.6% 140571738 / 141093804 / -0.4% 0.73 / 0.74 / -1.2%
tpch_q15/duckdb:parquet 57732828 / 58280320 / -0.9% 87795941 / 87701990 / +0.1% 0.66 / 0.66 / -1.0%
tpch_q16/duckdb:parquet 101202983 / 101465085 / -0.3% 108387498 / 109071919 / -0.6% 0.93 / 0.93 / +0.4%
tpch_q17/duckdb:parquet 82065274 / 82547243 / -0.6% 116641165 / 119579436 / -2.5% 0.70 / 0.69 / +1.9%
tpch_q18/duckdb:parquet 155226862 / 158655275 / -2.2% 169489070 / 175599421 / -3.5% 0.92 / 0.90 / +1.4%
tpch_q19/duckdb:parquet 100636707 / 101427433 / -0.8% 133116266 / 141280983 / -5.8% 0.76 / 0.72 / +5.3%
tpch_q20/duckdb:parquet 147718138 / 148720917 / -0.7% 188519595 / 188409347 / +0.1% 0.78 / 0.79 / -0.7%
tpch_q21/duckdb:parquet 252273077 / 255417275 / -1.2% 277907048 / 284032123 / -2.2% 0.91 / 0.90 / +0.9%
tpch_q22/duckdb:parquet 168869743 / 169114114 / -0.1% 184580171 / 184179402 / +0.2% 0.91 / 0.92 / -0.4%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR a47ec03e vs base 91b38f41
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.981x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.995x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24164066 / 24080426 / +0.3% 42143183 / 42811512 / -1.6% 0.57 / 0.56 / +1.9%
tpcds_q02/datafusion:vortex-file-compressed 47026808 / 47331892 / -0.6% 64819395 / 64773729 / +0.1% 0.73 / 0.73 / -0.7%
tpcds_q03/datafusion:vortex-file-compressed 12000484 / 12002078 / -0.0% 28197977 / 29487997 / -4.4% 0.43 / 0.41 / +4.6%
tpcds_q04/datafusion:vortex-file-compressed 123693386 / 123784586 / -0.1% 151961465 / 156175019 / -2.7% 0.81 / 0.79 / +2.7%
tpcds_q05/datafusion:vortex-file-compressed 60552816 / 59380299 / +2.0% 80612749 / 80833148 / -0.3% 0.75 / 0.73 / +2.3%
tpcds_q06/datafusion:vortex-file-compressed 22864970 / 23265882 / -1.7% 45522086 / 44173904 / +3.1% 0.50 / 0.53 / -4.6%
tpcds_q07/datafusion:vortex-file-compressed 31591846 / 31468508 / +0.4% 54983770 / 52426963 / +4.9% 0.57 / 0.60 / -4.3%
tpcds_q08/datafusion:vortex-file-compressed 24606582 / 24694712 / -0.4% 42427709 / 42733052 / -0.7% 0.58 / 0.58 / +0.4%
tpcds_q09/datafusion:vortex-file-compressed 17524022 / 17840130 / -1.8% 31590497 / 34204186 / -7.6% 0.55 / 0.52 / +6.4%
tpcds_q10/datafusion:vortex-file-compressed 27394352 / 27835334 / -1.6% 48627693 / 50133451 / -3.0% 0.56 / 0.56 / +1.5%
tpcds_q11/datafusion:vortex-file-compressed 64891676 / 64468496 / +0.7% 90527849 / 90998619 / -0.5% 0.72 / 0.71 / +1.2%
tpcds_q12/datafusion:vortex-file-compressed 16863145 / 16512743 / +2.1% 32542012 / 32892525 / -1.1% 0.52 / 0.50 / +3.2%
tpcds_q13/datafusion:vortex-file-compressed 31632020 / 31519534 / +0.4% 54602479 / 56254193 / -2.9% 0.58 / 0.56 / +3.4%
tpcds_q14/datafusion:vortex-file-compressed 499936755 / 497430012 / +0.5% 552139178 / 555242792 / -0.6% 0.91 / 0.90 / +1.1%
tpcds_q15/datafusion:vortex-file-compressed 15837879 / 15407246 / +2.8% 35580121 / 34466049 / +3.2% 0.45 / 0.45 / -0.4%
tpcds_q16/datafusion:vortex-file-compressed 20009775 / 20163899 / -0.8% 38729979 / 38582523 / +0.4% 0.52 / 0.52 / -1.1%
tpcds_q17/datafusion:vortex-file-compressed 55705933 / 60575782 / -8.0% 75036016 / 82810296 / -9.4% 0.74 / 0.73 / +1.5%
tpcds_q18/datafusion:vortex-file-compressed 68187080 / 68138125 / +0.1% 89595139 / 91121177 / -1.7% 0.76 / 0.75 / +1.8%
tpcds_q19/datafusion:vortex-file-compressed 17184334 / 17259996 / -0.4% 38139758 / 38558541 / -1.1% 0.45 / 0.45 / +0.7%
tpcds_q20/datafusion:vortex-file-compressed 17690422 / 17898320 / -1.2% 34680199 / 35337182 / -1.9% 0.51 / 0.51 / +0.7%
tpcds_q21/datafusion:vortex-file-compressed 16209513 / 16454965 / -1.5% 37575442 / 38146906 / -1.5% 0.43 / 0.43 / +0.0%
tpcds_q22/datafusion:vortex-file-compressed 57757844 / 57508116 / +0.4% 81598499 / 78558177 / +3.9% 0.71 / 0.73 / -3.3%
tpcds_q23/datafusion:vortex-file-compressed 70378034 / 72636138 / -3.1% 99923563 / 97355689 / +2.6% 0.70 / 0.75 / -5.6%
tpcds_q24/datafusion:vortex-file-compressed 67339574 / 67674112 / -0.5% 90004752 / 89252585 / +0.8% 0.75 / 0.76 / -1.3%
tpcds_q25/datafusion:vortex-file-compressed 53275549 / 53819093 / -1.0% 77528633 / 83139646 / -6.7% 0.69 / 0.65 / +6.2%
tpcds_q26/datafusion:vortex-file-compressed 30396214 / 30298837 / +0.3% 50112551 / 49705805 / +0.8% 0.61 / 0.61 / -0.5%
tpcds_q27/datafusion:vortex-file-compressed 60063788 / 59801034 / +0.4% 85112457 / 83863758 / +1.5% 0.71 / 0.71 / -1.0%
tpcds_q28/datafusion:vortex-file-compressed 18179756 / 18196826 / -0.1% 36810033 / 37406558 / -1.6% 0.49 / 0.49 / +1.5%
tpcds_q29/datafusion:vortex-file-compressed 58468990 / 58707434 / -0.4% 73099605 / 80502966 / -9.2% 0.80 / 0.73 / +9.7%
tpcds_q30/datafusion:vortex-file-compressed 26668343 / 27215037 / -2.0% 44367216 / 44574371 / -0.5% 0.60 / 0.61 / -1.6%
tpcds_q31/datafusion:vortex-file-compressed 59160682 / 59335014 / -0.3% 80390613 / 82146046 / -2.1% 0.74 / 0.72 / +1.9%
tpcds_q32/datafusion:vortex-file-compressed 13635757 / 13576429 / +0.4% 31073178 / 31743953 / -2.1% 0.44 / 0.43 / +2.6%
tpcds_q33/datafusion:vortex-file-compressed 27218978 / 28095228 / -3.1% 49072937 / 52036887 / -5.7% 0.55 / 0.54 / +2.7%
tpcds_q34/datafusion:vortex-file-compressed 17341628 / 17413460 / -0.4% 35553172 / 35475165 / +0.2% 0.49 / 0.49 / -0.6%
tpcds_q35/datafusion:vortex-file-compressed 34012014 / 34340308 / -1.0% 57687008 / 58249004 / -1.0% 0.59 / 0.59 / +0.0%
tpcds_q36/datafusion:vortex-file-compressed 47695636 / 48666033 / -2.0% 72736506 / 71294719 / +2.0% 0.66 / 0.68 / -3.9%
tpcds_q37/datafusion:vortex-file-compressed 12620052 / 11892388 / +6.1% 35014171 / 34904925 / +0.3% 0.36 / 0.34 / +5.8%
tpcds_q38/datafusion:vortex-file-compressed 29687468 / 30188538 / -1.7% 49613051 / 50903544 / -2.5% 0.60 / 0.59 / +0.9%
tpcds_q39/datafusion:vortex-file-compressed 62104858 / 61118662 / +1.6% 86585694 / 85430082 / +1.4% 0.72 / 0.72 / +0.3%
tpcds_q40/datafusion:vortex-file-compressed 24120292 / 24190570 / -0.3% 43972510 / 43424317 / +1.3% 0.55 / 0.56 / -1.5%
tpcds_q41/datafusion:vortex-file-compressed 17179055 / 17249902 / -0.4% 31099100 / 31475950 / -1.2% 0.55 / 0.55 / +0.8%
tpcds_q42/datafusion:vortex-file-compressed 11450026 / 11520167 / -0.6% 26010178 / 27688924 / -6.1% 0.44 / 0.42 / +5.8%
tpcds_q43/datafusion:vortex-file-compressed 12880549 / 12568676 / +2.5% 29912820 / 30141210 / -0.8% 0.43 / 0.42 / +3.3%
tpcds_q44/datafusion:vortex-file-compressed 26148024 / 26032928 / +0.4% 47064378 / 47375935 / -0.7% 0.56 / 0.55 / +1.1%
tpcds_q45/datafusion:vortex-file-compressed 18890468 / 18336238 / +3.0% 37906155 / 36973544 / +2.5% 0.50 / 0.50 / +0.5%
tpcds_q46/datafusion:vortex-file-compressed 22811711 / 22921988 / -0.5% 45439086 / 45629314 / -0.4% 0.50 / 0.50 / -0.1%
tpcds_q47/datafusion:vortex-file-compressed 77962356 / 77746112 / +0.3% 106679236 / 106045305 / +0.6% 0.73 / 0.73 / -0.3%
tpcds_q48/datafusion:vortex-file-compressed 29443350 / 29737214 / -1.0% 50847513 / 51076025 / -0.4% 0.58 / 0.58 / -0.5%
tpcds_q49/datafusion:vortex-file-compressed 57810990 / 57189180 / +1.1% 79901226 / 80636369 / -0.9% 0.72 / 0.71 / +2.0%
tpcds_q50/datafusion:vortex-file-compressed 31725764 / 32745744 / -3.1% 55649582 / 52613465 / +5.8% 0.57 / 0.62 / -8.4%
tpcds_q51/datafusion:vortex-file-compressed 67123148 / 67734696 / -0.9% 88538075 / 88518790 / +0.0% 0.76 / 0.77 / -0.9%
tpcds_q52/datafusion:vortex-file-compressed 11694216 / 11900924 / -1.7% 26997749 / 27813692 / -2.9% 0.43 / 0.43 / +1.2%
tpcds_q53/datafusion:vortex-file-compressed 18047868 / 18459244 / -2.2% 37388343 / 37102421 / +0.8% 0.48 / 0.50 / -3.0%
tpcds_q54/datafusion:vortex-file-compressed 32889548 / 33408584 / -1.6% 57007994 / 58971560 / -3.3% 0.58 / 0.57 / +1.8%
tpcds_q55/datafusion:vortex-file-compressed 11431738 / 11435570 / -0.0% 25997834 / 27725231 / -6.2% 0.44 / 0.41 / +6.6%
tpcds_q56/datafusion:vortex-file-compressed 26770259 / 26112495 / +2.5% 49502265 / 50878274 / -2.7% 0.54 / 0.51 / +5.4%
tpcds_q57/datafusion:vortex-file-compressed 77856218 / 77744864 / +0.1% 102047674 / 101768160 / +0.3% 0.76 / 0.76 / -0.1%
tpcds_q58/datafusion:vortex-file-compressed 41068366 / 41132890 / -0.2% 64793045 / 65908120 / -1.7% 0.63 / 0.62 / +1.6%
tpcds_q59/datafusion:vortex-file-compressed 30908108 / 31624910 / -2.3% 52624756 / 53448484 / -1.5% 0.59 / 0.59 / -0.7%
tpcds_q60/datafusion:vortex-file-compressed 27062843 / 27108818 / -0.2% 48162809 / 47107140 / +2.2% 0.56 / 0.58 / -2.4%
tpcds_q61/datafusion:vortex-file-compressed 23082972 / 23596974 / -2.2% 44621807 / 46083079 / -3.2% 0.52 / 0.51 / +1.0%
tpcds_q62/datafusion:vortex-file-compressed 18262851 / 18218668 / +0.2% 34683573 / 34963522 / -0.8% 0.53 / 0.52 / +1.1%
tpcds_q63/datafusion:vortex-file-compressed 17683985 / 18087454 / -2.2% 37428092 / 38123940 / -1.8% 0.47 / 0.47 / -0.4%
tpcds_q64/datafusion:vortex-file-compressed 224475328 / 224169880 / +0.1% 263796444 / 263408743 / +0.1% 0.85 / 0.85 / -0.0%
tpcds_q65/datafusion:vortex-file-compressed 74607064 / 74753910 / -0.2% 91453082 / 95096129 / -3.8% 0.82 / 0.79 / +3.8%
tpcds_q66/datafusion:vortex-file-compressed 52252742 / 53119124 / -1.6% 72773269 / 76016578 / -4.3% 0.72 / 0.70 / +2.8%
tpcds_q67/datafusion:vortex-file-compressed 58743638 / 57661556 / +1.9% 86720688 / 88363800 / -1.9% 0.68 / 0.65 / +3.8%
tpcds_q68/datafusion:vortex-file-compressed 22219432 / 22739478 / -2.3% 47967987 / 47655342 / +0.7% 0.46 / 0.48 / -2.9%
tpcds_q69/datafusion:vortex-file-compressed 28094871 / 27916831 / +0.6% 49313513 / 49688082 / -0.8% 0.57 / 0.56 / +1.4%
tpcds_q70/datafusion:vortex-file-compressed 23143070 / 23106530 / +0.2% 45488742 / 44596240 / +2.0% 0.51 / 0.52 / -1.8%
tpcds_q71/datafusion:vortex-file-compressed 19029655 / 18386245 / +3.5% 38156513 / 38793455 / -1.6% 0.50 / 0.47 / +5.2%
tpcds_q72/datafusion:vortex-file-compressed 352293978 / 362217550 / -2.7% 381821535 / 375616305 / +1.7% 0.92 / 0.96 / -4.3%
tpcds_q73/datafusion:vortex-file-compressed 16025158 / 16142107 / -0.7% 35112856 / 34839357 / +0.8% 0.46 / 0.46 / -1.5%
tpcds_q74/datafusion:vortex-file-compressed 46161380 / 46702272 / -1.2% 70739405 / 70906738 / -0.2% 0.65 / 0.66 / -0.9%
tpcds_q75/datafusion:vortex-file-compressed 136485002 / 136496324 / -0.0% 171743393 / 169262666 / +1.5% 0.79 / 0.81 / -1.5%
tpcds_q76/datafusion:vortex-file-compressed 26699366 / 26173710 / +2.0% 43590445 / 45306418 / -3.8% 0.61 / 0.58 / +6.0%
tpcds_q77/datafusion:vortex-file-compressed 45286516 / 45396751 / -0.2% 66425346 / 64526171 / +2.9% 0.68 / 0.70 / -3.1%
tpcds_q78/datafusion:vortex-file-compressed 68504698 / 68908670 / -0.6% 95232248 / 98358037 / -3.2% 0.72 / 0.70 / +2.7%
tpcds_q79/datafusion:vortex-file-compressed 20127726 / 20139812 / -0.1% 39504484 / 42241142 / -6.5% 0.51 / 0.48 / +6.9%
tpcds_q80/datafusion:vortex-file-compressed 73861511 / 75432101 / -2.1% 105896747 / 104526876 / +1.3% 0.70 / 0.72 / -3.3%
tpcds_q81/datafusion:vortex-file-compressed 27171089 / 27796720 / -2.3% 43586217 / 44634449 / -2.3% 0.62 / 0.62 / +0.1%
tpcds_q82/datafusion:vortex-file-compressed 13035144 / 12889212 / +1.1% 33664338 / 34087792 / -1.2% 0.39 / 0.38 / +2.4%
tpcds_q83/datafusion:vortex-file-compressed 35959316 / 35303784 / +1.9% 56470656 / 56065812 / +0.7% 0.64 / 0.63 / +1.1%
tpcds_q84/datafusion:vortex-file-compressed 12368372 / 12017834 / +2.9% 26825346 / 26964990 / -0.5% 0.46 / 0.45 / +3.5%
tpcds_q85/datafusion:vortex-file-compressed 57621351 / 57396391 / +0.4% 80462724 / 81808038 / -1.6% 0.72 / 0.70 / +2.1%
tpcds_q86/datafusion:vortex-file-compressed 16821380 / 16874929 / -0.3% 32518422 / 33168616 / -2.0% 0.52 / 0.51 / +1.7%
tpcds_q87/datafusion:vortex-file-compressed 29498872 / 30149668 / -2.2% 49620253 / 49290201 / +0.7% 0.59 / 0.61 / -2.8%
tpcds_q88/datafusion:vortex-file-compressed 32138203 / 32143334 / -0.0% 65389494 / 63049964 / +3.7% 0.49 / 0.51 / -3.6%
tpcds_q89/datafusion:vortex-file-compressed 20961854 / 21010384 / -0.2% 39937961 / 40758365 / -2.0% 0.52 / 0.52 / +1.8%
tpcds_q90/datafusion:vortex-file-compressed 10544755 / 10781509 / -2.2% 26182690 / 25994913 / +0.7% 0.40 / 0.41 / -2.9%
tpcds_q91/datafusion:vortex-file-compressed 16311832 / 16611498 / -1.8% 37927745 / 37605320 / +0.9% 0.43 / 0.44 / -2.6%
tpcds_q92/datafusion:vortex-file-compressed 13907577 / 14003876 / -0.7% 31157265 / 31284531 / -0.4% 0.45 / 0.45 / -0.3%
tpcds_q93/datafusion:vortex-file-compressed 22921273 / 22654210 / +1.2% 41830811 / 42591373 / -1.8% 0.55 / 0.53 / +3.0%
tpcds_q94/datafusion:vortex-file-compressed 19146371 / 19972449 / -4.1% 37455246 / 37648741 / -0.5% 0.51 / 0.53 / -3.6%
tpcds_q95/datafusion:vortex-file-compressed 45047994 / 45036059 / +0.0% 65639810 / 64766017 / +1.3% 0.69 / 0.70 / -1.3%
tpcds_q96/datafusion:vortex-file-compressed 8469388 / 8384932 / +1.0% 25173604 / 24272450 / +3.7% 0.34 / 0.35 / -2.6%
tpcds_q97/datafusion:vortex-file-compressed 21439284 / 21230128 / +1.0% 41012460 / 43662897 / -6.1% 0.52 / 0.49 / +7.5%
tpcds_q98/datafusion:vortex-file-compressed 16980256 / 17084957 / -0.6% 35820804 / 36230629 / -1.1% 0.47 / 0.47 / +0.5%
tpcds_q99/datafusion:vortex-file-compressed 21166406 / 21067414 / +0.5% 37191196 / 37201931 / -0.0% 0.57 / 0.57 / +0.5%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 41736058 / 42550974 / -1.9% 60785087 / 59218306 / +2.6% 0.69 / 0.72 / -4.4%
tpcds_q02/datafusion:parquet 55020725 / 55077274 / -0.1% 71854104 / 71891044 / -0.1% 0.77 / 0.77 / -0.1%
tpcds_q03/datafusion:parquet 19183100 / 19307330 / -0.6% 33501588 / 31967826 / +4.8% 0.57 / 0.60 / -5.2%
tpcds_q04/datafusion:parquet 182820482 / 181046520 / +1.0% 207371970 / 208688791 / -0.6% 0.88 / 0.87 / +1.6%
tpcds_q05/datafusion:parquet 69788362 / 69081328 / +1.0% 92078810 / 90392615 / +1.9% 0.76 / 0.76 / -0.8%
tpcds_q06/datafusion:parquet 33760248 / 34139162 / -1.1% 48319969 / 49411308 / -2.2% 0.70 / 0.69 / +1.1%
tpcds_q07/datafusion:parquet 47500302 / 46680516 / +1.8% 67006430 / 67284265 / -0.4% 0.71 / 0.69 / +2.2%
tpcds_q08/datafusion:parquet 31673462 / 31271150 / +1.3% 47916734 / 47228533 / +1.5% 0.66 / 0.66 / -0.2%
tpcds_q09/datafusion:parquet 32779531 / 31925608 / +2.7% 43507697 / 48299100 / -9.9% 0.75 / 0.66 / +14.0%
tpcds_q10/datafusion:parquet 43834508 / 44649483 / -1.8% 59535261 / 59435244 / +0.2% 0.74 / 0.75 / -2.0%
tpcds_q11/datafusion:parquet 99504750 / 99561899 / -0.1% 121214233 / 118570871 / +2.2% 0.82 / 0.84 / -2.2%
tpcds_q12/datafusion:parquet 23785644 / 23950632 / -0.7% 38332394 / 35743074 / +7.2% 0.62 / 0.67 / -7.4%
tpcds_q13/datafusion:parquet 46708894 / 46407844 / +0.6% 68859943 / 68679797 / +0.3% 0.68 / 0.68 / +0.4%
tpcds_q14/datafusion:parquet 537341337 / 538997384 / -0.3% 580028532 / 587786292 / -1.3% 0.93 / 0.92 / +1.0%
tpcds_q15/datafusion:parquet 23705577 / 23343674 / +1.6% 38852245 / 38101762 / +2.0% 0.61 / 0.61 / -0.4%
tpcds_q16/datafusion:parquet 36953446 / 37583969 / -1.7% 51261732 / 50399328 / +1.7% 0.72 / 0.75 / -3.3%
tpcds_q17/datafusion:parquet 73345084 / 73554304 / -0.3% 99920237 / 95469966 / +4.7% 0.73 / 0.77 / -4.7%
tpcds_q18/datafusion:parquet 67869162 / 71589321 / -5.2% 87739800 / 92761250 / -5.4% 0.77 / 0.77 / +0.2%
tpcds_q19/datafusion:parquet 29980374 / 29889114 / +0.3% 44723783 / 44354233 / +0.8% 0.67 / 0.67 / -0.5%
tpcds_q20/datafusion:parquet 25579948 / 25979346 / -1.5% 38015973 / 38205065 / -0.5% 0.67 / 0.68 / -1.0%
tpcds_q21/datafusion:parquet 20269788 / 20357334 / -0.4% 33382238 / 31573610 / +5.7% 0.61 / 0.64 / -5.8%
tpcds_q22/datafusion:parquet 76847134 / 77085245 / -0.3% 88791129 / 89371874 / -0.6% 0.87 / 0.86 / +0.3%
tpcds_q23/datafusion:parquet 92291132 / 93108686 / -0.9% 120248180 / 114540544 / +5.0% 0.77 / 0.81 / -5.6%
tpcds_q24/datafusion:parquet 93131876 / 91176493 / +2.1% 114897266 / 116406559 / -1.3% 0.81 / 0.78 / +3.5%
tpcds_q25/datafusion:parquet 80318228 / 80742784 / -0.5% 99041717 / 97510887 / +1.6% 0.81 / 0.83 / -2.1%
tpcds_q26/datafusion:parquet 43311508 / 44002493 / -1.6% 62045833 / 62096709 / -0.1% 0.70 / 0.71 / -1.5%
tpcds_q27/datafusion:parquet 76133224 / 76810879 / -0.9% 98623143 / 96063741 / +2.7% 0.77 / 0.80 / -3.5%
tpcds_q28/datafusion:parquet 29107980 / 28961028 / +0.5% 46254458 / 45681449 / +1.3% 0.63 / 0.63 / -0.7%
tpcds_q29/datafusion:parquet 75255588 / 75171357 / +0.1% 94922200 / 97150815 / -2.3% 0.79 / 0.77 / +2.5%
tpcds_q30/datafusion:parquet 44762002 / 45677145 / -2.0% 59554444 / 60017705 / -0.8% 0.75 / 0.76 / -1.2%
tpcds_q31/datafusion:parquet 79428640 / 81956428 / -3.1% 99805997 / 100991467 / -1.2% 0.80 / 0.81 / -1.9%
tpcds_q32/datafusion:parquet 26323074 / 26708132 / -1.4% 40882141 / 42189882 / -3.1% 0.64 / 0.63 / +1.7%
tpcds_q33/datafusion:parquet 37222004 / 37129691 / +0.2% 53856507 / 55293405 / -2.6% 0.69 / 0.67 / +2.9%
tpcds_q34/datafusion:parquet 24990552 / 24993678 / -0.0% 36698255 / 36148521 / +1.5% 0.68 / 0.69 / -1.5%
tpcds_q35/datafusion:parquet 50526845 / 51589754 / -2.1% 63757786 / 65203220 / -2.2% 0.79 / 0.79 / +0.2%
tpcds_q36/datafusion:parquet 52543670 / 53182810 / -1.2% 72975745 / 71686752 / +1.8% 0.72 / 0.74 / -2.9%
tpcds_q37/datafusion:parquet 21255957 / 21482900 / -1.1% 34519007 / 34872987 / -1.0% 0.62 / 0.62 / -0.0%
tpcds_q38/datafusion:parquet 45661786 / 44849098 / +1.8% 64673481 / 63183805 / +2.4% 0.71 / 0.71 / -0.5%
tpcds_q39/datafusion:parquet 67899980 / 68267004 / -0.5% 86165435 / 85606996 / +0.7% 0.79 / 0.80 / -1.2%
tpcds_q40/datafusion:parquet 31941622 / 32054252 / -0.4% 50017662 / 51512000 / -2.9% 0.64 / 0.62 / +2.6%
tpcds_q41/datafusion:parquet 19733198 / 19307541 / +2.2% 31775095 / 32825015 / -3.2% 0.62 / 0.59 / +5.6%
tpcds_q42/datafusion:parquet 18154291 / 18320024 / -0.9% 31462220 / 30252061 / +4.0% 0.58 / 0.61 / -4.7%
tpcds_q43/datafusion:parquet 19363838 / 19511224 / -0.8% 32259532 / 32227148 / +0.1% 0.60 / 0.61 / -0.9%
tpcds_q44/datafusion:parquet 35329678 / 36121738 / -2.2% 50163974 / 51018977 / -1.7% 0.70 / 0.71 / -0.5%
tpcds_q45/datafusion:parquet 27911283 / 28070662 / -0.6% 41391130 / 41405229 / -0.0% 0.67 / 0.68 / -0.5%
tpcds_q46/datafusion:parquet 29720464 / 29642790 / +0.3% 45818846 / 46818145 / -2.1% 0.65 / 0.63 / +2.4%
tpcds_q47/datafusion:parquet 99181869 / 99038958 / +0.1% 119825520 / 123342045 / -2.9% 0.83 / 0.80 / +3.1%
tpcds_q48/datafusion:parquet 41786598 / 42205598 / -1.0% 61616867 / 60021779 / +2.7% 0.68 / 0.70 / -3.6%
tpcds_q49/datafusion:parquet 76112966 / 71922664 / +5.8% 94820770 / 96705813 / -1.9% 0.80 / 0.74 / +7.9%
tpcds_q50/datafusion:parquet 47585565 / 48200996 / -1.3% 66228306 / 68269833 / -3.0% 0.72 / 0.71 / +1.8%
tpcds_q51/datafusion:parquet 75752174 / 75638250 / +0.2% 94302223 / 96923079 / -2.7% 0.80 / 0.78 / +2.9%
tpcds_q52/datafusion:parquet 18556626 / 19016806 / -2.4% 31199129 / 31743020 / -1.7% 0.59 / 0.60 / -0.7%
tpcds_q53/datafusion:parquet 22868814 / 22775802 / +0.4% 39865891 / 38090347 / +4.7% 0.57 / 0.60 / -4.1%
tpcds_q54/datafusion:parquet 52849174 / 52865716 / -0.0% 70727206 / 72356067 / -2.3% 0.75 / 0.73 / +2.3%
tpcds_q55/datafusion:parquet 18495590 / 18350456 / +0.8% 31167226 / 31716780 / -1.7% 0.59 / 0.58 / +2.6%
tpcds_q56/datafusion:parquet 41700787 / 41674734 / +0.1% 55207718 / 55931435 / -1.3% 0.76 / 0.75 / +1.4%
tpcds_q57/datafusion:parquet 101924229 / 102267872 / -0.3% 118363966 / 121250989 / -2.4% 0.86 / 0.84 / +2.1%
tpcds_q58/datafusion:parquet 65689285 / 67052007 / -2.0% 80809280 / 83909098 / -3.7% 0.81 / 0.80 / +1.7%
tpcds_q59/datafusion:parquet 48627175 / 48071272 / +1.2% 67314970 / 66587585 / +1.1% 0.72 / 0.72 / +0.1%
tpcds_q60/datafusion:parquet 40037976 / 43072976 / -7.0% 54234939 / 55690424 / -2.6% 0.74 / 0.77 / -4.6%
tpcds_q61/datafusion:parquet 37332366 / 35900170 / +4.0% 53690142 / 54039356 / -0.6% 0.70 / 0.66 / +4.7%
tpcds_q62/datafusion:parquet 25553504 / 25510662 / +0.2% 39118482 / 38796879 / +0.8% 0.65 / 0.66 / -0.7%
tpcds_q63/datafusion:parquet 22491870 / 22373250 / +0.5% 38183240 / 37719759 / +1.2% 0.59 / 0.59 / -0.7%
tpcds_q64/datafusion:parquet 288451306 / 288437912 / +0.0% 327566314 / 329935952 / -0.7% 0.88 / 0.87 / +0.7%
tpcds_q65/datafusion:parquet 123394534 / 124892312 / -1.2% 137884551 / 134371246 / +2.6% 0.89 / 0.93 / -3.7%
tpcds_q66/datafusion:parquet 61044490 / 60301700 / +1.2% 77154372 / 77666088 / -0.7% 0.79 / 0.78 / +1.9%
tpcds_q67/datafusion:parquet 69051472 / 69234004 / -0.3% 91461012 / 94476245 / -3.2% 0.75 / 0.73 / +3.0%
tpcds_q68/datafusion:parquet 29625800 / 29881938 / -0.9% 48656511 / 48435063 / +0.5% 0.61 / 0.62 / -1.3%
tpcds_q69/datafusion:parquet 43850700 / 44880134 / -2.3% 59452107 / 56514119 / +5.2% 0.74 / 0.79 / -7.1%
tpcds_q70/datafusion:parquet 82785960 / 83144223 / -0.4% 99793283 / 100502326 / -0.7% 0.83 / 0.83 / +0.3%
tpcds_q71/datafusion:parquet 26363180 / 26209444 / +0.6% 38724457 / 37963632 / +2.0% 0.68 / 0.69 / -1.4%
tpcds_q72/datafusion:parquet 522922918 / 522333654 / +0.1% 547345462 / 549548674 / -0.4% 0.96 / 0.95 / +0.5%
tpcds_q73/datafusion:parquet 23931346 / 24275552 / -1.4% 36114370 / 36353477 / -0.7% 0.66 / 0.67 / -0.8%
tpcds_q74/datafusion:parquet 70589534 / 71671286 / -1.5% 88864840 / 93336564 / -4.8% 0.79 / 0.77 / +3.4%
tpcds_q75/datafusion:parquet 151746135 / 152044284 / -0.2% 176906087 / 181876450 / -2.7% 0.86 / 0.84 / +2.6%
tpcds_q76/datafusion:parquet 33214732 / 34368010 / -3.4% 47734164 / 48079693 / -0.7% 0.70 / 0.71 / -2.7%
tpcds_q77/datafusion:parquet 55710314 / 56776356 / -1.9% 74733323 / 75571746 / -1.1% 0.75 / 0.75 / -0.8%
tpcds_q78/datafusion:parquet 85697384 / 87446721 / -2.0% 118237877 / 119128845 / -0.7% 0.72 / 0.73 / -1.3%
tpcds_q79/datafusion:parquet 27171011 / 27237534 / -0.2% 41403713 / 41784300 / -0.9% 0.66 / 0.65 / +0.7%
tpcds_q80/datafusion:parquet 80895868 / 83359577 / -3.0% 110380252 / 109926486 / +0.4% 0.73 / 0.76 / -3.4%
tpcds_q81/datafusion:parquet 40126648 / 38622397 / +3.9% 51598653 / 54182124 / -4.8% 0.78 / 0.71 / +9.1%
tpcds_q82/datafusion:parquet 21862070 / 22796204 / -4.1% 35718502 / 36447746 / -2.0% 0.61 / 0.63 / -2.1%
tpcds_q83/datafusion:parquet 59066558 / 58361226 / +1.2% 73538008 / 74594603 / -1.4% 0.80 / 0.78 / +2.7%
tpcds_q84/datafusion:parquet 26686892 / 27149690 / -1.7% 42179811 / 42828961 / -1.5% 0.63 / 0.63 / -0.2%
tpcds_q85/datafusion:parquet 81541406 / 82951410 / -1.7% 103698733 / 105068648 / -1.3% 0.79 / 0.79 / -0.4%
tpcds_q86/datafusion:parquet 20826740 / 21068771 / -1.1% 33418430 / 32873085 / +1.7% 0.62 / 0.64 / -2.8%
tpcds_q87/datafusion:parquet 44426336 / 45322896 / -2.0% 62766063 / 62417510 / +0.6% 0.71 / 0.73 / -2.5%
tpcds_q88/datafusion:parquet 37219464 / 38885922 / -4.3% 53595995 / 52789475 / +1.5% 0.69 / 0.74 / -5.7%
tpcds_q89/datafusion:parquet 25778868 / 26203610 / -1.6% 41121038 / 43045223 / -4.5% 0.63 / 0.61 / +3.0%
tpcds_q90/datafusion:parquet 14489943 / 14962488 / -3.2% 29331469 / 29084247 / +0.9% 0.49 / 0.51 / -4.0%
tpcds_q91/datafusion:parquet 32030428 / 31924935 / +0.3% 46173660 / 46447030 / -0.6% 0.69 / 0.69 / +0.9%
tpcds_q92/datafusion:parquet 26931594 / 27063092 / -0.5% 41866629 / 43014141 / -2.7% 0.64 / 0.63 / +2.2%
tpcds_q93/datafusion:parquet 27423320 / 27750978 / -1.2% 47116002 / 46839598 / +0.6% 0.58 / 0.59 / -1.8%
tpcds_q94/datafusion:parquet 35978776 / 35794619 / +0.5% 49958855 / 49807540 / +0.3% 0.72 / 0.72 / +0.2%
tpcds_q95/datafusion:parquet 65088026 / 65261790 / -0.3% 81042160 / 78310912 / +3.5% 0.80 / 0.83 / -3.6%
tpcds_q96/datafusion:parquet 12674110 / 12502102 / +1.4% 24169958 / 26628290 / -9.2% 0.52 / 0.47 / +11.7%
tpcds_q97/datafusion:parquet 35904410 / 36513596 / -1.7% 52491706 / 53235844 / -1.4% 0.68 / 0.69 / -0.3%
tpcds_q98/datafusion:parquet 25018468 / 25127676 / -0.4% 39976637 / 38452421 / +4.0% 0.63 / 0.65 / -4.2%
tpcds_q99/datafusion:parquet 30006224 / 30277574 / -0.9% 42725935 / 41984969 / +1.8% 0.70 / 0.72 / -2.6%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15673511 / 15623466 / +0.3% 24766223 / 24367968 / +1.6% 0.63 / 0.64 / -1.3%
tpcds_q02/duckdb:vortex-file-compressed 15411954 / 15341840 / +0.5% 22619646 / 22469497 / +0.7% 0.68 / 0.68 / -0.2%
tpcds_q03/duckdb:vortex-file-compressed 6838637 / 6684331 / +2.3% 15305000 / 16445357 / -6.9% 0.45 / 0.41 / +9.9%
tpcds_q04/duckdb:vortex-file-compressed 44757558 / 44545482 / +0.5% 53992271 / 53737546 / +0.5% 0.83 / 0.83 / +0.0%
tpcds_q05/duckdb:vortex-file-compressed 22566730 / 22843930 / -1.2% 30017946 / 31165019 / -3.7% 0.75 / 0.73 / +2.6%
tpcds_q06/duckdb:vortex-file-compressed 23399960 / 23363532 / +0.2% 37755797 / 37702208 / +0.1% 0.62 / 0.62 / +0.0%
tpcds_q07/duckdb:vortex-file-compressed 13905260 / 13489761 / +3.1% 23980546 / 26428809 / -9.3% 0.58 / 0.51 / +13.6%
tpcds_q08/duckdb:vortex-file-compressed 16940844 / 16782879 / +0.9% 24559749 / 25051870 / -2.0% 0.69 / 0.67 / +3.0%
tpcds_q09/duckdb:vortex-file-compressed 18280700 / 17610436 / +3.8% 27879030 / 27933722 / -0.2% 0.66 / 0.63 / +4.0%
tpcds_q10/duckdb:vortex-file-compressed 26510596 / 26505577 / +0.0% 39737698 / 40780026 / -2.6% 0.67 / 0.65 / +2.6%
tpcds_q11/duckdb:vortex-file-compressed 35855238 / 36088330 / -0.6% 44130844 / 44242728 / -0.3% 0.81 / 0.82 / -0.4%
tpcds_q12/duckdb:vortex-file-compressed 9589590 / 9853857 / -2.7% 15878468 / 16836591 / -5.7% 0.60 / 0.59 / +3.2%
tpcds_q13/duckdb:vortex-file-compressed 20920790 / 20290056 / +3.1% 32071189 / 33820388 / -5.2% 0.65 / 0.60 / +8.7%
tpcds_q14/duckdb:vortex-file-compressed 54539904 / 54906736 / -0.7% 63513157 / 64881988 / -2.1% 0.86 / 0.85 / +1.5%
tpcds_q15/duckdb:vortex-file-compressed 24434165 / 24501008 / -0.3% 31471339 / 31153568 / +1.0% 0.78 / 0.79 / -1.3%
tpcds_q16/duckdb:vortex-file-compressed 23659188 / 23747752 / -0.4% 34652077 / 35954194 / -3.6% 0.68 / 0.66 / +3.4%
tpcds_q17/duckdb:vortex-file-compressed 24768049 / 25301823 / -2.1% 38702147 / 40963519 / -5.5% 0.64 / 0.62 / +3.6%
tpcds_q18/duckdb:vortex-file-compressed 30728636 / 30262232 / +1.5% 40258817 / 41966213 / -4.1% 0.76 / 0.72 / +5.8%
tpcds_q19/duckdb:vortex-file-compressed 77725090 / 78114728 / -0.5% 88055837 / 91327763 / -3.6% 0.88 / 0.86 / +3.2%
tpcds_q20/duckdb:vortex-file-compressed 10543282 / 10416348 / +1.2% 17271719 / 17320877 / -0.3% 0.61 / 0.60 / +1.5%
tpcds_q21/duckdb:vortex-file-compressed 10529894 / 10188668 / +3.3% 23343083 / 22203768 / +5.1% 0.45 / 0.46 / -1.7%
tpcds_q22/duckdb:vortex-file-compressed 17673734 / 17564606 / +0.6% 27345609 / 29715096 / -8.0% 0.65 / 0.59 / +9.3%
tpcds_q23/duckdb:vortex-file-compressed 37089254 / 37272825 / -0.5% 46546845 / 49172093 / -5.3% 0.80 / 0.76 / +5.1%
tpcds_q24/duckdb:vortex-file-compressed 26505325 / 26920576 / -1.5% 38221432 / 38912252 / -1.8% 0.69 / 0.69 / +0.2%
tpcds_q25/duckdb:vortex-file-compressed 23506462 / 23152851 / +1.5% 36598630 / 38596898 / -5.2% 0.64 / 0.60 / +7.1%
tpcds_q26/duckdb:vortex-file-compressed 12943248 / 12824516 / +0.9% 20801917 / 21761357 / -4.4% 0.62 / 0.59 / +5.6%
tpcds_q27/duckdb:vortex-file-compressed 16335320 / 16183752 / +0.9% 27443388 / 27737971 / -1.1% 0.60 / 0.58 / +2.0%
tpcds_q28/duckdb:vortex-file-compressed 14727735 / 14771662 / -0.3% 23656957 / 23687637 / -0.1% 0.62 / 0.62 / -0.2%
tpcds_q29/duckdb:vortex-file-compressed 23437464 / 23197698 / +1.0% 36631333 / 37866395 / -3.3% 0.64 / 0.61 / +4.4%
tpcds_q30/duckdb:vortex-file-compressed 15755254 / 15785572 / -0.2% 24642191 / 24803937 / -0.7% 0.64 / 0.64 / +0.5%
tpcds_q31/duckdb:vortex-file-compressed 17737968 / 17986644 / -1.4% 25856597 / 26799854 / -3.5% 0.69 / 0.67 / +2.2%
tpcds_q32/duckdb:vortex-file-compressed 11376090 / 11322817 / +0.5% 20169720 / 21447300 / -6.0% 0.56 / 0.53 / +6.8%
tpcds_q33/duckdb:vortex-file-compressed 17383041 / 17493949 / -0.6% 25825216 / 26938073 / -4.1% 0.67 / 0.65 / +3.6%
tpcds_q34/duckdb:vortex-file-compressed 12179414 / 12274142 / -0.8% 21499367 / 22856570 / -5.9% 0.57 / 0.54 / +5.5%
tpcds_q35/duckdb:vortex-file-compressed 27838130 / 27717744 / +0.4% 38981027 / 39255555 / -0.7% 0.71 / 0.71 / +1.1%
tpcds_q36/duckdb:vortex-file-compressed 14307496 / 14480032 / -1.2% 24251679 / 25082775 / -3.3% 0.59 / 0.58 / +2.2%
tpcds_q37/duckdb:vortex-file-compressed 9109440 / 9273844 / -1.8% 22310362 / 23417115 / -4.7% 0.41 / 0.40 / +3.1%
tpcds_q38/duckdb:vortex-file-compressed 23693062 / 23687296 / +0.0% 30195153 / 31091542 / -2.9% 0.78 / 0.76 / +3.0%
tpcds_q39/duckdb:vortex-file-compressed 19613969 / 19764576 / -0.8% 31478921 / 31909199 / -1.3% 0.62 / 0.62 / +0.6%
tpcds_q40/duckdb:vortex-file-compressed 14227172 / 14035203 / +1.4% 21514073 / 21501244 / +0.1% 0.66 / 0.65 / +1.3%
tpcds_q41/duckdb:vortex-file-compressed 14447335 / 14604946 / -1.1% 21824997 / 21924518 / -0.5% 0.66 / 0.67 / -0.6%
tpcds_q42/duckdb:vortex-file-compressed 7196723 / 6905794 / +4.2% 15054646 / 16284319 / -7.6% 0.48 / 0.42 / +12.7%
tpcds_q43/duckdb:vortex-file-compressed 9927122 / 9818816 / +1.1% 18305258 / 18864094 / -3.0% 0.54 / 0.52 / +4.2%
tpcds_q44/duckdb:vortex-file-compressed 15189412 / 14870244 / +2.1% 24424419 / 26105198 / -6.4% 0.62 / 0.57 / +9.2%
tpcds_q45/duckdb:vortex-file-compressed 23008638 / 23197248 / -0.8% 30022462 / 31252419 / -3.9% 0.77 / 0.74 / +3.3%
tpcds_q46/duckdb:vortex-file-compressed 18988041 / 19000874 / -0.1% 26692311 / 27301183 / -2.2% 0.71 / 0.70 / +2.2%
tpcds_q47/duckdb:vortex-file-compressed 33778633 / 33557736 / +0.7% 43433552 / 43757674 / -0.7% 0.78 / 0.77 / +1.4%
tpcds_q48/duckdb:vortex-file-compressed 23316321 / 23459990 / -0.6% 35173877 / 37691085 / -6.7% 0.66 / 0.62 / +6.5%
tpcds_q49/duckdb:vortex-file-compressed 19687712 / 19629718 / +0.3% 32577694 / 33598572 / -3.0% 0.60 / 0.58 / +3.4%
tpcds_q50/duckdb:vortex-file-compressed 17361688 / 17077328 / +1.7% 29157090 / 30323104 / -3.8% 0.60 / 0.56 / +5.7%
tpcds_q51/duckdb:vortex-file-compressed 48506722 / 47815717 / +1.4% 58029346 / 76038118 / -23.7% 🟢 0.84 / 0.63 / +32.9%
tpcds_q52/duckdb:vortex-file-compressed 7077225 / 7137633 / -0.8% 15786668 / 16619747 / -5.0% 0.45 / 0.43 / +4.4%
tpcds_q53/duckdb:vortex-file-compressed 11418423 / 11385592 / +0.3% 20580562 / 22368253 / -8.0% 0.55 / 0.51 / +9.0%
tpcds_q54/duckdb:vortex-file-compressed 19942194 / 19642950 / +1.5% 30059073 / 30995961 / -3.0% 0.66 / 0.63 / +4.7%
tpcds_q55/duckdb:vortex-file-compressed 6817178 / 6620104 / +3.0% 15172013 / 15858522 / -4.3% 0.45 / 0.42 / +7.6%
tpcds_q56/duckdb:vortex-file-compressed 17784428 / 17738932 / +0.3% 26346577 / 27452026 / -4.0% 0.68 / 0.65 / +4.5%
tpcds_q57/duckdb:vortex-file-compressed 25316664 / 25050438 / +1.1% 34114639 / 33949224 / +0.5% 0.74 / 0.74 / +0.6%
tpcds_q58/duckdb:vortex-file-compressed 19497358 / 19874256 / -1.9% 27853503 / 28219169 / -1.3% 0.70 / 0.70 / -0.6%
tpcds_q59/duckdb:vortex-file-compressed 19384654 / 19337526 / +0.2% 27963652 / 27476306 / +1.8% 0.69 / 0.70 / -1.5%
tpcds_q60/duckdb:vortex-file-compressed 18259198 / 18378950 / -0.7% 27446024 / 27693015 / -0.9% 0.67 / 0.66 / +0.2%
tpcds_q61/duckdb:vortex-file-compressed 23591802 / 23315133 / +1.2% 34155655 / 33437809 / +2.1% 0.69 / 0.70 / -0.9%
tpcds_q62/duckdb:vortex-file-compressed 11740112 / 11753030 / -0.1% 18588157 / 19290962 / -3.6% 0.63 / 0.61 / +3.7%
tpcds_q63/duckdb:vortex-file-compressed 10812467 / 10930466 / -1.1% 19694558 / 20307970 / -3.0% 0.55 / 0.54 / +2.0%
tpcds_q64/duckdb:vortex-file-compressed 48953150 / 49194188 / -0.5% 68528568 / 69986243 / -2.1% 0.71 / 0.70 / +1.6%
tpcds_q65/duckdb:vortex-file-compressed 14747321 / 15076981 / -2.2% 23707884 / 24104742 / -1.6% 0.62 / 0.63 / -0.5%
tpcds_q66/duckdb:vortex-file-compressed 28153821 / 29086347 / -3.2% 38014049 / 38957179 / -2.4% 0.74 / 0.75 / -0.8%
tpcds_q67/duckdb:vortex-file-compressed 57901048 / 57610523 / +0.5% 68419758 / 68970652 / -0.8% 0.85 / 0.84 / +1.3%
tpcds_q68/duckdb:vortex-file-compressed 18818502 / 18512412 / +1.7% 26738470 / 27546928 / -2.9% 0.70 / 0.67 / +4.7%
tpcds_q69/duckdb:vortex-file-compressed 21746887 / 21747334 / -0.0% 37395546 / 36854500 / +1.5% 0.58 / 0.59 / -1.4%
tpcds_q70/duckdb:vortex-file-compressed 15389359 / 15461772 / -0.5% 24883028 / 25921308 / -4.0% 0.62 / 0.60 / +3.7%
tpcds_q71/duckdb:vortex-file-compressed 12713516 / 13066656 / -2.7% 22113838 / 22333770 / -1.0% 0.57 / 0.59 / -1.7%
tpcds_q72/duckdb:vortex-file-compressed 54860288 / 54503664 / +0.7% 69117125 / 69975182 / -1.2% 0.79 / 0.78 / +1.9%
tpcds_q73/duckdb:vortex-file-compressed 11079273 / 11306518 / -2.0% 20168232 / 20929258 / -3.6% 0.55 / 0.54 / +1.7%
tpcds_q74/duckdb:vortex-file-compressed 25712758 / 25824258 / -0.4% 32828752 / 32618953 / +0.6% 0.78 / 0.79 / -1.1%
tpcds_q75/duckdb:vortex-file-compressed 28586496 / 28015184 / +2.0% 38163331 / 39840516 / -4.2% 0.75 / 0.70 / +6.5%
tpcds_q76/duckdb:vortex-file-compressed 12520690 / 12370076 / +1.2% 22275917 / 23260687 / -4.2% 0.56 / 0.53 / +5.7%
tpcds_q77/duckdb:vortex-file-compressed 20377998 / 19869932 / +2.6% 29873440 / 30729633 / -2.8% 0.68 / 0.65 / +5.5%
tpcds_q78/duckdb:vortex-file-compressed 43818089 / 43126046 / +1.6% 52503844 / 52915544 / -0.8% 0.83 / 0.81 / +2.4%
tpcds_q79/duckdb:vortex-file-compressed 12903986 / 12990250 / -0.7% 21458896 / 22255733 / -3.6% 0.60 / 0.58 / +3.0%
tpcds_q80/duckdb:vortex-file-compressed 35620679 / 36790280 / -3.2% 50206452 / 49024536 / +2.4% 0.71 / 0.75 / -5.5%
tpcds_q81/duckdb:vortex-file-compressed 20881499 / 20634284 / +1.2% 29261297 / 29141543 / +0.4% 0.71 / 0.71 / +0.8%
tpcds_q82/duckdb:vortex-file-compressed 9567842 / 9209767 / +3.9% 22025916 / 23638343 / -6.8% 0.43 / 0.39 / +11.5%
tpcds_q83/duckdb:vortex-file-compressed 17128572 / 17358052 / -1.3% 23830757 / 23996605 / -0.7% 0.72 / 0.72 / -0.6%
tpcds_q84/duckdb:vortex-file-compressed 15604640 / 15476273 / +0.8% 22479640 / 23553269 / -4.6% 0.69 / 0.66 / +5.6%
tpcds_q85/duckdb:vortex-file-compressed 24320079 / 24443899 / -0.5% 37125693 / 39160140 / -5.2% 0.66 / 0.62 / +4.9%
tpcds_q86/duckdb:vortex-file-compressed 9541855 / 9593923 / -0.5% 16334511 / 16172040 / +1.0% 0.58 / 0.59 / -1.5%
tpcds_q87/duckdb:vortex-file-compressed 25169028 / 25111522 / +0.2% 31859456 / 31549784 / +1.0% 0.79 / 0.80 / -0.7%
tpcds_q88/duckdb:vortex-file-compressed 36499744 / 37034187 / -1.4% 47030529 / 46465979 / +1.2% 0.78 / 0.80 / -2.6%
tpcds_q89/duckdb:vortex-file-compressed 11867758 / 11921590 / -0.5% 21798927 / 22282893 / -2.2% 0.54 / 0.54 / +1.8%
tpcds_q90/duckdb:vortex-file-compressed 8967609 / 8650530 / +3.7% 15488528 / 14881311 / +4.1% 0.58 / 0.58 / -0.4%
tpcds_q91/duckdb:vortex-file-compressed 13611996 / 13751878 / -1.0% 20915546 / 21559626 / -3.0% 0.65 / 0.64 / +2.0%
tpcds_q92/duckdb:vortex-file-compressed 11756039 / 11577185 / +1.5% 20408586 / 20594655 / -0.9% 0.58 / 0.56 / +2.5%
tpcds_q93/duckdb:vortex-file-compressed 10479434 / 10474570 / +0.0% 24081555 / 26369072 / -8.7% 0.44 / 0.40 / +9.5%
tpcds_q94/duckdb:vortex-file-compressed 21911522 / 22079880 / -0.8% 31464087 / 32057398 / -1.9% 0.70 / 0.69 / +1.1%
tpcds_q95/duckdb:vortex-file-compressed 40051167 / 40190831 / -0.3% 51222355 / 52541742 / -2.5% 0.78 / 0.76 / +2.2%
tpcds_q96/duckdb:vortex-file-compressed 6609908 / 6703031 / -1.4% 14861666 / 15821546 / -6.1% 0.44 / 0.42 / +5.0%
tpcds_q97/duckdb:vortex-file-compressed 22953734 / 23151693 / -0.9% 30557670 / 30643400 / -0.3% 0.75 / 0.76 / -0.6%
tpcds_q98/duckdb:vortex-file-compressed 10751850 / 11017366 / -2.4% 19380964 / 19841472 / -2.3% 0.55 / 0.56 / -0.1%
tpcds_q99/duckdb:vortex-file-compressed 14787344 / 15000748 / -1.4% 21869052 / 22602124 / -3.2% 0.68 / 0.66 / +1.9%
duckdb / parquet / ns (0.997x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24325654 / 24218891 / +0.4% 31246004 / 31545746 / -1.0% 0.78 / 0.77 / +1.4%
tpcds_q02/duckdb:parquet 18277994 / 18389676 / -0.6% 24301472 / 24767174 / -1.9% 0.75 / 0.74 / +1.3%
tpcds_q03/duckdb:parquet 9746633 / 9909612 / -1.6% 16023219 / 16010763 / +0.1% 0.61 / 0.62 / -1.7%
tpcds_q04/duckdb:parquet 116371846 / 116190330 / +0.2% 122899046 / 126424752 / -2.8% 0.95 / 0.92 / +3.0%
tpcds_q05/duckdb:parquet 28746488 / 28750072 / -0.0% 32693524 / 33269702 / -1.7% 0.88 / 0.86 / +1.7%
tpcds_q06/duckdb:parquet 26635288 / 26631232 / +0.0% 36578590 / 35743850 / +2.3% 0.73 / 0.75 / -2.3%
tpcds_q07/duckdb:parquet 32054678 / 31262764 / +2.5% 39101762 / 39616057 / -1.3% 0.82 / 0.79 / +3.9%
tpcds_q08/duckdb:parquet 20335930 / 20175494 / +0.8% 24487653 / 24383086 / +0.4% 0.83 / 0.83 / +0.4%
tpcds_q09/duckdb:parquet 27448142 / 28580056 / -4.0% 30451037 / 30884535 / -1.4% 0.90 / 0.93 / -2.6%
tpcds_q10/duckdb:parquet 32700758 / 32952098 / -0.8% 40609505 / 40987193 / -0.9% 0.81 / 0.80 / +0.2%
tpcds_q11/duckdb:parquet 68105636 / 68686580 / -0.8% 74755545 / 75339543 / -0.8% 0.91 / 0.91 / -0.1%
tpcds_q12/duckdb:parquet 14182098 / 14006070 / +1.3% 19204837 / 19216548 / -0.1% 0.74 / 0.73 / +1.3%
tpcds_q13/duckdb:parquet 30254916 / 30913730 / -2.1% 39968823 / 40775366 / -2.0% 0.76 / 0.76 / -0.2%
tpcds_q14/duckdb:parquet 64080142 / 64314425 / -0.4% 72572658 / 69622259 / +4.2% 0.88 / 0.92 / -4.4%
tpcds_q15/duckdb:parquet 16934174 / 16903087 / +0.2% 23050737 / 23039655 / +0.0% 0.73 / 0.73 / +0.1%
tpcds_q16/duckdb:parquet 30513406 / 30651080 / -0.4% 38088449 / 37540685 / +1.5% 0.80 / 0.82 / -1.9%
tpcds_q17/duckdb:parquet 35170851 / 35146382 / +0.1% 40346426 / 41321842 / -2.4% 0.87 / 0.85 / +2.5%
tpcds_q18/duckdb:parquet 48034774 / 47648089 / +0.8% 55633433 / 55532631 / +0.2% 0.86 / 0.86 / +0.6%
tpcds_q19/duckdb:parquet 18971774 / 19185746 / -1.1% 25437668 / 26075400 / -2.4% 0.75 / 0.74 / +1.4%
tpcds_q20/duckdb:parquet 15147915 / 15014586 / +0.9% 20139826 / 20289796 / -0.7% 0.75 / 0.74 / +1.6%
tpcds_q21/duckdb:parquet 10888210 / 10768852 / +1.1% 17199739 / 16864080 / +2.0% 0.63 / 0.64 / -0.9%
tpcds_q22/duckdb:parquet 20506047 / 20486484 / +0.1% 26800429 / 26773851 / +0.1% 0.77 / 0.77 / -0.0%
tpcds_q23/duckdb:parquet 42575436 / 43957828 / -3.1% 48080109 / 47876261 / +0.4% 0.89 / 0.92 / -3.6%
tpcds_q24/duckdb:parquet 30552844 / 30776359 / -0.7% 37283455 / 37460105 / -0.5% 0.82 / 0.82 / -0.3%
tpcds_q25/duckdb:parquet 30838684 / 30878044 / -0.1% 37370954 / 37811902 / -1.2% 0.83 / 0.82 / +1.1%
tpcds_q26/duckdb:parquet 29285587 / 29214671 / +0.2% 35090407 / 35725809 / -1.8% 0.83 / 0.82 / +2.1%
tpcds_q27/duckdb:parquet 33345961 / 35062667 / -4.9% 42340384 / 42468516 / -0.3% 0.79 / 0.83 / -4.6%
tpcds_q28/duckdb:parquet 26592824 / 27644232 / -3.8% 36055027 / 33489653 / +7.7% 0.74 / 0.83 / -10.6%
tpcds_q29/duckdb:parquet 32582948 / 34106902 / -4.5% 39299267 / 40739377 / -3.5% 0.83 / 0.84 / -1.0%
tpcds_q30/duckdb:parquet 36108720 / 36325280 / -0.6% 44707116 / 45358004 / -1.4% 0.81 / 0.80 / +0.9%
tpcds_q31/duckdb:parquet 35772150 / 35549746 / +0.6% 43453660 / 42889158 / +1.3% 0.82 / 0.83 / -0.7%
tpcds_q32/duckdb:parquet 14602877 / 14427264 / +1.2% 21377004 / 21278107 / +0.5% 0.68 / 0.68 / +0.7%
tpcds_q33/duckdb:parquet 24384886 / 26196808 / -6.9% 29769904 / 29967270 / -0.7% 0.82 / 0.87 / -6.3%
tpcds_q34/duckdb:parquet 17390476 / 17241541 / +0.9% 24679576 / 24454189 / +0.9% 0.70 / 0.71 / -0.1%
tpcds_q35/duckdb:parquet 36087780 / 35674032 / +1.2% 44928947 / 44364462 / +1.3% 0.80 / 0.80 / -0.1%
tpcds_q36/duckdb:parquet 42261106 / 41394556 / +2.1% 48487477 / 48880017 / -0.8% 0.87 / 0.85 / +2.9%
tpcds_q37/duckdb:parquet 12856580 / 12918754 / -0.5% 19420510 / 19133676 / +1.5% 0.66 / 0.68 / -2.0%
tpcds_q38/duckdb:parquet 29829196 / 29736696 / +0.3% 33769393 / 35271215 / -4.3% 0.88 / 0.84 / +4.8%
tpcds_q39/duckdb:parquet 23259540 / 23679277 / -1.8% 29855978 / 29962912 / -0.4% 0.78 / 0.79 / -1.4%
tpcds_q40/duckdb:parquet 16300887 / 16383005 / -0.5% 21602102 / 21783066 / -0.8% 0.75 / 0.75 / +0.3%
tpcds_q41/duckdb:parquet 12225586 / 12199592 / +0.2% 19268246 / 18579575 / +3.7% 0.63 / 0.66 / -3.4%
tpcds_q42/duckdb:parquet 9795218 / 9850934 / -0.6% 15646316 / 16128118 / -3.0% 0.63 / 0.61 / +2.5%
tpcds_q43/duckdb:parquet 12324445 / 12824736 / -3.9% 19156385 / 19844393 / -3.5% 0.64 / 0.65 / -0.4%
tpcds_q44/duckdb:parquet 20643794 / 21323330 / -3.2% 28950126 / 26440453 / +9.5% 0.71 / 0.81 / -11.6%
tpcds_q45/duckdb:parquet 21314997 / 21325470 / -0.0% 27993204 / 28468242 / -1.7% 0.76 / 0.75 / +1.6%
tpcds_q46/duckdb:parquet 36977507 / 36935890 / +0.1% 43685678 / 44768127 / -2.4% 0.85 / 0.83 / +2.6%
tpcds_q47/duckdb:parquet 34498204 / 34356596 / +0.4% 40625664 / 41264432 / -1.5% 0.85 / 0.83 / +2.0%
tpcds_q48/duckdb:parquet 29191642 / 30405964 / -4.0% 36970782 / 38149864 / -3.1% 0.79 / 0.80 / -0.9%
tpcds_q49/duckdb:parquet 29106188 / 29257880 / -0.5% 38319216 / 36986140 / +3.6% 0.76 / 0.79 / -4.0%
tpcds_q50/duckdb:parquet 20008138 / 20025952 / -0.1% 25777452 / 27164616 / -5.1% 0.78 / 0.74 / +5.3%
tpcds_q51/duckdb:parquet 52314528 / 52552690 / -0.5% 60885725 / 76351498 / -20.3% 🟢 0.86 / 0.69 / +24.8%
tpcds_q52/duckdb:parquet 9729936 / 9708476 / +0.2% 15506831 / 15759561 / -1.6% 0.63 / 0.62 / +1.9%
tpcds_q53/duckdb:parquet 14225404 / 14143631 / +0.6% 20802303 / 21964440 / -5.3% 0.68 / 0.64 / +6.2%
tpcds_q54/duckdb:parquet 25248268 / 25670862 / -1.6% 32401920 / 33481526 / -3.2% 0.78 / 0.77 / +1.6%
tpcds_q55/duckdb:parquet 9630247 / 9580060 / +0.5% 15504320 / 16002131 / -3.1% 0.62 / 0.60 / +3.8%
tpcds_q56/duckdb:parquet 25796622 / 26158910 / -1.4% 30564818 / 30728326 / -0.5% 0.84 / 0.85 / -0.9%
tpcds_q57/duckdb:parquet 30497542 / 30637032 / -0.5% 36514031 / 35821338 / +1.9% 0.84 / 0.86 / -2.3%
tpcds_q58/duckdb:parquet 24015754 / 24546909 / -2.2% 30638815 / 30494892 / +0.5% 0.78 / 0.80 / -2.6%
tpcds_q59/duckdb:parquet 23480264 / 23429083 / +0.2% 29594428 / 30159140 / -1.9% 0.79 / 0.78 / +2.1%
tpcds_q60/duckdb:parquet 28285999 / 26664419 / +6.1% 33539132 / 33436047 / +0.3% 0.84 / 0.80 / +5.8%
tpcds_q61/duckdb:parquet 24952111 / 24950845 / +0.0% 30152637 / 29308252 / +2.9% 0.83 / 0.85 / -2.8%
tpcds_q62/duckdb:parquet 13227289 / 13164156 / +0.5% 18365144 / 18290348 / +0.4% 0.72 / 0.72 / +0.1%
tpcds_q63/duckdb:parquet 13718888 / 13771688 / -0.4% 20319865 / 20352346 / -0.2% 0.68 / 0.68 / -0.2%
tpcds_q64/duckdb:parquet 71265769 / 72148206 / -1.2% 81213325 / 82553041 / -1.6% 0.88 / 0.87 / +0.4%
tpcds_q65/duckdb:parquet 19614010 / 19361387 / +1.3% 25126828 / 25431108 / -1.2% 0.78 / 0.76 / +2.5%
tpcds_q66/duckdb:parquet 35830077 / 35262056 / +1.6% 42400245 / 42007369 / +0.9% 0.85 / 0.84 / +0.7%
tpcds_q67/duckdb:parquet 62814344 / 68264933 / -8.0% 67741642 / 67574410 / +0.2% 0.93 / 1.01 / -8.2%
tpcds_q68/duckdb:parquet 30377469 / 28686008 / +5.9% 36804949 / 37084386 / -0.8% 0.83 / 0.77 / +6.7%
tpcds_q69/duckdb:parquet 25992350 / 26059914 / -0.3% 34427408 / 35212942 / -2.2% 0.75 / 0.74 / +2.0%
tpcds_q70/duckdb:parquet 19520400 / 19645128 / -0.6% 26490301 / 26965490 / -1.8% 0.74 / 0.73 / +1.1%
tpcds_q71/duckdb:parquet 18080530 / 17225585 / +5.0% 23754456 / 24013151 / -1.1% 0.76 / 0.72 / +6.1%
tpcds_q72/duckdb:parquet 54468462 / 55683702 / -2.2% 61180871 / 62903257 / -2.7% 0.89 / 0.89 / +0.6%
tpcds_q73/duckdb:parquet 14896654 / 15092317 / -1.3% 22006868 / 22282763 / -1.2% 0.68 / 0.68 / -0.1%
tpcds_q74/duckdb:parquet 85437128 / 84761342 / +0.8% 92719832 / 92242979 / +0.5% 0.92 / 0.92 / +0.3%
tpcds_q75/duckdb:parquet 46664106 / 44393599 / +5.1% 50784901 / 50842431 / -0.1% 0.92 / 0.87 / +5.2%
tpcds_q76/duckdb:parquet 18069400 / 19261176 / -6.2% 23603147 / 24035751 / -1.8% 0.77 / 0.80 / -4.5%
tpcds_q77/duckdb:parquet 25254986 / 25168756 / +0.3% 32189672 / 31681362 / +1.6% 0.78 / 0.79 / -1.2%
tpcds_q78/duckdb:parquet 78894274 / 78079204 / +1.0% 84818909 / 85683231 / -1.0% 0.93 / 0.91 / +2.1%
tpcds_q79/duckdb:parquet 22396427 / 22503892 / -0.5% 29400708 / 29945653 / -1.8% 0.76 / 0.75 / +1.4%
tpcds_q80/duckdb:parquet 37999544 / 36389054 / +4.4% 44252283 / 44082419 / +0.4% 0.86 / 0.83 / +4.0%
tpcds_q81/duckdb:parquet 36977716 / 36565352 / +1.1% 45255892 / 46028828 / -1.7% 0.82 / 0.79 / +2.9%
tpcds_q82/duckdb:parquet 13634550 / 13659778 / -0.2% 20634217 / 20952469 / -1.5% 0.66 / 0.65 / +1.4%
tpcds_q83/duckdb:parquet 20394269 / 20429914 / -0.2% 25725682 / 25939583 / -0.8% 0.79 / 0.79 / +0.7%
tpcds_q84/duckdb:parquet 23495043 / 23108096 / +1.7% 28770710 / 28967836 / -0.7% 0.82 / 0.80 / +2.4%
tpcds_q85/duckdb:parquet 32890547 / 32867167 / +0.1% 39649407 / 40277504 / -1.6% 0.83 / 0.82 / +1.7%
tpcds_q86/duckdb:parquet 11895886 / 12056118 / -1.3% 17023850 / 17415602 / -2.2% 0.70 / 0.69 / +0.9%
tpcds_q87/duckdb:parquet 31503658 / 31812086 / -1.0% 35815446 / 35977604 / -0.5% 0.88 / 0.88 / -0.5%
tpcds_q88/duckdb:parquet 39645548 / 39495554 / +0.4% 50200845 / 47389544 / +5.9% 0.79 / 0.83 / -5.2%
tpcds_q89/duckdb:parquet 14450941 / 14376178 / +0.5% 21631842 / 22220638 / -2.6% 0.67 / 0.65 / +3.3%
tpcds_q90/duckdb:parquet 10143070 / 10317570 / -1.7% 15695705 / 15213733 / +3.2% 0.65 / 0.68 / -4.7%
tpcds_q91/duckdb:parquet 21348358 / 21497720 / -0.7% 29016002 / 28981922 / +0.1% 0.74 / 0.74 / -0.8%
tpcds_q92/duckdb:parquet 15938253 / 15854490 / +0.5% 22475865 / 22433569 / +0.2% 0.71 / 0.71 / +0.3%
tpcds_q93/duckdb:parquet 14222956 / 14155638 / +0.5% 20407308 / 20576468 / -0.8% 0.70 / 0.69 / +1.3%
tpcds_q94/duckdb:parquet 25665117 / 25993929 / -1.3% 32611828 / 33304185 / -2.1% 0.79 / 0.78 / +0.8%
tpcds_q95/duckdb:parquet 43873900 / 43997794 / -0.3% 49006959 / 50050013 / -2.1% 0.90 / 0.88 / +1.8%
tpcds_q96/duckdb:parquet 9257686 / 8403560 / +10.2% 🔴 13956211 / 14010933 / -0.4% 0.66 / 0.60 / +10.6%
tpcds_q97/duckdb:parquet 27590566 / 27741402 / -0.5% 34545103 / 34077374 / +1.4% 0.80 / 0.81 / -1.9%
tpcds_q98/duckdb:parquet 16743059 / 16733441 / +0.1% 24039772 / 24433406 / -1.6% 0.70 / 0.68 / +1.7%
tpcds_q99/duckdb:parquet 19160336 / 19262824 / -0.5% 24632505 / 24277613 / +1.5% 0.78 / 0.79 / -2.0%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR a47ec03e vs base 91b38f41
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.957x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.988x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1274614 / 1259764 / +1.2% 20601370 / 21840901 / -5.7% 0.06 / 0.06 / +7.3%
clickbench_q01/datafusion:vortex-file-compressed 6368588 / 6070274 / +4.9% 26571704 / 32193320 / -17.5% 🟢 0.24 / 0.19 / +27.1%
clickbench_q02/datafusion:vortex-file-compressed 9497626 / 9726968 / -2.4% 38131246 / 36285295 / +5.1% 0.25 / 0.27 / -7.1%
clickbench_q03/datafusion:vortex-file-compressed 10769938 / 11479392 / -6.2% 51121319 / 54110241 / -5.5% 0.21 / 0.21 / -0.7%
clickbench_q04/datafusion:vortex-file-compressed 54305865 / 55807226 / -2.7% 88154775 / 92295458 / -4.5% 0.62 / 0.60 / +1.9%
clickbench_q05/datafusion:vortex-file-compressed 73756476 / 75882252 / -2.8% 112475485 / 117842244 / -4.6% 0.66 / 0.64 / +1.8%
clickbench_q06/datafusion:vortex-file-compressed 1264634 / 1276858 / -1.0% 20708809 / 22803679 / -9.2% 0.06 / 0.06 / +9.1%
clickbench_q07/datafusion:vortex-file-compressed 9174884 / 8979054 / +2.2% 30121350 / 32729233 / -8.0% 0.30 / 0.27 / +11.0%
clickbench_q08/datafusion:vortex-file-compressed 75737830 / 75161192 / +0.8% 111911400 / 115195871 / -2.9% 0.68 / 0.65 / +3.7%
clickbench_q09/datafusion:vortex-file-compressed 169209020 / 167976525 / +0.7% 206045058 / 208668055 / -1.3% 0.82 / 0.80 / +2.0%
clickbench_q10/datafusion:vortex-file-compressed 22001093 / 23581434 / -6.7% 62929193 / 70011873 / -10.1% 🟢 0.35 / 0.34 / +3.8%
clickbench_q11/datafusion:vortex-file-compressed 25034070 / 25315940 / -1.1% 64597985 / 69110728 / -6.5% 0.39 / 0.37 / +5.8%
clickbench_q12/datafusion:vortex-file-compressed 72083468 / 72345214 / -0.4% 119148422 / 117706760 / +1.2% 0.60 / 0.61 / -1.6%
clickbench_q13/datafusion:vortex-file-compressed 117311409 / 118577245 / -1.1% 171450420 / 177813688 / -3.6% 0.68 / 0.67 / +2.6%
clickbench_q14/datafusion:vortex-file-compressed 76590500 / 77024296 / -0.6% 119111514 / 121460809 / -1.9% 0.64 / 0.63 / +1.4%
clickbench_q15/datafusion:vortex-file-compressed 61788950 / 60281139 / +2.5% 93601365 / 97536044 / -4.0% 0.66 / 0.62 / +6.8%
clickbench_q16/datafusion:vortex-file-compressed 148493482 / 151519262 / -2.0% 202069770 / 203250513 / -0.6% 0.73 / 0.75 / -1.4%
clickbench_q17/datafusion:vortex-file-compressed 152261791 / 148846058 / +2.3% 213773947 / 212793869 / +0.5% 0.71 / 0.70 / +1.8%
clickbench_q18/datafusion:vortex-file-compressed 289814056 / 294351256 / -1.5% 374063840 / 383121167 / -2.4% 0.77 / 0.77 / +0.8%
clickbench_q19/datafusion:vortex-file-compressed 7672696 / 7589149 / +1.1% 46614403 / 49894433 / -6.6% 0.16 / 0.15 / +8.2%
clickbench_q20/datafusion:vortex-file-compressed 61752238 / 61362058 / +0.6% 223089873 / 235224534 / -5.2% 0.28 / 0.26 / +6.1%
clickbench_q21/datafusion:vortex-file-compressed 87317520 / 91128932 / -4.2% 263904588 / 271011778 / -2.6% 0.33 / 0.34 / -1.6%
clickbench_q22/datafusion:vortex-file-compressed 96586002 / 98952414 / -2.4% 338409894 / 347049702 / -2.5% 0.29 / 0.29 / +0.1%
clickbench_q23/datafusion:vortex-file-compressed 187442252 / 197331288 / -5.0% 496027742 / 405239242 / +22.4% 🔴 0.38 / 0.49 / -22.4%
clickbench_q24/datafusion:vortex-file-compressed 15914441 / 15354366 / +3.6% 63583632 / 69870899 / -9.0% 0.25 / 0.22 / +13.9%
clickbench_q25/datafusion:vortex-file-compressed 18066365 / 17717502 / +2.0% 53490820 / 56570377 / -5.4% 0.34 / 0.31 / +7.8%
clickbench_q26/datafusion:vortex-file-compressed 15726089 / 15866930 / -0.9% 60278265 / 67643275 / -10.9% 🟢 0.26 / 0.23 / +11.2%
clickbench_q27/datafusion:vortex-file-compressed 95922181 / 96729264 / -0.8% 243083137 / 241249582 / +0.8% 0.39 / 0.40 / -1.6%
clickbench_q28/datafusion:vortex-file-compressed 553445722 / 561691190 / -1.5% 616708643 / 621723637 / -0.8% 0.90 / 0.90 / -0.7%
clickbench_q29/datafusion:vortex-file-compressed 22906042 / 23263484 / -1.5% 46981164 / 49574241 / -5.2% 0.49 / 0.47 / +3.9%
clickbench_q30/datafusion:vortex-file-compressed 56125844 / 56265428 / -0.2% 102655843 / 113802625 / -9.8% 0.55 / 0.49 / +10.6%
clickbench_q31/datafusion:vortex-file-compressed 67682948 / 67661358 / +0.0% 151136894 / 152034150 / -0.6% 0.45 / 0.45 / +0.6%
clickbench_q32/datafusion:vortex-file-compressed 283962765 / 289940034 / -2.1% 388748862 / 390693580 / -0.5% 0.73 / 0.74 / -1.6%
clickbench_q33/datafusion:vortex-file-compressed 319522754 / 322200973 / -0.8% 409577040 / 421844520 / -2.9% 0.78 / 0.76 / +2.1%
clickbench_q34/datafusion:vortex-file-compressed 314529827 / 319728942 / -1.6% 424939373 / 420835935 / +1.0% 0.74 / 0.76 / -2.6%
clickbench_q35/datafusion:vortex-file-compressed 55374816 / 54389272 / +1.8% 87482808 / 88301633 / -0.9% 0.63 / 0.62 / +2.8%
clickbench_q36/datafusion:vortex-file-compressed 37562258 / 37459468 / +0.3% 63044911 / 65053612 / -3.1% 0.60 / 0.58 / +3.5%
clickbench_q37/datafusion:vortex-file-compressed 21623520 / 21537792 / +0.4% 46366404 / 48361339 / -4.1% 0.47 / 0.45 / +4.7%
clickbench_q38/datafusion:vortex-file-compressed 11602406 / 11567984 / +0.3% 36824106 / 39855573 / -7.6% 0.32 / 0.29 / +8.6%
clickbench_q39/datafusion:vortex-file-compressed 76941436 / 77429327 / -0.6% 108194088 / 110867765 / -2.4% 0.71 / 0.70 / +1.8%
clickbench_q40/datafusion:vortex-file-compressed 11176833 / 11126175 / +0.5% 35959853 / 37440864 / -4.0% 0.31 / 0.30 / +4.6%
clickbench_q41/datafusion:vortex-file-compressed 10475587 / 10636923 / -1.5% 34689771 / 35249872 / -1.6% 0.30 / 0.30 / +0.1%
clickbench_q42/datafusion:vortex-file-compressed 10706310 / 11244806 / -4.8% 33862072 / 37096531 / -8.7% 0.32 / 0.30 / +4.3%
datafusion / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1268229 / 1279406 / -0.9% 48888675 / 51535276 / -5.1% 0.03 / 0.02 / +4.5%
clickbench_q01/datafusion:parquet 15734640 / 15759099 / -0.2% 72621811 / 72520800 / +0.1% 0.22 / 0.22 / -0.3%
clickbench_q02/datafusion:parquet 19169955 / 18786968 / +2.0% 81652163 / 82468731 / -1.0% 0.23 / 0.23 / +3.1%
clickbench_q03/datafusion:parquet 16616877 / 17388248 / -4.4% 78308128 / 81018602 / -3.3% 0.21 / 0.21 / -1.1%
clickbench_q04/datafusion:parquet 62585768 / 63689132 / -1.7% 123548750 / 129147887 / -4.3% 0.51 / 0.49 / +2.7%
clickbench_q05/datafusion:parquet 88024784 / 87758379 / +0.3% 156556901 / 157467945 / -0.6% 0.56 / 0.56 / +0.9%
clickbench_q06/datafusion:parquet 1285141 / 1295564 / -0.8% 49062119 / 50650073 / -3.1% 0.03 / 0.03 / +2.4%
clickbench_q07/datafusion:parquet 16540388 / 16951047 / -2.4% 67189718 / 69549068 / -3.4% 0.25 / 0.24 / +1.0%
clickbench_q08/datafusion:parquet 82886044 / 83979472 / -1.3% 159837103 / 168707049 / -5.3% 0.52 / 0.50 / +4.2%
clickbench_q09/datafusion:parquet 185885066 / 190051148 / -2.2% 273563687 / 267258448 / +2.4% 0.68 / 0.71 / -4.4%
clickbench_q10/datafusion:parquet 36477830 / 36130068 / +1.0% 100435041 / 101266660 / -0.8% 0.36 / 0.36 / +1.8%
clickbench_q11/datafusion:parquet 43474894 / 43064712 / +1.0% 110107403 / 111967866 / -1.7% 0.39 / 0.38 / +2.7%
clickbench_q12/datafusion:parquet 94910095 / 95466230 / -0.6% 159522197 / 163595374 / -2.5% 0.59 / 0.58 / +2.0%
clickbench_q13/datafusion:parquet 148419616 / 148525347 / -0.1% 227085509 / 229131299 / -0.9% 0.65 / 0.65 / +0.8%
clickbench_q14/datafusion:parquet 101635058 / 101583116 / +0.1% 173135120 / 174350594 / -0.7% 0.59 / 0.58 / +0.8%
clickbench_q15/datafusion:parquet 71774328 / 73701879 / -2.6% 127995769 / 133874700 / -4.4% 0.56 / 0.55 / +1.9%
clickbench_q16/datafusion:parquet 155829418 / 158693329 / -1.8% 233224380 / 236803806 / -1.5% 0.67 / 0.67 / -0.3%
clickbench_q17/datafusion:parquet 157173232 / 155237318 / +1.2% 229863657 / 242038100 / -5.0% 0.68 / 0.64 / +6.6%
clickbench_q18/datafusion:parquet 306917944 / 310297458 / -1.1% 412700066 / 428891760 / -3.8% 0.74 / 0.72 / +2.8%
clickbench_q19/datafusion:parquet 18772371 / 19071124 / -1.6% 74634712 / 77193688 / -3.3% 0.25 / 0.25 / +1.8%
clickbench_q20/datafusion:parquet 176789008 / 178342749 / -0.9% 293310712 / 298748754 / -1.8% 0.60 / 0.60 / +1.0%
clickbench_q21/datafusion:parquet 172283476 / 173272788 / -0.6% 308680383 / 317030594 / -2.6% 0.56 / 0.55 / +2.1%
clickbench_q22/datafusion:parquet 258469510 / 263445378 / -1.9% 446362398 / 454342353 / -1.8% 0.58 / 0.58 / -0.1%
clickbench_q23/datafusion:parquet 1004781802 / 1011964122 / -0.7% 1181061531 / 1209064786 / -2.3% 0.85 / 0.84 / +1.6%
clickbench_q24/datafusion:parquet 29575585 / 30481874 / -3.0% 85140681 / 91083117 / -6.5% 0.35 / 0.33 / +3.8%
clickbench_q25/datafusion:parquet 36330534 / 36676365 / -0.9% 97507396 / 106760291 / -8.7% 0.37 / 0.34 / +8.5%
clickbench_q26/datafusion:parquet 30560676 / 30750142 / -0.6% 85659305 / 91531570 / -6.4% 0.36 / 0.34 / +6.2%
clickbench_q27/datafusion:parquet 193158550 / 193829416 / -0.3% 284453547 / 306877985 / -7.3% 0.68 / 0.63 / +7.5%
clickbench_q28/datafusion:parquet 615120304 / 620164196 / -0.8% 694693233 / 720455906 / -3.6% 0.89 / 0.86 / +2.9%
clickbench_q29/datafusion:parquet 29684104 / 29769974 / -0.3% 87759759 / 90754365 / -3.3% 0.34 / 0.33 / +3.1%
clickbench_q30/datafusion:parquet 90564336 / 91234230 / -0.7% 165820315 / 173722783 / -4.5% 0.55 / 0.53 / +4.0%
clickbench_q31/datafusion:parquet 102517392 / 104426477 / -1.8% 189925276 / 202687148 / -6.3% 0.54 / 0.52 / +4.8%
clickbench_q32/datafusion:parquet 311619714 / 308400415 / +1.0% 429879156 / 424926368 / +1.2% 0.72 / 0.73 / -0.1%
clickbench_q33/datafusion:parquet 376150766 / 378086212 / -0.5% 473646671 / 477150538 / -0.7% 0.79 / 0.79 / +0.2%
clickbench_q34/datafusion:parquet 376976180 / 377902534 / -0.2% 471348976 / 482767486 / -2.4% 0.80 / 0.78 / +2.2%
clickbench_q35/datafusion:parquet 63562172 / 65006452 / -2.2% 125017492 / 124336245 / +0.5% 0.51 / 0.52 / -2.8%
clickbench_q36/datafusion:parquet 73412612 / 73927418 / -0.7% 133287269 / 137144953 / -2.8% 0.55 / 0.54 / +2.2%
clickbench_q37/datafusion:parquet 35401560 / 35558072 / -0.4% 90630139 / 92855875 / -2.4% 0.39 / 0.38 / +2.0%
clickbench_q38/datafusion:parquet 47325001 / 47568298 / -0.5% 105252991 / 107383793 / -2.0% 0.45 / 0.44 / +1.5%
clickbench_q39/datafusion:parquet 143823494 / 143022314 / +0.6% 205980508 / 212317226 / -3.0% 0.70 / 0.67 / +3.7%
clickbench_q40/datafusion:parquet 19905300 / 19951456 / -0.2% 75885767 / 78973736 / -3.9% 0.26 / 0.25 / +3.8%
clickbench_q41/datafusion:parquet 18454949 / 18763783 / -1.6% 74742725 / 76337961 / -2.1% 0.25 / 0.25 / +0.5%
clickbench_q42/datafusion:parquet 19360181 / 19408688 / -0.2% 74233278 / 74831094 / -0.8% 0.26 / 0.26 / +0.6%
duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2152994 / 2123692 / +1.4% 20821264 / 21898221 / -4.9% 0.10 / 0.10 / +6.6%
clickbench_q01/duckdb:vortex-file-compressed 7038607 / 7026149 / +0.2% 24858994 / 26825175 / -7.3% 0.28 / 0.26 / +8.1%
clickbench_q02/duckdb:vortex-file-compressed 8041238 / 8208356 / -2.0% 31737823 / 35316798 / -10.1% 🟢 0.25 / 0.23 / +9.0%
clickbench_q03/duckdb:vortex-file-compressed 14238674 / 14314232 / -0.5% 49578743 / 56872184 / -12.8% 🟢 0.29 / 0.25 / +14.1%
clickbench_q04/duckdb:vortex-file-compressed 55361876 / 56262988 / -1.6% 86660735 / 97904039 / -11.5% 🟢 0.64 / 0.57 / +11.2%
clickbench_q05/duckdb:vortex-file-compressed 64118846 / 64875577 / -1.2% 90792104 / 91122426 / -0.4% 0.71 / 0.71 / -0.8%
clickbench_q06/duckdb:vortex-file-compressed 2582954 / 2463526 / +4.8% 28511453 / 28250149 / +0.9% 0.09 / 0.09 / +3.9%
clickbench_q07/duckdb:vortex-file-compressed 7999633 / 8263040 / -3.2% 25848368 / 26872414 / -3.8% 0.31 / 0.31 / +0.6%
clickbench_q08/duckdb:vortex-file-compressed 67138750 / 68019051 / -1.3% 103407131 / 111784985 / -7.5% 0.65 / 0.61 / +6.7%
clickbench_q09/duckdb:vortex-file-compressed 89805572 / 87421008 / +2.7% 123865221 / 130371038 / -5.0% 0.73 / 0.67 / +8.1%
clickbench_q10/duckdb:vortex-file-compressed 26361868 / 25992662 / +1.4% 61220906 / 69737861 / -12.2% 🟢 0.43 / 0.37 / +15.5%
clickbench_q11/duckdb:vortex-file-compressed 28586794 / 28810808 / -0.8% 64485418 / 71228745 / -9.5% 0.44 / 0.40 / +9.6%
clickbench_q12/duckdb:vortex-file-compressed 69128614 / 69479443 / -0.5% 96132817 / 98556194 / -2.5% 0.72 / 0.70 / +2.0%
clickbench_q13/duckdb:vortex-file-compressed 123923087 / 124666830 / -0.6% 158752931 / 167021763 / -5.0% 0.78 / 0.75 / +4.6%
clickbench_q14/duckdb:vortex-file-compressed 73996260 / 73719470 / +0.4% 99713132 / 102148693 / -2.4% 0.74 / 0.72 / +2.8%
clickbench_q15/duckdb:vortex-file-compressed 74950159 / 75064616 / -0.2% 107987042 / 112531513 / -4.0% 0.69 / 0.67 / +4.0%
clickbench_q16/duckdb:vortex-file-compressed 138724308 / 136541955 / +1.6% 178676604 / 182685771 / -2.2% 0.78 / 0.75 / +3.9%
clickbench_q17/duckdb:vortex-file-compressed 138250336 / 140993470 / -1.9% 170510680 / 174984626 / -2.6% 0.81 / 0.81 / +0.6%
clickbench_q18/duckdb:vortex-file-compressed 260384548 / 260695566 / -0.1% 310513579 / 320680643 / -3.2% 0.84 / 0.81 / +3.2%
clickbench_q19/duckdb:vortex-file-compressed 9284711 / 9367931 / -0.9% 37060667 / 41628422 / -11.0% 🟢 0.25 / 0.23 / +11.3%
clickbench_q20/duckdb:vortex-file-compressed 64914594 / 64976006 / -0.1% 161597195 / 165060480 / -2.1% 0.40 / 0.39 / +2.0%
clickbench_q21/duckdb:vortex-file-compressed 98024626 / 97504152 / +0.5% 265372219 / 283318499 / -6.3% 0.37 / 0.34 / +7.3%
clickbench_q22/duckdb:vortex-file-compressed 172587174 / 173596133 / -0.6% 392306271 / 438734938 / -10.6% 🟢 0.44 / 0.40 / +11.2%
clickbench_q23/duckdb:vortex-file-compressed 33313212 / 35283004 / -5.6% 82841148 / 85846213 / -3.5% 0.40 / 0.41 / -2.2%
clickbench_q24/duckdb:vortex-file-compressed 14251556 / 14270622 / -0.1% 34763182 / 36283004 / -4.2% 0.41 / 0.39 / +4.2%
clickbench_q25/duckdb:vortex-file-compressed 18197030 / 18596388 / -2.1% 47050731 / 47996209 / -2.0% 0.39 / 0.39 / -0.2%
clickbench_q26/duckdb:vortex-file-compressed 11059116 / 11325214 / -2.3% 32581788 / 33619351 / -3.1% 0.34 / 0.34 / +0.8%
clickbench_q27/duckdb:vortex-file-compressed 53564264 / 53827926 / -0.5% 212558951 / 220747424 / -3.7% 0.25 / 0.24 / +3.3%
clickbench_q28/duckdb:vortex-file-compressed 510521010 / 509800188 / +0.1% 572423334 / 574256082 / -0.3% 0.89 / 0.89 / +0.5%
clickbench_q29/duckdb:vortex-file-compressed 17607419 / 17314468 / +1.7% 40881176 / 43959184 / -7.0% 0.43 / 0.39 / +9.3%
clickbench_q30/duckdb:vortex-file-compressed 59228260 / 59539628 / -0.5% 98865631 / 109441893 / -9.7% 0.60 / 0.54 / +10.1%
clickbench_q31/duckdb:vortex-file-compressed 99697351 / 109694199 / -9.1% 181633032 / 194465616 / -6.6% 0.55 / 0.56 / -2.7%
clickbench_q32/duckdb:vortex-file-compressed 364248698 / 378649706 / -3.8% 396843773 / 416326221 / -4.7% 0.92 / 0.91 / +0.9%
clickbench_q33/duckdb:vortex-file-compressed 352471770 / 348319770 / +1.2% 432672150 / 442414681 / -2.2% 0.81 / 0.79 / +3.5%
clickbench_q34/duckdb:vortex-file-compressed 361154395 / 359711986 / +0.4% 446360896 / 460028393 / -3.0% 0.81 / 0.78 / +3.5%
clickbench_q35/duckdb:vortex-file-compressed 56457368 / 56556153 / -0.2% 86595124 / 89483246 / -3.2% 0.65 / 0.63 / +3.2%
clickbench_q36/duckdb:vortex-file-compressed 11445146 / 11505696 / -0.5% 30643201 / 33169379 / -7.6% 0.37 / 0.35 / +7.7%
clickbench_q37/duckdb:vortex-file-compressed 7762500 / 8026362 / -3.3% 29526532 / 28444206 / +3.8% 0.26 / 0.28 / -6.8%
clickbench_q38/duckdb:vortex-file-compressed 8581543 / 8690200 / -1.3% 27159310 / 28477529 / -4.6% 0.32 / 0.31 / +3.5%
clickbench_q39/duckdb:vortex-file-compressed 19359764 / 19177272 / +1.0% 38996196 / 40951357 / -4.8% 0.50 / 0.47 / +6.0%
clickbench_q40/duckdb:vortex-file-compressed 6885858 / 7319470 / -5.9% 27331807 / 27501313 / -0.6% 0.25 / 0.27 / -5.3%
clickbench_q41/duckdb:vortex-file-compressed 7722386 / 8073882 / -4.4% 27359756 / 29932927 / -8.6% 0.28 / 0.27 / +4.6%
clickbench_q42/duckdb:vortex-file-compressed 7122201 / 7081532 / +0.6% 27091421 / 25910403 / +4.6% 0.26 / 0.27 / -3.8%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 11668050 / 10936614 / +6.7% 17951467 / 18496767 / -2.9% 0.65 / 0.59 / +9.9%
clickbench_q01/duckdb:parquet 16630354 / 17364563 / -4.2% 26147448 / 24003064 / +8.9% 0.64 / 0.72 / -12.1%
clickbench_q02/duckdb:parquet 23913354 / 23852667 / +0.3% 37004107 / 34707024 / +6.6% 0.65 / 0.69 / -6.0%
clickbench_q03/duckdb:parquet 24039378 / 24265748 / -0.9% 39029985 / 36821650 / +6.0% 0.62 / 0.66 / -6.5%
clickbench_q04/duckdb:parquet 63590213 / 62597868 / +1.6% 77941609 / 76891790 / +1.4% 0.82 / 0.81 / +0.2%
clickbench_q05/duckdb:parquet 84610872 / 85775756 / -1.4% 102969297 / 101401369 / +1.5% 0.82 / 0.85 / -2.9%
clickbench_q06/duckdb:parquet 21931494 / 22547742 / -2.7% 33077927 / 30659822 / +7.9% 0.66 / 0.74 / -9.8%
clickbench_q07/duckdb:parquet 18849142 / 18585179 / +1.4% 25809764 / 27750772 / -7.0% 0.73 / 0.67 / +9.0%
clickbench_q08/duckdb:parquet 77188918 / 77897616 / -0.9% 90688725 / 94822544 / -4.4% 0.85 / 0.82 / +3.6%
clickbench_q09/duckdb:parquet 102307432 / 105538921 / -3.1% 122301407 / 124343745 / -1.6% 0.84 / 0.85 / -1.4%
clickbench_q10/duckdb:parquet 42279117 / 42159695 / +0.3% 58603130 / 58222270 / +0.7% 0.72 / 0.72 / -0.4%
clickbench_q11/duckdb:parquet 47638394 / 47503445 / +0.3% 66918552 / 67071023 / -0.2% 0.71 / 0.71 / +0.5%
clickbench_q12/duckdb:parquet 93452555 / 93359524 / +0.1% 113911857 / 113762075 / +0.1% 0.82 / 0.82 / -0.0%
clickbench_q13/duckdb:parquet 154926890 / 152258478 / +1.8% 174608560 / 176619306 / -1.1% 0.89 / 0.86 / +2.9%
clickbench_q14/duckdb:parquet 103511941 / 103134474 / +0.4% 126234978 / 125736221 / +0.4% 0.82 / 0.82 / -0.0%
clickbench_q15/duckdb:parquet 88852920 / 88198879 / +0.7% 105727581 / 105923344 / -0.2% 0.84 / 0.83 / +0.9%
clickbench_q16/duckdb:parquet 172442773 / 175521478 / -1.8% 184879544 / 188294431 / -1.8% 0.93 / 0.93 / +0.1%
clickbench_q17/duckdb:parquet 181843139 / 178577778 / +1.8% 195021379 / 190167708 / +2.6% 0.93 / 0.94 / -0.7%
clickbench_q18/duckdb:parquet 314917586 / 311359643 / +1.1% 330105032 / 340582142 / -3.1% 0.95 / 0.91 / +4.4%
clickbench_q19/duckdb:parquet 21573616 / 21832549 / -1.2% 30886104 / 30446288 / +1.4% 0.70 / 0.72 / -2.6%
clickbench_q20/duckdb:parquet 177752635 / 182345972 / -2.5% 225864599 / 232780310 / -3.0% 0.79 / 0.78 / +0.5%
clickbench_q21/duckdb:parquet 233502268 / 227280193 / +2.7% 267356809 / 267983880 / -0.2% 0.87 / 0.85 / +3.0%
clickbench_q22/duckdb:parquet 312602317 / 321851783 / -2.9% 362498808 / 364767446 / -0.6% 0.86 / 0.88 / -2.3%
clickbench_q23/duckdb:parquet 180706236 / 166484048 / +8.5% 237949211 / 250775337 / -5.1% 0.76 / 0.66 / +14.4%
clickbench_q24/duckdb:parquet 32780958 / 32864701 / -0.3% 41290137 / 40195222 / +2.7% 0.79 / 0.82 / -2.9%
clickbench_q25/duckdb:parquet 43853876 / 45333524 / -3.3% 65344383 / 62279660 / +4.9% 0.67 / 0.73 / -7.8%
clickbench_q26/duckdb:parquet 33141347 / 33507212 / -1.1% 50920715 / 38889576 / +30.9% 🔴 0.65 / 0.86 / -24.5%
clickbench_q27/duckdb:parquet 191901000 / 191752977 / +0.1% 225497728 / 227675366 / -1.0% 0.85 / 0.84 / +1.0%
clickbench_q28/duckdb:parquet 933365008 / 934266047 / -0.1% 920720823 / 915317898 / +0.6% 1.01 / 1.02 / -0.7%
clickbench_q29/duckdb:parquet 25941498 / 25509132 / +1.7% 34150303 / 35534293 / -3.9% 0.76 / 0.72 / +5.8%
clickbench_q30/duckdb:parquet 108496247 / 108932512 / -0.4% 136625053 / 133740696 / +2.2% 0.79 / 0.81 / -2.5%
clickbench_q31/duckdb:parquet 149663798 / 150573574 / -0.6% 184667848 / 207860791 / -11.2% 🟢 0.81 / 0.72 / +11.9%
clickbench_q32/duckdb:parquet 410486618 / 396545166 / +3.5% 426173604 / 415307817 / +2.6% 0.96 / 0.95 / +0.9%
clickbench_q33/duckdb:parquet 484695362 / 477613020 / +1.5% 470977428 / 452666102 / +4.0% 1.03 / 1.06 / -2.5%
clickbench_q34/duckdb:parquet 477885488 / 476200734 / +0.4% 470504162 / 459500407 / +2.4% 1.02 / 1.04 / -2.0%
clickbench_q35/duckdb:parquet 64070678 / 63045764 / +1.6% 82465452 / 78978420 / +4.4% 0.78 / 0.80 / -2.7%
clickbench_q36/duckdb:parquet 31787220 / 32554133 / -2.4% 39593665 / 41325596 / -4.2% 0.80 / 0.79 / +1.9%
clickbench_q37/duckdb:parquet 24711163 / 24621020 / +0.4% 33313467 / 34485823 / -3.4% 0.74 / 0.71 / +3.9%
clickbench_q38/duckdb:parquet 25873009 / 26578190 / -2.7% 35396530 / 35454842 / -0.2% 0.73 / 0.75 / -2.5%
clickbench_q39/duckdb:parquet 54539000 / 54315667 / +0.4% 61779597 / 65572633 / -5.8% 0.88 / 0.83 / +6.6%
clickbench_q40/duckdb:parquet 17104072 / 16704950 / +2.4% 24740829 / 24708798 / +0.1% 0.69 / 0.68 / +2.3%
clickbench_q41/duckdb:parquet 16970054 / 18441890 / -8.0% 24003308 / 23601633 / +1.7% 0.71 / 0.78 / -9.5%
clickbench_q42/duckdb:parquet 17158026 / 16549220 / +3.7% 24351417 / 25861472 / -5.8% 0.70 / 0.64 / +10.1%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR a47ec03e vs base 91b38f41
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.7%
Engines: DataFusion No clear signal (-0.2%, environment too noisy confidence) · DuckDB No clear signal (+7.7%, environment too noisy confidence)
Vortex (geomean): hot 0.988x ➖ · cold 0.982x ➖
Parquet (geomean): hot 0.953x ➖ · cold 0.982x ➖
Shifts: Parquet (control) -4.7% · Median polish -0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 273611335 / 254035971 / +7.7% 787010446 / 998227897 / -21.2% 0.35 / 0.25 / +36.6%
tpch_q02/datafusion:vortex-file-compressed 293271602 / 289268611 / +1.4% 681076814 / 594167014 / +14.6% 0.43 / 0.49 / -11.6%
tpch_q03/datafusion:vortex-file-compressed 413451221 / 371098738 / +11.4% 951215704 / 1146786620 / -17.1% 0.43 / 0.32 / +34.3%
tpch_q04/datafusion:vortex-file-compressed 211165379 / 209601756 / +0.7% 396171758 / 441348867 / -10.2% 0.53 / 0.47 / +12.2%
tpch_q05/datafusion:vortex-file-compressed 400104387 / 497034189 / -19.5% 538224777 / 718145139 / -25.1% 0.74 / 0.69 / +7.4%
tpch_q06/datafusion:vortex-file-compressed 265113877 / 282754628 / -6.2% 413860286 / 517407165 / -20.0% 0.64 / 0.55 / +17.2%
tpch_q07/datafusion:vortex-file-compressed 369657114 / 371865207 / -0.6% 552323594 / 608549928 / -9.2% 0.67 / 0.61 / +9.5%
tpch_q08/datafusion:vortex-file-compressed 431827633 / 523021633 / -17.4% 762876848 / 631133412 / +20.9% 0.57 / 0.83 / -31.7%
tpch_q09/datafusion:vortex-file-compressed 290015517 / 376554023 / -23.0% 507250229 / 704382198 / -28.0% 0.57 / 0.53 / +6.9%
tpch_q10/datafusion:vortex-file-compressed 367699711 / 377919173 / -2.7% 482424049 / 508212270 / -5.1% 0.76 / 0.74 / +2.5%
tpch_q11/datafusion:vortex-file-compressed 260600634 / 221334790 / +17.7% 350944029 / 376872184 / -6.9% 0.74 / 0.59 / +26.4%
tpch_q12/datafusion:vortex-file-compressed 310315985 / 329640976 / -5.9% 542900506 / 477226484 / +13.8% 0.57 / 0.69 / -17.3%
tpch_q13/datafusion:vortex-file-compressed 142827445 / 146419727 / -2.5% 313343351 / 371873800 / -15.7% 0.46 / 0.39 / +15.8%
tpch_q14/datafusion:vortex-file-compressed 220229242 / 180811537 / +21.8% 392989096 / 297531457 / +32.1% 🔴 0.56 / 0.61 / -7.8%
tpch_q15/datafusion:vortex-file-compressed 419621100 / 347769091 / +20.7% 532601158 / 547125724 / -2.7% 0.79 / 0.64 / +24.0%
tpch_q16/datafusion:vortex-file-compressed 138064944 / 132286983 / +4.4% 276368781 / 282719720 / -2.2% 0.50 / 0.47 / +6.8%
tpch_q17/datafusion:vortex-file-compressed 257456437 / 252162354 / +2.1% 406876428 / 452493681 / -10.1% 0.63 / 0.56 / +13.5%
tpch_q18/datafusion:vortex-file-compressed 245076524 / 296474134 / -17.3% 495733016 / 505411675 / -1.9% 0.49 / 0.59 / -15.7%
tpch_q19/datafusion:vortex-file-compressed 287407903 / 276776442 / +3.8% 391031466 / 478831265 / -18.3% 0.73 / 0.58 / +27.2%
tpch_q20/datafusion:vortex-file-compressed 291727444 / 308213591 / -5.3% 475032176 / 429583450 / +10.6% 0.61 / 0.72 / -14.4%
tpch_q21/datafusion:vortex-file-compressed 502386982 / 529671265 / -5.2% 684206613 / 622734454 / +9.9% 0.73 / 0.85 / -13.7%
tpch_q22/datafusion:vortex-file-compressed 155073725 / 148285867 / +4.6% 346536182 / 387385794 / -10.5% 0.45 / 0.38 / +16.9%
datafusion / parquet / ns (0.990x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 160409401 / 161335931 / -0.6% 505885451 / 540476076 / -6.4% 0.32 / 0.30 / +6.2%
tpch_q02/datafusion:parquet 294466432 / 292448793 / +0.7% 549274970 / 514206575 / +6.8% 0.54 / 0.57 / -5.7%
tpch_q03/datafusion:parquet 254709393 / 375767409 / -32.2% 🟢 640694561 / 681451483 / -6.0% 0.40 / 0.55 / -27.9%
tpch_q04/datafusion:parquet 139955983 / 154485050 / -9.4% 364345883 / 350000378 / +4.1% 0.38 / 0.44 / -13.0%
tpch_q05/datafusion:parquet 376241975 / 354767962 / +6.1% 605315886 / 508969551 / +18.9% 0.62 / 0.70 / -10.8%
tpch_q06/datafusion:parquet 122585127 / 109131186 / +12.3% 237778675 / 227642778 / +4.5% 0.52 / 0.48 / +7.5%
tpch_q07/datafusion:parquet 366416837 / 382057648 / -4.1% 522923856 / 459046437 / +13.9% 0.70 / 0.83 / -15.8%
tpch_q08/datafusion:parquet 409145656 / 446658752 / -8.4% 547885082 / 571600074 / -4.1% 0.75 / 0.78 / -4.4%
tpch_q09/datafusion:parquet 438720535 / 385371028 / +13.8% 487935403 / 501315513 / -2.7% 0.90 / 0.77 / +17.0%
tpch_q10/datafusion:parquet 323455958 / 340880314 / -5.1% 457837307 / 518680332 / -11.7% 0.71 / 0.66 / +7.5%
tpch_q11/datafusion:parquet 274311485 / 257398204 / +6.6% 385604424 / 359034793 / +7.4% 0.71 / 0.72 / -0.8%
tpch_q12/datafusion:parquet 161628181 / 158213537 / +2.2% 380489882 / 289922852 / +31.2% 🔴 0.42 / 0.55 / -22.2%
tpch_q13/datafusion:parquet 277283276 / 281691297 / -1.6% 457335882 / 483931841 / -5.5% 0.61 / 0.58 / +4.2%
tpch_q14/datafusion:parquet 160647508 / 163284741 / -1.6% 296552996 / 311826916 / -4.9% 0.54 / 0.52 / +3.5%
tpch_q15/datafusion:parquet 299948411 / 312577981 / -4.0% 465605855 / 470626575 / -1.1% 0.64 / 0.66 / -3.0%
tpch_q16/datafusion:parquet 110345782 / 101750535 / +8.4% 270722500 / 202723383 / +33.5% 🔴 0.41 / 0.50 / -18.8%
tpch_q17/datafusion:parquet 282440299 / 289851442 / -2.6% 453964418 / 424338225 / +7.0% 0.62 / 0.68 / -8.9%
tpch_q18/datafusion:parquet 333435569 / 348438472 / -4.3% 447435058 / 467435192 / -4.3% 0.75 / 0.75 / -0.0%
tpch_q19/datafusion:parquet 172637667 / 184944434 / -6.7% 320046896 / 362329185 / -11.7% 0.54 / 0.51 / +5.7%
tpch_q20/datafusion:parquet 285067762 / 245577330 / +16.1% 564798684 / 382830006 / +47.5% 🔴 0.50 / 0.64 / -21.3%
tpch_q21/datafusion:parquet 393620684 / 364011578 / +8.1% 531146485 / 470817857 / +12.8% 0.74 / 0.77 / -4.1%
tpch_q22/datafusion:parquet 158063753 / 162779605 / -2.9% 356006658 / 309882329 / +14.9% 0.44 / 0.53 / -15.5%
duckdb / vortex-file-compressed / ns (0.988x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 232975618 / 235358568 / -1.0% 343551296 / 309231215 / +11.1% 0.68 / 0.76 / -10.9%
tpch_q02/duckdb:vortex-file-compressed 393023834 / 386390763 / +1.7% 474340418 / 408620732 / +16.1% 0.83 / 0.95 / -12.4%
tpch_q03/duckdb:vortex-file-compressed 531679886 / 512249960 / +3.8% 547269183 / 537534942 / +1.8% 0.97 / 0.95 / +1.9%
tpch_q04/duckdb:vortex-file-compressed 269682480 / 296350338 / -9.0% 272782187 / 308499856 / -11.6% 0.99 / 0.96 / +2.9%
tpch_q05/duckdb:vortex-file-compressed 518072052 / 535586895 / -3.3% 600024456 / 577539082 / +3.9% 0.86 / 0.93 / -6.9%
tpch_q06/duckdb:vortex-file-compressed 435292247 / 319360740 / +36.3% 🔴 408184578 / 343219015 / +18.9% 1.07 / 0.93 / +14.6%
tpch_q07/duckdb:vortex-file-compressed 449909328 / 815270562 / -44.8% 🟢 539467423 / 539517864 / -0.0% 0.83 / 1.51 / -44.8%
tpch_q08/duckdb:vortex-file-compressed 665844405 / 644893453 / +3.2% 630806804 / 686742179 / -8.1% 1.06 / 0.94 / +12.4%
tpch_q09/duckdb:vortex-file-compressed 492936368 / 477018963 / +3.3% 549126043 / 499824944 / +9.9% 0.90 / 0.95 / -5.9%
tpch_q10/duckdb:vortex-file-compressed 470541948 / 489174077 / -3.8% 492239843 / 525480004 / -6.3% 0.96 / 0.93 / +2.7%
tpch_q11/duckdb:vortex-file-compressed 287845119 / 274637903 / +4.8% 314167747 / 316105987 / -0.6% 0.92 / 0.87 / +5.5%
tpch_q12/duckdb:vortex-file-compressed 456047540 / 474339005 / -3.9% 521637610 / 534602771 / -2.4% 0.87 / 0.89 / -1.5%
tpch_q13/duckdb:vortex-file-compressed 196362500 / 210344922 / -6.6% 249564407 / 260597721 / -4.2% 0.79 / 0.81 / -2.5%
tpch_q14/duckdb:vortex-file-compressed 225413062 / 242789366 / -7.2% 359304908 / 336922745 / +6.6% 0.63 / 0.72 / -12.9%
tpch_q15/duckdb:vortex-file-compressed 230384739 / 220613633 / +4.4% 290780275 / 264495652 / +9.9% 0.79 / 0.83 / -5.0%
tpch_q16/duckdb:vortex-file-compressed 206850329 / 187780586 / +10.2% 267820560 / 224633927 / +19.2% 0.77 / 0.84 / -7.6%
tpch_q17/duckdb:vortex-file-compressed 398150693 / 383145904 / +3.9% 406703699 / 434877070 / -6.5% 0.98 / 0.88 / +11.1%
tpch_q18/duckdb:vortex-file-compressed 359340820 / 355182901 / +1.2% 421909922 / 556508844 / -24.2% 0.85 / 0.64 / +33.4%
tpch_q19/duckdb:vortex-file-compressed 428241329 / 417070713 / +2.7% 530310354 / 442197085 / +19.9% 0.81 / 0.94 / -14.4%
tpch_q20/duckdb:vortex-file-compressed 454363652 / 479034544 / -5.2% 533989475 / 561455745 / -4.9% 0.85 / 0.85 / -0.3%
tpch_q21/duckdb:vortex-file-compressed 630975255 / 649183171 / -2.8% 746523198 / 710369689 / +5.1% 0.85 / 0.91 / -7.5%
tpch_q22/duckdb:vortex-file-compressed 250951941 / 232739032 / +7.8% 274255706 / 247424042 / +10.8% 0.92 / 0.94 / -2.7%
duckdb / parquet / ns (0.917x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 175211631 / 237794121 / -26.3% 192344728 / 308692457 / -37.7% 🟢 0.91 / 0.77 / +18.3%
tpch_q02/duckdb:parquet 400703220 / 462108158 / -13.3% 392238028 / 487300075 / -19.5% 1.02 / 0.95 / +7.7%
tpch_q03/duckdb:parquet 374222882 / 505830478 / -26.0% 391482536 / 872948549 / -55.2% 🟢 0.96 / 0.58 / +65.0%
tpch_q04/duckdb:parquet 267943196 / 387035822 / -30.8% 🟢 291031280 / 581287344 / -49.9% 🟢 0.92 / 0.67 / +38.3%
tpch_q05/duckdb:parquet 548630996 / 538106675 / +2.0% 673665857 / 567877104 / +18.6% 0.81 / 0.95 / -14.1%
tpch_q06/duckdb:parquet 149764674 / 150963422 / -0.8% 196822216 / 187240366 / +5.1% 0.76 / 0.81 / -5.6%
tpch_q07/duckdb:parquet 476736304 / 436298566 / +9.3% 543121429 / 461956856 / +17.6% 0.88 / 0.94 / -7.1%
tpch_q08/duckdb:parquet 515580973 / 610111770 / -15.5% 615507277 / 698851843 / -11.9% 0.84 / 0.87 / -4.1%
tpch_q09/duckdb:parquet 633550809 / 576425528 / +9.9% 710455168 / 617345411 / +15.1% 0.89 / 0.93 / -4.5%
tpch_q10/duckdb:parquet 565621383 / 608824980 / -7.1% 588237762 / 600001797 / -2.0% 0.96 / 1.01 / -5.2%
tpch_q11/duckdb:parquet 271821654 / 277473115 / -2.0% 299009534 / 308296073 / -3.0% 0.91 / 0.90 / +1.0%
tpch_q12/duckdb:parquet 293394739 / 256102915 / +14.6% 482515220 / 292849427 / +64.8% 🔴 0.61 / 0.87 / -30.5%
tpch_q13/duckdb:parquet 462768210 / 421289843 / +9.8% 596301514 / 635768904 / -6.2% 0.78 / 0.66 / +17.1%
tpch_q14/duckdb:parquet 354414862 / 487146364 / -27.2% 588829766 / 525409912 / +12.1% 0.60 / 0.93 / -35.1%
tpch_q15/duckdb:parquet 199757368 / 242936206 / -17.8% 256039760 / 258633573 / -1.0% 0.78 / 0.94 / -16.9%
tpch_q16/duckdb:parquet 294015632 / 277745495 / +5.9% 330015792 / 302430309 / +9.1% 0.89 / 0.92 / -3.0%
tpch_q17/duckdb:parquet 294868808 / 374869338 / -21.3% 370112785 / 400574066 / -7.6% 0.80 / 0.94 / -14.9%
tpch_q18/duckdb:parquet 387430847 / 376031895 / +3.0% 373714200 / 367823365 / +1.6% 1.04 / 1.02 / +1.4%
tpch_q19/duckdb:parquet 228203967 / 273862590 / -16.7% 299588718 / 361788021 / -17.2% 0.76 / 0.76 / +0.6%
tpch_q20/duckdb:parquet 408596754 / 562930266 / -27.4% 408543307 / 775638682 / -47.3% 🟢 1.00 / 0.73 / +37.8%
tpch_q21/duckdb:parquet 474475446 / 422842699 / +12.2% 541914050 / 653630071 / -17.1% 0.88 / 0.65 / +35.3%
tpch_q22/duckdb:parquet 312181336 / 278708806 / +12.0% 351199028 / 257009608 / +36.6% 🔴 0.89 / 1.08 / -18.0%

A bit-packed array without patches only holds values in 0..2^bit_width, so its
unpacked values are already codes into that range. Exporting it to an Arrow
dictionary now unpacks straight into the codes type and uses 0..2^bit_width as
the values, instead of decoding to the values type and dictionary-encoding the
result. Applies up to 16-bit widths when the dictionary is no larger than the
array.

To unpack into narrower codes, BitPacked's cast kernel now also handles
narrowing integer casts when the array has no patches and the target holds
every value the bit width allows, skipping the generic bounds check.

PolarSignals SF1 on DataFusion (V2): q00-q03 another ~2x faster.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC
Signed-off-by: Claude <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC
Signed-off-by: Claude <noreply@anthropic.com>
…0erx1

Signed-off-by: Claude <noreply@anthropic.com>

# Conflicts:
#	vortex-arrow/src/executor/dictionary.rs
…ange

The primitive dictionary export scanned every key for its range before
choosing an encoding, even for high-cardinality columns such as addresses that
can never use the dense table. Sample first, and scan the full range only when
the sampled keys fit the dense table.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC
Signed-off-by: Claude <noreply@anthropic.com>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 23, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 23, 2026

Copy link
Copy Markdown
Contributor Author

CodSpeed Performance Analysis fails on a47ec03, but I don't think any of the flagged benchmarks run code this PR changes. The PR touches only vortex-arrow dictionary export, the BitPacked CastKernel and the vortex-layout scan v2 code:

  • filter_neon[8/64/80], threshold_neon[80] (encodings/fastlanes/benches/bitpacking_{filter,take}.rs). These time filter and take on BitPacked and never call cast, so the narrowing-cast change isn't on their path. They are walltime runs on a non-Macro runner, and CodSpeed notes that base and head ran on different runner types.
  • chunked_dict_primitive_canonical_into[f64] (vortex-array) and words_gather_dispatch_avx512 (vortex-buffer). This PR changes neither crate. Both were flagged before as well, when the branch was behind develop.
  • test_repeated_scan_scalar_at[int_float] (Python scalar_at). That path doesn't use dictionary export or the scan v2 filter path. Its sibling [int] case improved by 28% in the same run.

There's no fix to port for these. I'll re-check them on the next push.


Generated by Claude Code

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants