Repository navigation
[DO NOT MERGE] Research notes on extension types, Decimal and casts - #10633
connortsui20 wants to merge 12 commits into
Performance Regression: -16.75%
3 warnings, 1 note
⚠️ Walltime results may be unreliableSome benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.
⚠️ Unable to measure the execution of 2 benchmarksThese benchmarks measured no execution time, so their results are not comparable and count as unchanged. This usually happens when the compiler removes the code under test.
⚠️ 19 benchmarks are dominated by system callsSystem calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.
ℹ️ 40 benchmarks have no flamegraph
The flamegraph wasn't generated: the symbols of the profiling trace could not be resolved, because no information about the language frames was collected.
⚡ 3 improved benchmarks
❌ 12 regressed benchmarks
✅ 2393 untouched benchmarks
⏩ 12 skipped benchmarks1
Warning
Please fix the performance issues or acknowledge them on CodSpeed.
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | Walltime | threshold_neon[8] |
1.4 µs | 2.8 µs | -50.85% |
| ❌ | Walltime | filter_neon[8] |
897 ns | 1,779 ns | -49.58% |
| ❌ | Walltime | filter_neon[64] |
1.7 µs | 2.5 µs | -32.28% |
| ❌ | Walltime | threshold_neon[80] |
3.6 µs | 5 µs | -28.02% |
| ❌ | Walltime | threshold_neon[64] |
2.6 µs | 3.6 µs | -27.98% |
| ❌ | Walltime | filter_neon[80] |
2.5 µs | 3.2 µs | -21.54% |
| ❌ | CPU Simulation | test_scan_filter_to_arrow_array[int_float] |
3.5 ms | 4.1 ms | -13.65% |
| ❌ | Walltime | starts_with_avx2[64, VarBin] |
54.1 µs | 61.8 µs | -12.35% |
| ❌ | Walltime | decode_chunked_neon[i64, 524288] |
13 µs | 14.8 µs | -11.96% |
| ❌ | CPU Simulation | test_repeated_scan_filter[int_float] |
3.4 ms | 3.9 ms | -10.88% |
| ❌ | CPU Simulation | test_repeated_scan_filter[int] |
2.4 ms | 2.7 ms | -10.13% |
| ❌ | CPU Simulation | test_scan_filter_to_arrow_array[int] |
2.5 ms | 2.8 ms | -10.11% |
| ⚡ | CPU Simulation | bench_compare_primitive[(10000, 32)] |
97 µs | 72.9 µs | +33.1% |
| ⚡ | CPU Simulation | chunked_dict_primitive_canonical_into[f64, (1000, 1000, 10)] |
191.7 µs | 151.6 µs | +26.45% |
| ⚡ | Walltime | starts_with_avx2[8, VarBin] |
46.9 µs | 40.4 µs | +16.13% |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing ct/ext-types-research (fe6586e) with develop (3974ee0)
Footnotes
-
12 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩