Repository navigation
Reclassify and simplify error types - #10080
robert3005 wants to merge 3 commits into
Performance Regression: -3.62%
4 warnings, 1 note
⚠️ Walltime results may be unreliableSome benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.
⚠️ Unable to measure the execution of 2 benchmarksThese benchmarks measured no execution time, so their results are not comparable and count as unchanged. This usually happens when the compiler removes the code under test.
⚠️ 17 benchmarks are dominated by system callsSystem calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.
⚠️ Base and head ran on different runner typesSome benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.
ℹ️ 40 benchmarks have no flamegraph
The flamegraph wasn't generated: the symbols of the profiling trace could not be resolved, because no information about the language frames was collected.
⚡ 11 improved benchmarks
❌ 21 regressed benchmarks
✅ 2376 untouched benchmarks
⏩ 12 skipped benchmarks1
🗄️ 24 archived benchmarks run2
Warning
Please fix the performance issues or acknowledge them on CodSpeed.
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | CPU Simulation | decode_bool_nullable[10000_2_alternating_mostly_valid] |
358.5 µs | 470.4 µs | -23.79% |
| ❌ | CPU Simulation | decode_bool_nullable[10000_10_mostly_true_mostly_valid] |
88.4 µs | 110.9 µs | -20.27% |
| ❌ | CPU Simulation | decode_bool_nullable[10000_10_alternating_mostly_null] |
89.1 µs | 111.3 µs | -19.96% |
| ❌ | CPU Simulation | decode_bool_nullable[10000_10_alternating_half_valid] |
105.9 µs | 127.2 µs | -16.75% |
| ❌ | CPU Simulation | decode_bool_nullable[10000_10_mostly_true_half_valid] |
108.2 µs | 129.6 µs | -16.49% |
| ❌ | CPU Simulation | decode_bool_nullable[10000_10_alternating_mostly_valid] |
117.1 µs | 139.7 µs | -16.17% |
| ❌ | CPU Simulation | decode_bool_nullable[10000_10_mostly_true_mostly_null] |
108.3 µs | 129.2 µs | -16.16% |
| ❌ | CPU Simulation | filter_powerlaw_by_mostly_true[250000] |
162.4 µs | 190 µs | -14.5% |
| ❌ | Walltime | threshold_avx2[80] |
2.6 µs | 3 µs | -13.67% |
| ❌ | CPU Simulation | test_scan_filter_to_arrow_array[int_float] |
3.5 ms | 4 ms | -13.04% |
| ❌ | CPU Simulation | filter_powerlaw_by_mostly_true[100000] |
63.9 µs | 73.5 µs | -13.02% |
| ❌ | CPU Simulation | filter_random_by_mostly_true[250000] |
198 µs | 226.1 µs | -12.43% |
| ❌ | CPU Simulation | density_sweep_dense_runs[0.9] |
68.1 µs | 77.6 µs | -12.25% |
| ❌ | CPU Simulation | filter_powerlaw_by_random[250000] |
153.8 µs | 174.7 µs | -11.96% |
| ❌ | CPU Simulation | rank_indices[(0.05, 0.05, "self_sparse_rank_sparse")] |
49.2 µs | 55.8 µs | -11.74% |
| ❌ | CPU Simulation | from_bool_slice[1024] |
3.3 µs | 3.7 µs | -11.14% |
| ❌ | CPU Simulation | test_repeated_scan_filter[int] |
2.4 ms | 2.8 ms | -11.1% |
| ❌ | CPU Simulation | density_sweep_dense_runs[0.001] |
53.6 µs | 59.9 µs | -10.56% |
| ❌ | CPU Simulation | filter_random_by_random[250000] |
183.7 µs | 205 µs | -10.39% |
| ❌ | CPU Simulation | split[(65536, Microseconds)] |
2.1 ms | 2.4 ms | -10.37% |
| ... | ... | ... | ... | ... | ... |
ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing claude/affectionate-keller-4j7w5g (3115e2c) with develop (c7a6cc9)
Footnotes
-
12 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
-
24 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them. ↩