Repository navigation
perf(cuda): read pooled files in 8 MiB chunks - #10715
Conversation
Merging this PR will regress 3 benchmarks2 warnings, 1 note
Warning Please fix the performance issues or acknowledge them on CodSpeed. Performance Changes
Tip Investigate this regression by commenting Comparing Footnotes
|
ad17bf0 to
33595aa
Compare
Increase physical staged-read and H2D chunks from 4 MiB to 8 MiB while preserving concurrency and logical scan batches. Keep the read-size documentation and boundary-test comment with the change. Original-commit: ccd8ae8f00 Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
33595aa to
a5374f5
Compare
## Problem Cached file pages still pass through pinned staging buffers before reaching the GPU. ## Solution On supported Linux devices, copy resident mapped-file ranges directly with a CUDA kernel; retain staged reads for other cases. ## Assessment Hardware-dependent fast path with mapping lifetime and cancellation guards. Keeps 4 MiB chunks, so it is independent of #10715. Based on #10726. Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
Problem
Splitting staged file reads into 4 MiB chunks adds per-chunk I/O and transfer overhead.
Solution
Increase physical read and H2D chunks to 8 MiB, retaining concurrency 32 and existing logical batches.
Assessment
Uses larger staging buffers per request. Independent of mapped-file copying; based on #10726.