Repository navigation
perf(cuda): copy cached file pages directly on the GPU - #10716
Conversation
Merging this PR will regress 1 benchmark3 warnings, 1 note
Warning Please fix the performance issues or acknowledge them on CodSpeed. Performance Changes
Tip Investigate this regression by commenting Comparing Footnotes
|
d006295 to
715005f
Compare
715005f to
cbbedfc
Compare
On devices that read pageable memory through host page tables, copy resident mapped-file ranges directly into device memory. Preserve staged reads for uncached ranges and direct I/O, source and destination alignment, cancellation safety, and mapping lifetime guards. Use the existing file-read chunk size so this feature is independent of chunk-size tuning. Original-commit: b546d93814 Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
cbbedfc to
5d8b5f3
Compare
Problem
Cached file pages still pass through pinned staging buffers before reaching the GPU.
Solution
On supported Linux devices, copy resident mapped-file ranges directly with a CUDA kernel; retain staged reads for other cases.
Assessment
Hardware-dependent fast path with mapping lifetime and cancellation guards. Keeps 4 MiB chunks, so it is independent of #10715. Based on #10726.