Repository navigation
feat(cuda): track device memory accesses across streams - #10721
Conversation
Merging this PR will degrade performance by 5.19%3 warnings, 1 note
Warning Please fix the performance issues or acknowledge them on CodSpeed. Performance Changes
Tip Investigate this regression by commenting Comparing Footnotes
|
38ad068 to
fd26f0f
Compare
8390bc7 to
7085828
Compare
7085828 to
b896d5d
Compare
Add typed device allocations and views, host/device copies, pointer guards, pooled access events, and kernel launches. Order conflicting accesses and frees across streams while avoiding redundant waits. Include round-trip, cross-stream read, free-ordering, and event-pool tests. Existing consumers still use cudarc. Original-commit: 5fd3f54eba Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
fd26f0f to
08dc2b8
Compare
Problem
Device memory shared across streams needs ordered access and deallocation without redundant waits.
Solution
Add typed allocations/views, copies, pointer guards, pooled access events, and kernel launches.
Assessment
Depends on #10720; activated by #10722. The driver remains excluded from publishing.