Skip to content

Vulkan: keep a reshape that changes the last dim before a quantized linear - #25

Merged
msluszniak merged 1 commit into
@ms/separate-backends-1.4.1from
@ms/vulkan-qlinear-keep-input-view-1.4.1
Oct 27, 2026
Merged

msluszniak merged 1 commit into
@ms/separate-backends-1.4.1from
@ms/vulkan-qlinear-keep-input-view-1.4.1

Conversation

@msluszniak

Copy link
Copy Markdown

…ntized linear

QuantizedLinearMatch skipped any view_copy feeding the linear, assuming it is the
leading-dim flatten from aten.linear's N-D decomposition. A reshape that merges
attention heads ([S, H, D] -> [S, H * D]) was skipped too, so the fused
et_vk.linear_q4gsw received the [S, H, D] tensor and lowering failed in the fake
kernel. Skip the view only when it keeps the last dim.

Backport of pytorch/executorch#24116.
@msluszniak
msluszniak merged commit ebfb4d2 into @ms/separate-backends-1.4.1 Oct 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant