docs(serving): gather Cut-2 closed on both backends + dispatch rule + instrument ladder - #2149
Merged
Merged
Conversation
…e instrument ladder Records the outcome (Metal 4.0x zero-bytes; CUDA V4-Flash coherent at 51 MiB/token vs 3.3 GiB), the three defects that all shared one shape (a kernel reachable from a gather-capable supports_op that did not honor src[3] — gate/dispatch mismatch, fused gate+up, mul_mat_vec_q_moe), and the rule that would have caught all three at once: enumerate reachable kernels FROM THE DISPATCH CODE. Also records why it took eleven eliminations — every probe asked WHAT was wrong with the table when nothing about the table was wrong; the probe that cracked it asked WHERE. Heuristic: when several probes in a row all say 'that property is fine', the question shape is wrong — bisect the surface. Ships the instrument ladder as a table so the next hunt starts with tools instead of theories. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LoTjvf5j3Ez13g6k8mRkFo
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Outcome, the three same-shaped defects, the enumerate-from-dispatch rule, the property-vs-surface lesson, and the reusable instrument ladder.
🤖 Generated with Claude Code
https://claude.ai/code/session_01LoTjvf5j3Ez13g6k8mRkFo