Skip to content

Inkling 2's attention kernels under the kernel contract - #4125

Open
ajensenwaud wants to merge 1 commit into
ashhart:mainfrom
ajensenwaud:ink-k-attn
Open

ajensenwaud wants to merge 1 commit into
ashhart:mainfrom
ajensenwaud:ink-k-attn

Conversation

@ajensenwaud

@ajensenwaud ajensenwaud commented Nov 20, 2026 •

Copy link
Copy Markdown
Contributor

What this changes

Adds Inkling 2's attention kernels, with a relative-position bias, a sink and a sigmoid gate on every head, their launcher in a new inkling2 module, and their registration with the kernel contract. Nothing serves them until the family PR at the top of the stack.

Checks on this head

  • Head 0e053ba11; lean checker 168 on the base, 168 on this head, 0 new.
  • zig build test test-golden test-inkling2-cuda-host compile-cuda-tests: 10,925 of 11,016 tests, 91 skipped on main c94e65d33; rebased onto cfc8510ce, rechecked there: the CUDA tests compile and the family host tests pass.
  • zig fmt --check build.zig zig and git diff --check: clean. CI: pending.

Receipt

n/a: no served path reaches these kernels yet.

Kernel contract
  • Registered: tf_ink2_prep (sliding and full), tf_ink2_rel_table, tf_ink2_attn and tf_ink2_attn_fold with tf_ink2_merge, and tf_ink2_attn_prompt, which replaces fold and merge bit for bit. They use common's qmm_frag mma and ldmatrix and tf_common cp.async; nvcc 13.3 gives the same SASS as with local copies on sm_80, 86, 89, 120 and 121.
  • Planted controls: 5, each red as planted.
  • GB10 (sm_121), the family's run on this stack tested over main 4fda6a020, 19 November, with the same family and contract files: SUMMARY 55 kernels: 55 pass gates 1-4, 0 fail, 0 known findings; 35 controls: 35 red as planted, 0 missed; 0 limit problems, exit 0. This PR's share is 7 registrations and 5 controls.
  • Main's full kernel-contract on that head and on main alone: 388 limit problems and 8 known findings on both, and no failure on the head that main does not show.
  • Gate 5: records for nvcc 13.0 and 13.3 on sm_80, 86, 89, 120 and 121; 13.2 stays pending.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant