docs/hrx: root cause of the #123/#140 NaNs (decode-split q8 pack barrier) - #177
Conversation
…er, fixed in llama.cpp 00adc2b Replace the open-question paragraph (page migration) with the root cause and the measured fix, and say decode-split is now off for speed, not correctness. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Docs7 for 1bit-monster/engine
Commit |
PR Reviewer Guide 🔍Here are some key observations to aid the review process:
|
Docs follow-up to #176.
docs/hrx.mdstill called the NaN source open and pointed at page migration. It now states the root cause (the LDS-only barrier beforepack_completed_q8, fixed in llama.cpp00adc2bvia 1bit-MONSTER/llama.cpp#28 and #29) and the measured fix. The decode-split note now says the kernel stays off by default for speed, not correctness: per the existing table it is slower on Qwen3-0.6B and ZAYA1-8B and faster only on Coder-30B. Docs only.🤖 Generated with Claude Code