Repository navigation
Conversation
Keep logical requantization across affine/MX views and reuse block-preserving axis mapping. Validate both MX BMM operands and supported formats before dtype shortcuts; preserve MX linear output conversion to the INT16 residual stream. TICO-DCO-1.0-Signed-off-by: seongwoo <mhs4670go@naver.com>
Return fresh contiguous eager and fake outputs with canonical strides, including partial blocks, singleton and empty dimensions. Preserve residual users and export-only logical MX operators without performing quantization in fake kernels. TICO-DCO-1.0-Signed-off-by: seongwoo <mhs4670go@naver.com>
Keep producer-owned affine KV storage and independent affine reads from main. Align current V to the read grid, concatenate complete attention V, then apply sequence-axis MXINT8 once. Preserve affine computation and storage returns, restrict unsupported MX cache policies, and persist MX compute policy in cache observer state. Cover actual cached adapter calibration, both layouts and shared consumers, mixed-policy state restoration, S=32 prefill and 31+1 decode Circle storage interfaces, and exact eager/export parity. The built-in reference still explicitly rejects unsupported MX value codecs. TICO-DCO-1.0-Signed-off-by: seongwoo <mhs4670go@naver.com>
Apply the past observer only to existing KV. Keep current V on its producer grid and apply MX once to the full concatenated V, without adding read-grid rounding or clipping to current tokens. Reuse FoldQuantOps float-input preservation for incompatible affine concat domains before MX, including intervening views. Retain each source qparam through explicit Dequantize inputs and keep the same-domain integer concat and affine compute paths unchanged. Add numerical Circle-prefix and actual Gemma4 regressions for independent grids, current outliers, cached calibration, and storage preservation. TICO-DCO-1.0-Signed-off-by: seongwoo <mhs4670go@naver.com>
Apply the formatting required by the current main branch after rebasing the MX changes. Keep all test behavior and assertions unchanged. TICO-DCO-1.0-Signed-off-by: seongwoo <mhs4670go@naver.com>
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This commit supports int16->mxint8 Quantize.
TICO-DCO-1.0-Signed-off-by: seongwoo mhs4670go@naver.com