Skip to content

Add opt-in lossless int16 checkpoint encoding - #199

Draft
rawsh wants to merge 3 commits into
Ascend:release/v0.1.10from
rawsh:feature/lossless-checkpoint-routes
Draft

rawsh wants to merge 3 commits into
Ascend:release/v0.1.10from
rawsh:feature/lossless-checkpoint-routes

Conversation

@rawsh

@rawsh rawsh commented Oct 16, 2026

Copy link
Copy Markdown

Add default-off checkpoint_uint8_fields to SimpleStorage: eligible named CPU int16 tensors serialize as uint8 and native load restores int16; all other fields and pending state remain intact.

This targets the active release/v0.1.10 checkpoint owner. Eight retained shards round-trip every field exactly, reducing total TQ bytes from 5,354,198,012 to 3,618,909,504 (32.41%); original checkpoint bytes remain unchanged. Older readers reject opt-in files before installing state.

Validation: 27 focused real-object/unit/public-API tests pass, plus Ruff and compileall. Full optional-backend CI and exact GPU training/save/resume parity remain pending; no live adoption or wrapper changes.

rawsh added 3 commits October 16, 2026 03:37
Signed-off-by: Robert Washbourne <rawashbourne@gmail.com>
Signed-off-by: Robert Washbourne <rawashbourne@gmail.com>
Signed-off-by: Robert Washbourne <rawashbourne@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant