Add live-status: command → one-sentence status model, pipeline and service - #17
Merged
Merged
Conversation
…ing, training, service) Mines local agent transcripts into deduplicated command groups, redacts secrets before any teacher/judge call, labels with Opus 5 teacher and judge passes, builds leakage-controlled splits, and adds SFT/DPO training, GGUF export, evaluation and a local status service with heuristic fallback. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
…raining memory fixes Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
… results Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
live-status/, a local pipeline and service that turn shell/tool commands into one live status sentence.Data. Mines Claude Code, Codex, OpenCode, OpenCode2, Cursor, Grok and PSReadLine transcripts (65,767 executions → 58,109 template groups), redacts secrets before any model call, and labels with Opus 5 teacher and judge passes. v1 splits: 3,113 train / 425 validation / 494 test. Families are leakage-controlled, and test is enriched with secret, injection and synthetic adversarial cases.
Grading. TypeSafe jev (through Vercel AI Gateway) grades outputs against the gold status. It agrees with Opus evaluations at AUC 0.92 (700 pairs) and takes seconds instead of hours.
Models (jev-accepted share of the 494 test statuses):
Service.
POST /v1/summarize-command: redaction, cache, model call, validation, then heuristic fallback. Auth/TLS/rate limits for remote use; commands are never logged.Verification.
api/client.pywith real commands, a fake credential and an injection string. The credential became "with stored credentials", the injection was described as data, repeat requests hit the cache, and the log held only hashes and statuses.live-status/tests) are added to CI.work/live-status.Limits.
🤖 Generated with Claude Code