Skip to content

Record local semantic rejection of 350M candidate - #19

Merged
Noisemaker111 merged 1 commit into
agentsfrom
docs/live-status-local-judge
Sep 21, 2026
Merged

Noisemaker111 merged 1 commit into
agentsfrom
docs/live-status-local-judge

Conversation

@Noisemaker111

Copy link
Copy Markdown
Owner

The fast LFM2.5-350M Q8 candidate looked strong on formatting validators, but a private blinded Qwen3 8B screen found materially worse semantics than the current model. This records the 48-row paired result, reference-control behavior, uncertainty, and rejection decision so the candidate cannot be promoted from its narrow target-recall score.

Validation: report values reproduced from the saved local checkpoint; git diff --check passes. No held-out command text or model output is committed.

@Noisemaker111
Noisemaker111 merged commit c2ed381 into agents Sep 21, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant