You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Part of #255 (ADR-0023, ADR-0013). Read docs/evals.md process rules before touching corpus, labels or metrics.
Cases
Clean match rate. Over a set of "clean up / tighten / fix headings" prompts on corpus notes, the share of b2_edit calls that apply without NoMatch or Ambiguous.
Preservation. After applying all proposals, every [[wikilink]], heading and frontmatter key the note had is still present unless the prompt asked to remove it.
Judged quality. A judge scores the resulting note against the prompt, as answers are scored today.
Honesty. A prompt with nothing to fix yields zero proposals and an answer that says so.
Report per model tier (PR #250). The result decides whether edit mode is on by default for the shipped model or gated by tier. Record the run in docs/evals.md.
Activity