You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
test(planning): run the seven interview eval-first cases and file a rule slice for each case that fails #9794
Run each case on a copy of plugins/planning outside git (the repository has too many linked worktrees for the CLI to screen), one or two at a time:
claude plugin eval<copy-of-plugins/planning> --case <name> --runs 3 --judge-model opus --keep-temp
Cases: the seven from #7247 (read-back of a dictated answer, active-reply final confirmation, changes-only final brief, recommendation basis and flip, "something else" closing probe, MoSCoW scope cut before wayfind, crux question on a rejected recommendation). Size the cost ceiling from the last partial pass's costUsd. Read each result with run-validity.py and noise-report.py; for final-confirm-active-reply and final-brief-changes-only read the kept traces.
Size: Medium
Complexity: Medium
Uncertainty: Knowable
Flags: none
Understood: run the seven interview eval-first cases from #7247 against a copy of plugins/planning, post a VALID with-plugin result for each on #7269, and file a rule slice under #7269 for each case that fails on main. The paid claude plugin eval runs need an attended session, so an unattended lane can't do them. The slice-filing item depends on those results. No likely duplicates found among the open issues.
Activity
github-actions commentedon Oct 24, 2026
Proposed work class: none
Size: Medium
Complexity: Medium
Uncertainty: Knowable
Flags: none
Understood: run the seven interview eval-first cases from #7247 against a copy of plugins/planning, post a VALID with-plugin result for each on #7269, and file a rule slice under #7269 for each case that fails on main. The paid
claude plugin evalruns need an attended session, so an unattended lane can't do them. The slice-filing item depends on those results. No likely duplicates found among the open issues.Automated triage. A maintainer reviews it.