test(developer-experience): port the stays-quiet eval case #9998

Activity

1. kyle-sexton

   added the

   Task

   issue type on Oct 25, 2026
2. kyle-sexton

   added

   status: readyTriaged, unblocked, and fully specified; eligible to pick up.Triaged, unblocked, and fully specified; eligible to pick up.

   admission-deferredReady for the issue lane; work-unblock admits it when queued work is under the queued capReady for the issue lane; work-unblock admits it when queued work is under the queued cap

   on Oct 25, 2026
3. kyle-sexton

   added a parent issue on Oct 25, 2026

   • feat(developer-experience): claude plugin eval suite in GitHub Actions #6649
4. kyle-sexton

   marked this as blocked by 2 issues on Oct 25, 2026

   • chore(developer-experience): commit the hand-rolled eval scenario sources #9936
   • test(developer-experience): add shared eval fixtures for the .NET and Python repositories #9943
5. github-actions

   added

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 25, 2026
6. github-actions commented on Oct 25, 2026

   

   github-actionsBot

   on Oct 25, 2026 – with GitHub Actions

   Last edited by melodic-automation-lanes

   Contributor

   More actions

   Proposed work class: work-class: scoped
   Basis: automated intake triage; the lanes App applied this class.

   Size: Small
   Complexity: Low
   Uncertainty: Known
   Flags: none
   Blocked by: #9936, #9943

   Understood: port the stays-quiet scenario from #6649 into plugins/developer-experience/evals/ as one eval case with a deterministic grader. Done when the case loads and passes /evals:validate (no paid run) and the changelog-fragment check exits 0.

   Nothing is missing. The issue lists #9936 (commit the scenario sources) and #9943 (shared eval fixtures) as dependencies, and both are still open, so this one waits on them. I found no duplicates.

   _{Automated triage, applied by the lanes App.}
7. github-actions

   added

   priority: mediumReal value, no hard deadline; normal backlog flow.Real value, no hard deadline; normal backlog flow.

   and removed

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 25, 2026
8. melodic-automation-lanes

   added

   work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.A briefed fix or small feature; blast radius bounded by the brief, tests exist.

   and removed

   admission-deferredReady for the issue lane; work-unblock admits it when queued work is under the queued capReady for the issue lane; work-unblock admits it when queued work is under the queued cap

   on Oct 25, 2026
9. melodic-automation-lanes commented on Oct 25, 2026

   

   melodic-automation-lanesBot

   on Oct 25, 2026

   Contributor

   More actions

   Not admitted to the issue lane yet: blocker #9936 is not closed by a listed human or a merge; blocker #9943 is not closed by a listed human or a merge.
10. kyle-sexton

    marked this as blocking on Oct 25, 2026

    • test(developer-experience): run the plugin-eval suite on the eval dispatch lane and record the delta #10005
11. melodic-automation-lanes

    marked this as blocking on Oct 26, 2026

    • feat(developer-experience): claude plugin eval suite in GitHub Actions #6649