multi-agent: paired model-routing eval for retrieval, review and mechanical-edit roles #6901

Activity

1. github-actions

   added

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 11, 2026
2. github-actions commented on Oct 11, 2026

   

   github-actionsBot

   on Oct 11, 2026 – with GitHub Actions

   Last edited by github-actions

   Contributor

   More actions

   Proposed work class: none

   Thanks for the report. Automated triage handed this issue to a maintainer.

   _{Automated triage. A maintainer reviews it.}
3. github-actions

   added

   needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

   on Oct 11, 2026
4. kyle-sexton

   added the

   Task

   issue type on Oct 12, 2026
5. kyle-sexton

   removed

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 12, 2026
6. kyle-sexton

   added sub-issues on Oct 25, 2026

   • test(multi-agent): routing eval cases for the retrieval role #10009
   • test(multi-agent): routing eval cases for the review role #10012
   • test(multi-agent): routing eval cases for the mechanical-edit role #10017
   • perf(multi-agent): run the paired routing eval and confirm or change the role defaults #10022
7. kyle-sexton

   removed

   needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

   on Oct 25, 2026
8. github-actions

   added

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

   on Oct 25, 2026
9. melodic-automation-lanes commented on Oct 25, 2026

   

   melodic-automation-lanesBot

   on Oct 25, 2026

   Contributor

   More actions

   The triage verdict left this issue at status: needs-decision:

   • no Size: line
   • no Complexity: line
   • no Uncertainty: line
   • no Flags: line
   • the triage run escalated
   • held by needs-human
   • no lanes App verdict comment shows whether an earlier verdict was flagged
10. melodic-automation-lanes

    added

    status: needs-decisionAwaiting a human or maintainer judgment call.Awaiting a human or maintainer judgment call.

    and removed

    needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

    on Oct 25, 2026
11. kyle-sexton commented on Oct 25, 2026

    

    kyle-sexton

    on Oct 25, 2026

    MemberAuthor

    More actions

    Split by the owner's HITL session (2026-10-24, C12, Q93-Q95) into sub-issues. Slices with no blocker can run in parallel; the rest wait on their blocked-by edges. Intake triage sets each slice's fields, then admission takes it.

    • test(multi-agent): routing eval cases for the retrieval role #10009 test(multi-agent): routing eval cases for the retrieval role; blocked by: none
    • test(multi-agent): routing eval cases for the review role #10012 test(multi-agent): routing eval cases for the review role; blocked by: none
    • test(multi-agent): routing eval cases for the mechanical-edit role #10017 test(multi-agent): routing eval cases for the mechanical-edit role; blocked by: none
    • perf(multi-agent): run the paired routing eval and confirm or change the role defaults #10022 perf(multi-agent): run the paired routing eval and confirm or change the role defaults; blocked by: test(multi-agent): routing eval cases for the retrieval role #10009, test(multi-agent): routing eval cases for the review role #10012, test(multi-agent): routing eval cases for the mechanical-edit role #10017