Skip to content

docs(multi-agent,session-flow): fix repo-mode audit pilot findings and schedule a full sweep #6916

Open
2 of 2 issues completed

Description

@kyle-sexton

Problem

A /multi-agent:audit-defaults repo pilot was run on 2026-10-10 against Claude Code 2.1.296. It covered 12 files in multi-agent and session-flow, used 23 agents, and every finding it confirmed was upheld 3-0 by a skeptic panel. It confirmed 12 findings. The 2 about per-spawn effort were fixed in #6913. The other 10 are model and pointer hygiene outside that PR's scope:

  • plugins/multi-agent/reference/config.md:31 (stale): best is listed as a role model, but the sub-agents docs list only sonnet, opus, haiku, fable and inherit as subagent aliases. Check whether best is accepted per invocation; if not, drop it from the role values and the frontier default, otherwise point the list at sub-agents#choose-a-model.
  • plugins/multi-agent/reference/config.md:59 (copied-current): point at sub-agents#choose-a-model and workflows#cost with an as-of date and recheck trigger. The CLAUDE_CODE_SUBAGENT_MODEL caveat applies only when neither the per-invocation model nor the frontmatter sets one.
  • plugins/multi-agent/skills/route/SKILL.md:81 (copied-current): same pointer and caveat.
  • plugins/multi-agent/skills/route/SKILL.md:27 (copied-current): point the family list at model-config#model-aliases.
  • plugins/session-flow/skills/orchestrate/SKILL.md:64 (copied-current): the model-resolution fact needs a sub-agents#choose-a-model pointer; the recorded pointer covers brief contents only.
  • plugins/session-flow/skills/orchestrate/SKILL.md:114 (unpointed-judgment): cite optimizing-for-cost-and-intelligence#orchestrator-strategy-delegate-bulk-work.
  • plugins/session-flow/skills/orchestrate/SKILL.md:118 (unpointed-judgment): cite optimizing-for-cost-and-intelligence#tune-effort.
  • plugins/session-flow/skills/orchestrate/SKILL.md:134 (copied-current): point "withheld from non-fork workers" at sub-agents#available-tools or the sources.md record.
  • plugins/session-flow/skills/orchestrate/SKILL.md:168 (stale): the anchor and size bands should match workflows#set-a-size-guideline.
  • plugins/session-flow/README.md:493 (hardcoded-model-pin): use the haiku alias instead of the full ID claude-haiku-4-5.

Proposed next step

  1. Fix the 10 findings above, one PR per plugin.
  2. Schedule a full /multi-agent:audit-defaults repo sweep as its own run. Today's target list holds 110 files in 31 areas that state effort and spawn claims, and at the pilot's rate that is roughly 700 agents. Run it in waves with a pilot, during a fresh plan-usage window.

Done when

The 10 pilot findings are done (#7990, #7991, both closed). What remains is the full sweep, run in waves with a pilot wave first (owner decision 2026-10-12).

  • /multi-agent:audit-defaults repo ran over every file in its repo-mode target list, in waves after a pilot wave, and the issue has a comment with the count of files covered, findings confirmed and findings refuted.
  • Each confirmed finding is fixed in the run's PR, or filed as its own issue linked from that comment.
  • ci-status is green on the PR.

Activity

  1. added
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Oct 11, 2026
  2. github-actions commented on Oct 11, 2026

    @github-actions
    Contributor

    Thanks for the report. Automated triage handed this issue to a maintainer.

    Automated triage. A maintainer reviews it.

  3. added
    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.
    on Oct 11, 2026
  4. added theissue type on Oct 12, 2026
  5. removed
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Oct 12, 2026
  6. kyle-sexton commented on Oct 13, 2026

    @kyle-sexton
    MemberAuthor

    Decision recorded. The owner approved applying independently verified recommendations on 2026-10-12.

    • Keep best as a role model value and in the frontier default? → Drop best from role values and the frontier default
      Basis: https://code.claude.com/docs/en/sub-agents.md lines 351-357 (fetched 2026-10-12); https://code.claude.com/docs/en/model-config.md line 33; Agent tool schema in this session (model enum sonnet/opus/haiku/fable); plugins/multi-agent/reference/config.md:31,34 on origin/main
    • How to run the full repo-mode sweep? → Waves with a pilot wave first, in a fresh plan-usage window
      Basis: docs(multi-agent,session-flow): fix repo-mode audit pilot findings and schedule a full sweep #6916 body 'Proposed next step'; judgment (spend only, reversible)
    • Keep best as a role model value and in the frontier default? → Drop best from role values and the frontier default, and remove it from resolve-roles.sh ALIASES in the same change so --session-model best is rejected and the caller omits it (treated as frontier). (added by verification)
      Basis: origin/main plugins/multi-agent/scripts/resolve-roles.sh:61,135,298-302,327,335

    A 2026-10-10 repo-mode audit pilot confirmed 10 model and pointer hygiene findings in multi-agent and session-flow and proposes a full ~700-agent sweep. Main has moved since (#6998, #7009): the README haiku pin is gone and several pointers now exist, so each finding needs re-checking before fixing.

    Verification notes:

    • Implementation caveat for Q1: resolve-roles.sh:61 keeps best in ALIASES, which also validates --session-model (:135), and SESSION_FRONTIER is computed from the frontier list (:298-302). Dropping best from the frontier default while ALIASES still accepts --session-model best would make a best session count as non-frontier and let inherit fan-out workers bypass the guard. Remove best from ALIASES too (an unknown session already counts as frontier) or keep it in frontier.
    • Assumption that Workflow opts.model rejects best is unverifiable: the workflows page says agents follow the subagent model order (workflows.md line 453) without listing accepted values.

    Verified by an independent fresh-context check (confirmed, risk low): gh issue view 6916 (no owner comment); origin/main plugins/multi-agent/reference/config.md:30,34; origin/main plugins/multi-agent/reference/defaults.yaml:4,14; origin/main plugins/multi-agent/scripts/resolve-roles.sh; origin/main plugins/multi-agent/skills/route/SKILL.md:24-30,74-84; git grep claude-haiku origin/main plugins/session-flow/README.md: no match

    Admission to an agent lane stays with the work-class rules and owner ratification.

  7. kyle-sexton commented on Oct 18, 2026

    @kyle-sexton
    MemberAuthor

    This was generated by AI during backlog shaping.

    This issue is split into 3 pieces, each sized for one lane PR. Re-checked on origin/main as the decision comment requires: the README haiku pin is gone and the orchestrate choose-a-model, available-tools and size-guideline pointers now exist (session-flow orchestrate SKILL.md:189,209; context/sources.md:206,217,295), but best is still a role value and frontier default in config.md:31,34, defaults.yaml:4,23, resolve-roles.sh:30,66, setup SKILL.md:86 and drift-audit.js:200; split into the multi-agent best removal plus remaining pointers, the session-flow pointer recheck, and the paid full sweep.

    Filed pieces are sub-issues of this one, and the paced queue admits them to the lane. Unfiled pieces wait on the blocker shown. The owner approved this split in an attended backlog-shaping session on 2026-10-18.

  8. removed
    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.
    on Oct 24, 2026
  9. kyle-sexton commented on Oct 24, 2026

    @kyle-sexton
    MemberAuthor

    Released by the owner's HITL session (2026-10-24, C12): it waited only on a removed gate. Intake triage re-runs on it to set its fields, then admission takes it.

  10. kyle-sexton commented on Oct 25, 2026

    @kyle-sexton
    MemberAuthor

    Needs a run of claude (eval, probe or /usage), which the issue lane cannot do (pr-pipeline.yaml:289-314). The owner's HITL session runs it on the operator machine; no owner action needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Fields

    No fields configured for Task.

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions