Concise skills rollout: plugin-quality (3 skills, 2 model-invoked) #6588

Activity

1. kyle-sexton

   added a parent issue on Oct 7, 2026

   • Concise skills: one skill-creation standard, evals, and a fleet-wide rollout #6476
2. github-actions

   added

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 7, 2026
3. github-actions commented on Oct 7, 2026

   

   github-actionsBot

   on Oct 7, 2026 – with GitHub Actions

   Last edited by melodic-automation-lanes

   Contributor

   More actions

   Proposed work class: work-class: scoped
   Basis: automated intake triage; the lanes App applied this class.

   Size: Medium
   Complexity: Medium
   Uncertainty: Known
   Flags: none
   Blocked by: none

   I understand this as the per-plugin skills rewrite of plugin-quality (audit, report, setup), done in one draft PR under #6476. It follows the rewrite-a-plugin runbook. The PR needs probe files for the two model-invoked skills, a per-skill decision table, a list of anything left unmeasured, and a version or changelog entry. Eval spend is on prepaid credit, so I've added no cost flag. The done-when items are specific enough to act on, and I found nothing missing and no likely duplicates.

   _{Automated triage, applied by the lanes App.}
4. github-actions

   added

   needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

   on Oct 7, 2026
5. kyle-sexton

   removed

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 12, 2026
6. kyle-sexton

   added the

   Task

   issue type on Oct 12, 2026
7. kyle-sexton

   removed

   needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

   on Oct 24, 2026
8. kyle-sexton commented on Oct 24, 2026

   

   kyle-sexton

   on Oct 24, 2026

   MemberAuthor

   More actions

   Released by the owner's HITL session (2026-10-24, C12): it waited only on a removed gate. Intake triage re-runs on it to set its fields, then admission takes it.
9. github-actions commented on Oct 25, 2026

   

   github-actionsBot

   on Oct 25, 2026 – with GitHub Actions

   Last edited by github-actions

   Contributor

   More actions

   The triage sweep dispatched intake triage for this issue (attempt 1 of 2).
10. github-actions

    added

    priority: mediumReal value, no hard deadline; normal backlog flow.Real value, no hard deadline; normal backlog flow.

    on Oct 25, 2026
11. melodic-automation-lanes

    added

    status: readyTriaged, unblocked, and fully specified; eligible to pick up.Triaged, unblocked, and fully specified; eligible to pick up.

    work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.A briefed fix or small feature; blast radius bounded by the brief, tests exist.

    admission-deferredReady for the issue lane; work-unblock admits it when queued work is under the queued capReady for the issue lane; work-unblock admits it when queued work is under the queued cap

    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.Fully specified and briefed; eligible for autonomous pickup from the frontier.

    and removed

    admission-deferredReady for the issue lane; work-unblock admits it when queued work is under the queued capReady for the issue lane; work-unblock admits it when queued work is under the queued cap

    on Oct 25, 2026
12. melodic-automation-lanes commented on Oct 25, 2026

    

    melodic-automation-lanesBot

    on Oct 25, 2026

    Contributor

    More actions

    The lanes App's pull request #9999 merged with Refs:, so this issue stays open and nothing starts the lane on it again. work-unblock removed status: ready and agent-ready, so the hourly triage sweep sends it back to intake triage, which decides what work is left and admits it again.
13. melodic-automation-lanes

    added

    status: readyTriaged, unblocked, and fully specified; eligible to pick up.Triaged, unblocked, and fully specified; eligible to pick up.

    admission-deferredReady for the issue lane; work-unblock admits it when queued work is under the queued capReady for the issue lane; work-unblock admits it when queued work is under the queued cap

    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.Fully specified and briefed; eligible for autonomous pickup from the frontier.

    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

    and removed

    status: readyTriaged, unblocked, and fully specified; eligible to pick up.Triaged, unblocked, and fully specified; eligible to pick up.

    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.Fully specified and briefed; eligible for autonomous pickup from the frontier.

    admission-deferredReady for the issue lane; work-unblock admits it when queued work is under the queued capReady for the issue lane; work-unblock admits it when queued work is under the queued cap

    on Oct 25, 2026
14. melodic-automation-lanes commented on Oct 25, 2026

    

    melodic-automation-lanesBot

    on Oct 25, 2026

    Contributor

    More actions

    The work-resolve-issue lane stopped partway through this issue and needs a person.

    Why, in the run's own words:

    This lane cannot run the measurements the rewrite protocol needs before anything ships. The runbook (plugins/playbooks/skills/skill-authoring/reference/rewrite-a-plugin.md) and skill-criteria.md 'Measurement' step 6 ('ship only parts that were measured'; 'A cut to an existing skill ships only when its evals show no loss') require several runs: /evals:plugin-eval preflight, a smoke pass on the before version, /evals:validate, judge calibration, before and after eval passes on each target model, /skill-quality:check measure-invocation over a held-out probe set written outside the repository, and /docs-hygiene:compress compare with two labelers. The issue's Done-when also needs /skill-quality:check and /evals:validate results and a decision table backed by before and after numbers. The CI lane loads only the work-items, discovery and knowledge plugins, and its Bash runs only the named wrappers, so the evals, skill-quality and docs-hygiene skills and the claude plugin eval CLI are not available here. An unmeasured rewrite cannot ship under the protocol. Writing cases alone, without the smoke pass and freeze, would leave half-finished work that a later run would have to redo, so nothing was started. This issue needs a session that has the evals, skill-quality and docs-hygiene plugins and the prepaid eval credit (Q46, --max-cost-usd 5 per pass).

    What the run says it did not do:

    • Inventory and before-state /skill-quality:check plugins/plugin-quality run: the skill-quality plugin is not loaded in this lane
    • Outcome cases via /evals:design, /evals:validate, judge calibration, and the before-version smoke pass with freeze: the evals plugin and the paid eval runner are not available in this lane
    • Held-out probe set and /skill-quality:check measure-invocation triggering runs: not available in this lane
    • Rewriting the audit, report and setup skills: not started, because the protocol ships only measured parts and nothing could be measured here
    • Before and after measurement, the /docs-hygiene:compress compare meaning diff, and the per-skill decision table for the PR body: not available in this lane
    • plugin-quality changelog fragment: not written, since nothing in the plugin changed

    Run: https://github.com/melodic-software/claude-code-plugins/actions/runs/40208741583

    To retry, remove needs-human and add agent-ready again.