Skip to content

perf(test): measure the Windows column of the wall-clock baseline and the gate, affected-run and corpus targets #10241

Open

Description

@kyle-sexton

Parent: #3716 (slice 2 of 3). Blocked by #10200 (slice 1).
Runs in: HOST. Needs a healthy Windows 11 Git Bash host; the lane runs on Linux; the host runner works it.

Problem

#3716 criteria 1 to 4 are Windows measurements: the Windows column of the baseline table, no gate script over 60 s, scripts/affected-tests.sh --run on a typical 50-file diff under 2 minutes, and the full scripts/run-plugin-tests.sh corpus under 10 minutes with the number recorded. No current Windows number exists; the last ones are from 2026-09-04 to 2026-09-08 (#3716 comment), before many optimizations.

Fix

On a Windows host that does not carry the #3715 process-creation condition (or record that it does), at a stated origin/main commit:

  1. Run the full corpus with slice 1's timing option and fill the Windows column of docs/test-wall-clock-baseline.md, with the total.
  2. Time each gate script slice 1 lists in its typical single-diff invocation.
  3. Run scripts/affected-tests.sh --run over a real merged 50-file diff (name the commit range) and record the time.
  4. Open one PR with the doc update. In the PR body list every gate script over 60 s, and say whether criteria 3 and 4 are met.

Done when

  • docs/test-wall-clock-baseline.md has a filled Windows column, the host's OS build, Git Bash version and the commit measured
  • The doc records the full-corpus Windows total and the 50-file affected-tests.sh --run time with its commit range
  • The PR body lists each gate script over 60 s on Windows, or states there is none
  • A comment on test-perf: diagnose and cut the wall clock of the local test and gate corpus, especially on Windows Git Bash #3716 states which of criteria 2, 3 and 4 are met, so per-offender slices can be filed for the rest
  • ci-status is green on the PR head

Split by the backlog HITL session (2026-10-25, owner rule Q93: split large work before a run picks it up). This was generated by AI.

Activity

  1. added
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Oct 26, 2026
  2. github-actions commented on Oct 26, 2026

    @github-actions
    Contributor

    Proposed work class: work-class: scoped
    Basis: automated intake triage; the lanes App applied this class.

    Size: Small
    Complexity: Medium
    Uncertainty: Known
    Flags: none
    Blocked by: #10200

    Understood: on a Windows 11 Git Bash host, measure the full test corpus, the gate scripts, and a 50-file affected-tests.sh --run. Then fill the Windows column of docs/test-wall-clock-baseline.md and open one PR. The work needs the timing option and baseline doc from #10200 first. The Windows measurements need a host run, which an unattended Linux lane can't do. I found no duplicates among the open issues.

    Automated triage, applied by the lanes App.

  3. added
    priority: mediumReal value, no hard deadline; normal backlog flow.
    and removed
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Oct 26, 2026
  4. added
    status: readyTriaged, unblocked, and fully specified; eligible to pick up.
    work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.
    on Oct 26, 2026
  5. melodic-automation-lanes commented on Oct 26, 2026

    @melodic-automation-lanes
    Contributor

    Not admitted to the issue lane yet: blocker #10200 is not closed by a listed human or a merge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    priority: mediumReal value, no hard deadline; normal backlog flow.status: readyTriaged, unblocked, and fully specified; eligible to pick up.work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.

    Type

    Fields

    No fields configured for Task.

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions