Skip to content

[symbolmap] Validate audit coverage - #1354

Merged
Quim Muntal (qmuntal) merged 1 commit into
mainfrom
qmuntal/symbolmap-audit-coverage
Nov 4, 2026
Merged

Quim Muntal (qmuntal) merged 1 commit into
mainfrom
qmuntal/symbolmap-audit-coverage

Conversation

@qmuntal

Copy link
Copy Markdown
Member

Summary

  • Freeze a flat per-item audit plan and require complete, source-pinned receipts before PR/noop publication.
  • Keep the single-agent workflow, existing limits, and safe-output protections; simplify the prompt by reusing the symbol skill and coverage guide.
  • Add coverage/provenance regression tests and document the receipt contract.

This is validation-only: it rejects incomplete coverage but does not force an early-exiting agent to continue.

Related to #1348. The catalog catch-up changes in #1352 are not included.

Validation

  • Full symbolmap component tests passed on the latest main.
  • Go vet, golangci-lint, formatting, strict workflow compilation, and run-step ShellCheck passed.
  • Real-data comparison retained all 2,317 required items, including pins, parent IDs, commits, and patch ranges; empty receipts were rejected.
  • No live workflow dispatched.

Add flat audit manifests and pinned per-item receipt validation for original assessments, API/member changes, behavioral diffs, and Go-only entries. Freeze the validator and plan before agent execution, and block PR/noop publication when coverage fails. Simplify the maintenance prompt by reusing the existing skill and coverage guide.

Refs #1348.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@qmuntal
Quim Muntal (qmuntal) requested a review from a team as a code owner November 4, 2026 09:26
Copilot AI balanced review requested due to automatic review settings November 4, 2026 09:26
@github-actions github-actions Bot added the area:github Changes files in the github area label Nov 4, 2026
@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

API consistency review

Result Scope
out of scope internal-only

The PR changes only the symbolmap maintenance workflow, its lock file, and internal symbolmap validation tooling/tests/docs. No exported Go API, framework behavior, or examples are affected, so no parity review is needed.

Generated by Go API Consistency Review Agent for #1354 · copilot · auto · 16.2 AIC · ⌖ 0.613 AIC · ⊞ 5.1K · ◷

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

Two critical coverage gaps allow filtered reports and added module-root packages to omit required API/member items while still passing audit checks without their receipts.

2 open issues
What changed in this PR

Adds a structural coverage gate to weekly symbol-map maintenance, addressing incomplete audits reported in #1348. It validates completion before publication without forcing an early-exiting agent to continue; the catalog catch-up in #1352 remains separate.

Changes:

  • Adds audit-plan and audit-check commands for frozen review items and source-pinned receipts.
  • Gates PR/noop publication using a pre-agent-built validator and recorded hashes.
  • Adds coverage/provenance regression tests and documents the receipt contract.
File Description
docs/​dotnet-go-sdk-feature-comparison.md Documents audit plans, receipts, and validation limits.
.github/​workflows/​symbolmap-maintenance-weekly.md Adds coverage validation and updates review instructions.
.github/​workflows/​symbolmap-maintenance-weekly.lock.yml Regenerates workflow steps and publication conditions.
_catalog/​cmd/​symbolmap/​main.go Registers audit commands and shares index flags.
_catalog/​cmd/​symbolmap/​main_test.go Adds coverage, provenance, and CLI regression tests.
_catalog/​cmd/​symbolmap/​audit.go Implements plan generation and receipt validation.

Review effort: Balanced

Comment thread _catalog/cmd/symbolmap/audit.go Resolved
Comment thread _catalog/cmd/symbolmap/audit.go Resolved
Quim Muntal (qmuntal) added a commit that referenced this pull request Nov 4, 2026
Record the diagnostic filter in changes reports and require explicitly unfiltered input when planning an audit. Include exported declarations and members when the module-root package is added, using the canonical package-name helper. Add regressions for filtered report admission and root-member receipts, and clarify the coverage documentation.

Addresses review feedback on #1354.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@qmuntal
Quim Muntal (qmuntal) added this pull request to the merge queue Nov 4, 2026
Merged via the queue into main with commit 2cd194d Nov 4, 2026
24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:github Changes files in the github area

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants