Skip to content

Define v0.5 public evidence benchmark workflow#14

Merged
ehsanestaji merged 1 commit into
mainfrom
feature/public-evidence-benchmarks
Jul 3, 2026
Merged

Define v0.5 public evidence benchmark workflow#14
ehsanestaji merged 1 commit into
mainfrom
feature/public-evidence-benchmarks

Conversation

@ehsanestaji

Copy link
Copy Markdown
Owner

Summary

  • Add a v0.5 public evidence workflow page for local smoke runs and public NCBI assembly evidence.
  • Enrich the public assembly manifest with evidence role, expected scale, and downstream route fields.
  • Carry those manifest fields through collect_evidence.py into evidence_summary.json and evidence_summary.tsv.
  • Add guard tests for the public evidence manifest, doc page, and summary metadata columns.

Verification

  • Red tests failed before implementation for missing manifest metadata, missing v0.5 evidence doc, and missing summary columns.
  • python3 -m unittest discover -s tests/python
  • cargo test --locked
  • git diff --check
  • git diff --cached --check
  • Public wording scan for disallowed development-tool naming returned no matches.
  • Local evidence smoke run: python3 scripts/collect_evidence.py --binary target/release/fastaguard --out-dir target/evidence/v0.5-local-smoke --local-only
  • NCBI source URL checks returned HTTP 200 for GCF_000005845.2 and GCF_000182925.2.

@ehsanestaji ehsanestaji force-pushed the feature/public-evidence-benchmarks branch from f2428d2 to f02564d Compare July 3, 2026 18:24
@ehsanestaji ehsanestaji merged commit 2f6d2b6 into main Jul 3, 2026
2 checks passed
@ehsanestaji ehsanestaji deleted the feature/public-evidence-benchmarks branch July 3, 2026 18:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant