Summary
Smoke test run for Claude engine — §22222473735
Overall Status: PARTIAL — all non-skipped tests passed, 2 tests skipped (no threads / no safe test PR to close).
PR used for review testing: #17120 (chore: bump Claude Code → 2.1.49, Copilot → 0.0.412, GitHub MCP Server → v0.31.0)
Timestamp: 2026-02-20T11:37 UTC
Test Results
| # |
Test |
Result |
| 1 |
GitHub MCP: Review last 2 merged PRs |
✅ Found PR #17106 (Remove legacy engine.steps), PR #17109 (Ubuntu runner image update) |
| 2 |
Safe Inputs GH CLI: Query 2 PRs |
✅ #17122 (fix: remove lockdown), #17120 (chore: bump versions) |
| 3 |
Serena MCP: activate_project + find_symbol |
✅ Project activated; 3 symbols found: gh-aw/main (file), main (func), runCmd (var) |
| 4 |
Make Build |
✅ go build succeeded — binary gh-aw produced |
| 5 |
Playwright: github.com navigation |
✅ Title: "GitHub · Change is constant. GitHub keeps you ahead." |
| 6 |
Tavily: "GitHub Agentic Workflows" search |
✅ Results returned (githubnext.com and others) |
| 7 |
File Writing: create test file |
✅ /tmp/gh-aw/agent/smoke-test-claude-22222473735.txt created |
| 8 |
Bash Tool: verify file |
✅ cat confirmed contents |
| 9 |
Discussion Interaction: comment on discussion |
✅ Comic-book comment added to discussion #17129 |
| 10 |
Agentic Workflows MCP: smoke-claude status |
✅ Workflow smoke-claude is active (claude engine, compiled: Yes) |
| 11 |
Update PR body |
✅ Appended test message to PR #17120 |
| 12 |
PR Review Comments (2 inline) |
✅ 2 review comments added on different files |
| 13 |
Submit PR Review |
✅ COMMENT review submitted |
| 14 |
Resolve Review Thread |
⚠️ Skipped — no review threads on PR #17120 |
| 15 |
Add Reviewer |
✅ copilot added as reviewer |
| 16 |
Push to PR Branch |
✅ Pushed smoke test commit to copilot/update-cli-tools-versions-another-one |
| 17 |
Close PR |
⚠️ Skipped — no safe test PR to close |
References:
💥 [THE END] — Illustrated by Smoke Claude for issue #17120
Summary
Smoke test run for Claude engine — §22222473735
Overall Status: PARTIAL — all non-skipped tests passed, 2 tests skipped (no threads / no safe test PR to close).
PR used for review testing: #17120 (
chore: bump Claude Code → 2.1.49, Copilot → 0.0.412, GitHub MCP Server → v0.31.0)Timestamp: 2026-02-20T11:37 UTC
Test Results
gh-aw/main(file),main(func),runCmd(var)go buildsucceeded — binarygh-awproduced/tmp/gh-aw/agent/smoke-test-claude-22222473735.txtcreatedcatconfirmed contentssmoke-claudeis active (claude engine, compiled: Yes)copilotadded as reviewercopilot/update-cli-tools-versions-another-oneReferences: