Summary
Overall status: PARTIAL (2 skipped, 1 fallback)
Run: §24149252240 · 2026-04-08T17:32:00Z
PR used for review tests: #25330
Core Tests (#1 –12)
#
Test
Status
1
GitHub MCP — last 2 merged PRs (#25343 , #25341 )
✅
2
MCP Scripts GH CLI — pr list --limit 2 (#25350 , #25342 )
✅
3
Serena — project activated, 12 symbols found for "Engine"
✅
4
Make Build — make build succeeded
✅
5
Playwright — github.com title contains "GitHub"
✅
6
Tavily Web Search — no Tavily MCP configured; used WebSearch fallback, results returned
⚠️
7
File Writing — /tmp/gh-aw/agent/smoke-test-claude-24149252240.txt created
✅
8
Bash Tool — cat verified file contents
✅
9
Discussion Interaction — comic-book comment on discussion #25347
✅
10
Agentic Workflows MCP — smoke-claude active, engine: claude, compiled: Yes
✅
11
Slack Safe Output — posted to #smoke-tests
✅
12
Code Scanning Alert — warning on README.md:1
✅
PR Review Tests (#13 –19) — PR #25330
#
Test
Status
13
Update PR body (append)
✅
14
PR Review Comments (2 inline comments)
✅
15
Submit PR Review (COMMENT)
✅
16
Resolve Review Thread — integrity filter blocked reading threads
⚠️
17
Add Reviewer — added copilot
✅
18
Push to PR Branch — smoke-test-files/smoke-claude-push-test.md
✅
19
Close PR — skipped (no safe test PR to close)
⚠️
Notes
Serena find_symbol timed out on first attempt with broad pattern; succeeded with scoped search (Engine in pkg/)
Playwright screenshot write failed (permissions on /tmp/gh-aw/mcp-logs/playwright/); snapshot tool worked correctly
No Tavily MCP server available in this environment; WebSearch returned 10+ results for "GitHub Agentic Workflows"
PR fix: quote ${RUNNER_TEMP} in generated shell commands and replace template expressions in run: blocks #25330 integrity filter (min-integrity: approved) blocked get_files and get_review_comments; diff retrieved via get_diff payload file instead
Note
🔒 Integrity filter blocked 1 item
The following item were blocked because they don't meet the GitHub integrity level.
To allow these resources, lower min-integrity in your GitHub frontmatter:
tools :
github :
min-integrity : approved # merged | approved | unapproved | none
💥 [THE END] — Illustrated by Smoke Claude · ● 374.4K · ◷
Summary
Overall status: PARTIAL (2 skipped, 1 fallback)
Run: §24149252240 · 2026-04-08T17:32:00Z
PR used for review tests: #25330
Core Tests (#1–12)
pr list --limit 2(#25350, #25342)make buildsucceeded/tmp/gh-aw/agent/smoke-test-claude-24149252240.txtcreatedcatverified file contentssmoke-claudeactive, engine: claude, compiled: Yes#smoke-testsPR Review Tests (#13–19) — PR #25330
copilotsmoke-test-files/smoke-claude-push-test.mdNotes
find_symboltimed out on first attempt with broad pattern; succeeded with scoped search (Engineinpkg/)/tmp/gh-aw/mcp-logs/playwright/); snapshot tool worked correctlymin-integrity: approved) blockedget_filesandget_review_comments; diff retrieved viaget_diffpayload file insteadNote
🔒 Integrity filter blocked 1 item
The following item were blocked because they don't meet the GitHub integrity level.
pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".To allow these resources, lower
min-integrityin your GitHub frontmatter: