Overall Status : PARTIAL (1 test tool unavailable, 2 skipped by policy)Timestamp : 2026-04-18T01:18 UTCPR Used for Review Tests : #26953
Core Tests (#1 –12)
#
Test
Result
1
GitHub MCP — last 2 merged PRs
✅ (response oversized, fetched via pagination)
2
mcpscripts-gh — list 2 PRs
✅ (#26968 , #26966 )
3
Serena MCP — activate + find 3+ symbols
✅ (CompileWorkflow, validateWorkflowData, generateAndValidateYAML, +)
4
Make build
✅ go build succeeded
5
Playwright — github.com title contains "GitHub"
✅ "GitHub · Change is constant."
6
Tavily web search — "GitHub Agentic Workflows"
✅ 3 results returned
7
File writing — smoke-test-claude-24593507195.txt
✅ Created
8
Bash tool — verify file contents
✅ cat output verified
9
Discussion interaction — comment on #26967
✅ Comic-book comment posted
10
Agentic Workflows MCP — status smoke-claude
❌ Tool unavailable: failed to get workflow statuses
11
Slack safe output
✅ Posted to #smoke-tests
12
Code scanning alert safe output
✅ Warning posted on README.md:1
PR Review Tests (#13 –19)
#
Test
Result
13
Update PR body (append)
✅ Appended test message
14
PR review comments (2 lines)
✅ 2 inline comments on invocation_context_helpers.cjs
15
Submit PR review (COMMENT)
✅ Review submitted
16
Resolve review thread
⚠️ Skipped — review threads filtered by integrity policy
17
Add reviewer (copilot)
✅ Copilot added as reviewer
18
Push to PR branch
✅ smoke-test-files/smoke-claude-push-test.md pushed
19
Close PR (conditional)
⚠️ Skipped — no safe test PR to close
Details
Test #10 — Agentic Workflows MCP Error
MCP error -32603: calling "tools/call": failed to get workflow statuses
The status file was written to /tmp/gh-aw/agent/smoke-claude-status-24593507195.txt with error note.
Test #16 — Integrity Policy
The get_review_comments call returned empty due to integrity filtering:
Resource 'pr:#26953 ' has lower integrity than agent requires.
🔒 Integrity filter blocked 1 item
The following item were blocked because they don't meet the GitHub integrity level.
To allow these resources, lower min-integrity in your GitHub frontmatter:
tools :
github :
min-integrity : approved # merged | approved | unapproved | none
💥 [THE END] — Illustrated by Smoke Claude · ● 287.8K · ◷
Test Results — Run §24593507195
Overall Status: PARTIAL (1 test tool unavailable, 2 skipped by policy)
Timestamp: 2026-04-18T01:18 UTC
PR Used for Review Tests: #26953
Core Tests (#1–12)
CompileWorkflow,validateWorkflowData,generateAndValidateYAML, +)go buildsucceededcatoutput verifiedsmoke-claudefailed to get workflow statusesPR Review Tests (#13–19)
invocation_context_helpers.cjssmoke-test-files/smoke-claude-push-test.mdpushedDetails
Test #10 — Agentic Workflows MCP Error
The status file was written to
/tmp/gh-aw/agent/smoke-claude-status-24593507195.txtwith error note.Test #16 — Integrity Policy
The
get_review_commentscall returned empty due to integrity filtering:Note
🔒 Integrity filter blocked 1 item
The following item were blocked because they don't meet the GitHub integrity level.
pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".To allow these resources, lower
min-integrityin your GitHub frontmatter: