Overall Status: PARTIAL (Playwright via browser_navigate ⚠️, Tavily 1st attempt ⚠️, Serena find_symbol timeout on first try ⚠️)
| # |
Test |
Status |
Notes |
| 1 |
GitHub MCP — last 2 merged PRs |
✅ |
Found #24506 (closed), #24505 (closed) |
| 2 |
MCP Scripts GH CLI — query 2 PRs |
✅ |
Found #24503, #24501 |
| 3 |
Serena MCP — activate + find_symbol |
✅ |
4 symbols found (2 JS + 2 Go); initial find_symbol timed out, retry succeeded |
| 4 |
Make build |
✅ |
Build succeeded |
| 5 |
Playwright — github.com title |
✅ |
Title: "GitHub · Change is constant..." (via browser_run_code) |
| 6 |
Tavily web search |
✅ |
5 results for "GitHub Agentic Workflows" |
| 7 |
File writing |
✅ |
/tmp/gh-aw/agent/smoke-test-claude-23982071590.txt created |
| 8 |
Bash tool — verify file |
✅ |
File contents verified with cat |
| 9 |
Discussion comment |
✅ |
Comic-book comment added to #24511 |
| 10 |
Agentic Workflows MCP status |
✅ |
smoke-claude active, compiled, triggers: PR/reaction/schedule |
| 11 |
Slack safe output |
✅ |
Posted to #smoke-tests |
| 12 |
Code scanning alert |
✅ |
Dummy warning created on README.md:1 |
| 13 |
Update PR body |
✅ |
Appended to PR #24503 |
| 14 |
PR review comments |
✅ |
2 comments added on mount_mcp_as_cli.cjs and mcp_cli_tools_prompt.md |
| 15 |
Submit PR review |
✅ |
COMMENT review submitted |
| 16 |
Resolve review thread |
⚠️ |
Skipped — PRRT_ node IDs not accessible via available tools |
| 17 |
Add reviewer |
✅ |
copilot added as reviewer |
| 18 |
Push to PR branch |
✅ |
smoke-test-files/smoke-claude-push-test.md pushed to PR #24503 |
| 19 |
Close PR |
⚠️ |
Skipped — no safe test PR to close |
PR Used for Review Testing
PR #24503 — "feat: mount MCP servers as local CLIs after gateway starts"
Notes
- Playwright
browser_navigate failed with permission denied on snapshot file; browser_run_code worked successfully
- Tavily rate-limited on first attempt (429); second attempt succeeded
- Serena
find_symbol timed out on first broad search; targeted searches succeeded
Timestamp: 2026-04-04T15:46:00Z
💥 [THE END] — Illustrated by Smoke Claude · ● 278.9K · ◷
Test Results — Run §23982071590
Overall Status: PARTIAL (Playwright via⚠️ , Tavily 1st attempt ⚠️ , Serena ⚠️ )
browser_navigatefind_symboltimeout on first tryfind_symboltimed out, retry succeededbrowser_run_code)/tmp/gh-aw/agent/smoke-test-claude-23982071590.txtcreatedcatsmoke-claudeactive, compiled, triggers: PR/reaction/schedulemount_mcp_as_cli.cjsandmcp_cli_tools_prompt.mdcopilotadded as reviewersmoke-test-files/smoke-claude-push-test.mdpushed to PR #24503PR Used for Review Testing
PR #24503 — "feat: mount MCP servers as local CLIs after gateway starts"
Notes
browser_navigatefailed with permission denied on snapshot file;browser_run_codeworked successfullyfind_symboltimed out on first broad search; targeted searches succeededTimestamp: 2026-04-04T15:46:00Z