Automated smoke test run for Claude engine validation.
Run: §24787456549
Timestamp: 2026-04-22T15:41 UTC
PR Used for Review Testing: #27851 - Disable shell history expansion for bash scripts and MCP CLI wrappers
Core Test Results
| # |
Test |
Status |
| 1 |
GitHub MCP Testing (last 2 merged PRs: #27872, #27868) |
✅ |
| 2 |
MCP Scripts GH CLI Testing (gh pr list → #27864, #27862) |
✅ |
| 3 |
Serena MCP Testing (activated project, found 7 symbols for Run) |
✅ |
| 4 |
Make Build Testing (make build succeeded) |
✅ |
| 5 |
Playwright Testing (GitHub page title contains "GitHub") |
✅ |
| 6 |
Tavily Web Search Testing (3 results for "GitHub Agentic Workflows") |
✅ |
| 7 |
File Writing Testing (/tmp/gh-aw/agent/smoke-test-claude-24787456549.txt) |
✅ |
| 8 |
Bash Tool Testing (file read back successfully) |
✅ |
| 9 |
Discussion Interaction Testing (comment on discussion #27856) |
✅ |
| 10 |
Agentic Workflows MCP Testing |
❌ |
| 11 |
Slack Script Safe Output Testing (post_slack_message) |
✅ |
| 12 |
Code Scanning Alert Safe Output Testing |
✅ |
Test #10 Error Detail
Error: MCP error -32603: calling "tools/call": failed to get workflow statuses
Status written to /tmp/gh-aw/agent/smoke-claude-status-24787456549.txt
PR Review Safe Output Results
| # |
Test |
Status |
| 13 |
Update PR Testing (appended to PR #27851 body) |
✅ |
| 14 |
PR Review Comment Testing (2 inline comments on PR #27851) |
✅ |
| 15 |
Submit PR Review Testing (COMMENT review submitted) |
✅ |
| 16 |
Resolve Review Thread Testing |
⚠️ skipped — could not retrieve PRRT node ID via GraphQL |
| 17 |
Add Reviewer Testing (added copilot to PR #27851) |
✅ |
| 18 |
Push to PR Branch Testing (smoke-test-files/smoke-claude-push-test.md) |
✅ |
| 19 |
Close PR Testing |
⚠️ skipped — no safe test PR to close |
Overall Status: PARTIAL
- 16 tests passed ✅
- 1 test failed ❌ (Agentic Workflows MCP — tool unavailable)
- 2 tests skipped ⚠️ (thread ID resolution, no safe PR to close)
💥 [THE END] — Illustrated by Smoke Claude · ● 165K · ◷
Automated smoke test run for Claude engine validation.
Run: §24787456549
Timestamp: 2026-04-22T15:41 UTC
PR Used for Review Testing: #27851 - Disable shell history expansion for bash scripts and MCP CLI wrappers
Core Test Results
gh pr list→ #27864, #27862)Run)make buildsucceeded)/tmp/gh-aw/agent/smoke-test-claude-24787456549.txt)post_slack_message)Test #10 Error Detail
Error:
MCP error -32603: calling "tools/call": failed to get workflow statusesStatus written to
/tmp/gh-aw/agent/smoke-claude-status-24787456549.txtPR Review Safe Output Results
copilotto PR #27851)smoke-test-files/smoke-claude-push-test.md)Overall Status: PARTIAL