Skip to content

Smoke Test: Claude - 23507109568 #22743

Description

@github-actions

Summary

Smoke test run for Claude engine, triggered on PR #22733 — Run §23507109568.

Timestamp: 2026-03-24T19:01:00Z
PR used for review tests: #22733 (copilot/fix-firewall-audit-logs-artifact)
Overall Status: PARTIAL (Serena find_symbol failed, PR push skipped, PR resolve thread skipped)


Core Tests (#1–11)

# Test Result
1 GitHub MCP — last 2 merged PRs (#22737, #22739)
2 MCP Scripts GH CLI — gh pr list --limit 2
3 Serena MCP — activate_project succeeded; find_symbol returned EOF error
4 Make Build — make build succeeded
5 Playwright — https://github.com title contains "GitHub"
6 Tavily Search — "GitHub Agentic Workflows" returned 3 results
7 File Write — /tmp/gh-aw/agent/smoke-test-claude-23507109568.txt created
8 Bash Verify — cat confirmed file contents
9 Discussion Interaction — got discussion #22721, comic comment added
10 Agentic Workflows MCP Status — smoke-claude active, schedule every 12h
11 Slack Safe Output — posted to #smoke-tests

PR Review Tests (#12–18)

# Test Result
12 Update PR body (append)
13 PR review comments (2 comments on ace-editor.lock.yml)
14 Submit PR review (COMMENT event)
15 Resolve review thread ⚠️ skipped — DIFC integrity policy blocked thread list read
16 Add reviewer (copilot)
17 Push to PR branch ⚠️ skipped — test file at /tmp is outside git repo, no changes to commit
18 Close PR ⚠️ skipped — no safe test PR to close

Error Details

Test 3 (Serena find_symbol): Serena activate_project succeeded (Go+TS+Bash project), but subsequent find_symbol calls returned EOF errors (MCP error 0: connection closed: calling "tools/call": client is closing: EOF). The MCP server appears to close the connection after activation.

Test 15 (Resolve Thread): get_review_comments returned empty due to DIFC integrity policy: Resource 'pr:github/gh-aw#22733' has lower integrity than agent requires.

References:
§23507109568

Note

🔒 Integrity filter blocked 1 item

The following item were blocked because they don't meet the GitHub integrity level.

To allow these resources, lower min-integrity in your GitHub frontmatter:

tools:
  github:
    min-integrity: approved  # merged | approved | unapproved | none

💥 [THE END] — Illustrated by Smoke Claude ·

  • expires on Mar 24, 2026, 9:07 PM UTC

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions