Skip to content

[aw-failures] [aw-fix] P1: Test Quality Sentinel — create_report_incomplete_issue rejected: missing incomplete_signals array #47526

Description

@github-actions

Make create_report_incomplete_issue (report_incomplete) either always carry a populated incomplete_signals array or accept an empty one — right now a single malformed message fails the whole safe_outputs job after a successful agent run.

Problem

Agent job succeeds; safe_outputs job fails at Process Safe Outputs. The create_report_incomplete_issue message is rejected for a missing required incomplete_signals array.

Affected workflows / runs

Workflow Run Agent job safe_outputs job
Test Quality Sentinel §29981402712 success failure

Evidence (from audit)

✗ Message 5 (create_report_incomplete_issue) failed: Missing or empty incomplete_signals array
1 safe output(s) failed:

Probable root cause

Schema/prompt mismatch on the report_incomplete safe-output. The agent emitted a create_report_incomplete_issue message without the required non-empty incomplete_signals array, and validation hard-fails the batch. This is the same safe-output family as the previously-fixed #46376 (report_incomplete rejected for missing workflow_name) — a new required field surfacing the same class of failure, so the earlier fix did not cover incomplete_signals.

Proposed remediation

  1. Update the workflow prompt/guidance so any report_incomplete emission always includes a populated incomplete_signals array.
  2. Relax validation to accept an empty/absent incomplete_signals (default to a single generic signal) instead of failing the entire safe-outputs batch — mirroring the [aw-failures] [aw-fix] P1: report_incomplete safe output rejected — "Missing required field: workflow_name" #46376 fix.
  3. Regression test: emit a report_incomplete with no signals and assert graceful handling.

Success criteria

  • Test Quality Sentinel safe_outputs job completes green.
  • report_incomplete with missing/empty incomplete_signals no longer hard-fails Process Safe Outputs.

Parent: #46171. Related (closed): #46376. Analyzed run: 29981402712.
Related to #46171

Generated by 🔍 [aw] Failure Investigator (6h) · age00 171 AIC · ⌖ 37.9 AIC · ⊞ 3.8K ·

  • expires on Jul 29, 2026, 11:48 PM UTC-08:00

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions