Skip to content

ci(release): give quality checks thirty minutes on hosted runners - #104

Merged
rynfar merged 1 commit into
pylonfrom
ci/release-quality-timeout
Aug 26, 2026
Merged

ci(release): give quality checks thirty minutes on hosted runners#104
rynfar merged 1 commit into
pylonfrom
ci/release-quality-timeout

Conversation

@rynfar

@rynfar rynfar commented Aug 26, 2026

Copy link
Copy Markdown
Collaborator

What Changed

release.yml: the quality job's timeout-minutes goes from 10 to 30, with a comment recording why.

Why

The first nightly after the runner migration (#99), run 33004923066, built all four platforms successfully on hosted runners — macOS arm64 5.5 min, macOS x64 6.8 min, Windows 10.8 min, Linux 2.8 min — and then published nothing, because Release quality checks hit its 10-minute ceiling (GitHub reports that as cancelled) and every publish job downstream skipped.

That job runs vp run test for the whole repository serially on one runner — the same work ci.yml spreads over four jobs. Blacksmith's 8 vCPU did the Test step in 3m16s; the 4-vCPU hosted runner was still on it at 7m44s when it was cut. Expected total is around fifteen minutes, so thirty gives 2× headroom, in keeping with docs/operations/release.md's "job timeouts are generous" rule (a ceiling costs nothing; a run killed at the limit wastes the whole matrix).

Not changed: the job's shape. Sharding it like ci.yml would cut wall time but adds four jobs to every release run; nightlies run every three hours and nothing waits on this job except publish.

Checklist

  • This PR is small and focused
  • I explained what changed and why
  • I included before/after screenshots for any UI changes (no UI change)
  • I included a video for animation/interaction changes (no motion change)

Model: Claude Fable 5 · Harness: Claude Code


View with [code]smith Autofix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need. Autofix is disabled.

The release quality job runs the whole repository's check, typecheck, and test suites serially on one runner, the same work ci.yml spreads over four jobs. Blacksmith's 8 vCPU finished the Test step in 3m16s, so a 10-minute ceiling was fine. On the 4-vCPU GitHub-hosted runner that replaced it (#99) the Test step was still running at 7m44s when the ceiling cut the job, which GitHub reports as cancelled, and every publish job downstream skipped: the first nightly after the migration produced four successful platform builds and no release. Thirty minutes is roughly 2x the expected duration.
@github-actions github-actions Bot added vouch:trusted PR author is trusted by repo permissions or the VOUCHED list. size:XS labels Aug 26, 2026
@github-actions

Copy link
Copy Markdown

Thread transfer impact

✅ Thread transfer remains within every enforced ceiling.

Provider Metric Main baseline This PR Impact PR ceiling
Codex Total thread wire 13.3 KiB 13.3 KiB −2 B (−0.0%) 15.1 KiB
Codex Thread snapshot wire 6.9 KiB 6.9 KiB −3 B (−0.0%) 7.3 KiB
Codex Live turn WebSocket wire 6.4 KiB 6.4 KiB +1 B (+0.0%) 7.8 KiB
Codex Live turn WebSocket decoded 55.5 KiB 55.5 KiB 0 B (0.0%) 66.4 KiB
Codex Live turn messages 9 9 0 (0.0%) 21
Claude Total thread wire 13.3 KiB 13.3 KiB +40 B (+0.3%) 15.1 KiB
Claude Thread snapshot wire 6.9 KiB 6.9 KiB +4 B (+0.1%) 7.3 KiB
Claude Live turn WebSocket wire 6.4 KiB 6.4 KiB +36 B (+0.5%) 7.8 KiB
Claude Live turn WebSocket decoded 56.3 KiB 56.4 KiB +44 B (+0.1%) 66.4 KiB
Claude Live turn messages 9 10 +1 (+11.1%) 21

Baseline: 37208c9 · PR result: cd6c883 · Source CI: success

Scenario and decoded snapshot size

10 historical turns, 5 command tools per turn, 878.9 KiB retained MCP result per historical turn, and a 1.05 MiB retained result in the measured turn.

  • Codex decoded thread snapshot: 109.4 KiB
  • Claude decoded thread snapshot: 110.0 KiB

Updated in place by a trusted workflow. PR artifacts are strictly validated and never executed.

@rynfar
rynfar merged commit cad03c4 into pylon Aug 26, 2026
14 checks passed
@rynfar
rynfar deleted the ci/release-quality-timeout branch August 26, 2026 19:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:XS vouch:trusted PR author is trusted by repo permissions or the VOUCHED list.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant