Skip to content

Run operator E2E on one Kubernetes version per PR - #6540

Merged
rdimitrov merged 1 commit into
mainfrom
rdimitrov/operator-e2e-pr-matrix
Sep 8, 2026
Merged

Run operator E2E on one Kubernetes version per PR#6540
rdimitrov merged 1 commit into
mainfrom
rdimitrov/operator-e2e-pr-matrix

Conversation

@rdimitrov

Copy link
Copy Markdown
Member

Summary

Every pull request update runs the operator E2E suite against three kind node versions. That is about 20 large-runner minutes per PR Checks run, roughly a fifth of the suite's cost, and cross-version compatibility almost never breaks within a single PR.

Run only the newest version (1.35) on pull_request events. Pushes to main and manual dispatches keep the full three-version matrix, so a version-specific regression still surfaces on main within one CI cycle rather than never.

Expected saving: about 13 large-runner minutes per PR run, roughly $330 per month at current PR volume.

Type of change

  • Other: CI/CD

Test plan

  • actionlint on the changed workflow with the repo's custom runner labels declared: clean.
  • Verified the renovate regex manager for kindest/node still matches every occurrence, including the one inside the fromJSON string, so both lists are bumped together.
  • Branch rulesets only require the CRD Schema Compatibility check, so the changed job names do not block merges.
  • This PR's own Operator CI shows a single E2E Tests Operator (kindest/node:v1.35.1) job.

Does this introduce a user-facing change?

No.

Special notes for reviewers

github.event_name inside a reusable workflow is the caller's event, so pull_request here means PR Checks and push means Main build. The matrix expression is the smallest way to make the list conditional without a separate matrix-preparation job.

Generated with Claude Code

🤖 Generated with Claude Code

Every pull request update runs the operator E2E suite against three
kind node versions, about 20 large-runner minutes per run, while
cross-version compatibility almost never breaks within a single PR.

Run only the newest version on pull_request events. Pushes to main
and manual dispatches keep the full matrix, so a version-specific
regression still surfaces on main within one CI cycle.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@rdimitrov
rdimitrov requested a review from JAORMX as a code owner September 8, 2026 11:20
@github-actions github-actions Bot added the size/XS Extra small PR: < 100 lines changed label Sep 8, 2026
@codecov

codecov Bot commented Sep 8, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 78.70%. Comparing base (1e80f9d) to head (eabb172).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #6540      +/-   ##
==========================================
+ Coverage   78.69%   78.70%   +0.01%     
==========================================
  Files         777      777              
  Lines       76797    76797              
==========================================
+ Hits        60434    60442       +8     
+ Misses      16358    16350       -8     
  Partials        5        5              

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@rdimitrov

Copy link
Copy Markdown
Member Author

/retest

1 similar comment
@rdimitrov

Copy link
Copy Markdown
Member Author

/retest

@rdimitrov
rdimitrov merged commit 2533388 into main Sep 8, 2026
73 of 74 checks passed
@rdimitrov
rdimitrov deleted the rdimitrov/operator-e2e-pr-matrix branch September 8, 2026 12:15
@github-actions github-actions Bot mentioned this pull request Sep 8, 2026
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size/XS Extra small PR: < 100 lines changed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants