Skip to content

ci: mutation-testing gate via flawd, report-only while it soaks - #66

Merged
fohara merged 2 commits into
mainfrom
ci/mutation-gate
Aug 27, 2026
Merged

ci: mutation-testing gate via flawd, report-only while it soaks#66
fohara merged 2 commits into
mainfrom
ci/mutation-gate

Conversation

@fohara

@fohara fohara commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Lands the mutation-testing workflow: diff-scoped flawd ci on PRs, weekly full-depth audit on main, SARIF → code scanning, report artifact. Threshold 0 = report-only: this is a dogfooding gate being soaked in public before any enforcement is considered.

  • Install: public release mirror + sha256 verification (v0.14.0 pinned)
  • Entitlement: flawd activate from the FLAWD_LICENSE_KEY repo secret (already set); fork PRs skip with a visible notice since secrets aren't available to them
  • Backend: native isolation via flawd.ci.toml (same scope/budgets as flawd.toml) — measured on this repo: setup ≈2min warm, a small PR-shaped judged run ≈5.5min end to end (probe run)
  • Local full-audit baseline for context: 98.7% verified score at the 400-mutant budget

The rehearsal history lives on the (closed) probe PR #63.

fohara added 2 commits August 27, 2026 06:42
Diff-scoped 'flawd ci' on pull requests and a weekly full-depth audit
on main, with SARIF into code scanning and the full report as an
artifact. Threshold is 0: this is a dogfooding gate being soaked in
public before any enforcement — reds here are findings, not blockers,
until the score history earns a real threshold.

Runners use flawd.ci.toml (same scope and budgets as flawd.toml; native
execution backend, the documented hosted-runner setup — an ephemeral VM
gains nothing from a per-run Docker image build). Fork PRs are skipped
with an explanatory notice because repository secrets are unavailable
to them. flawd is installed from the public release mirror with
checksum verification and activated from a repo secret.
…iff pass

The next flawd release emits a valid empty SARIF on that path; the
guard stays harmless after the version bump.
@fohara
fohara merged commit 19219c0 into main Aug 27, 2026
23 checks passed
@fohara
fohara deleted the ci/mutation-gate branch August 27, 2026 13:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant