Skip to content

calibration: pick a data-backed global shipped default for quality_gate_score, then register the second ceiling knob #8280

Description

@JSONbored

Problem

quality_gate_score stayed out of the registry (#8224's recorded finding): qualityGateMinScore is per-repo nullable with no global shipped default, and every registry entry anchors on the shipped constant. Rather than inventing a number, derive it: the readiness-score capture (#8223) plus realized outcomes can backtest candidate defaults the same way every other threshold earns its value.

Requirements

⚠️ Required pattern. The default is chosen by evidence, recorded on this issue BEFORE the constant ships: replay candidate defaults over the quality_gate_score corpus (once it clears sane floors), pick the value whose backtest dominates, document the comparison. Then the registry entry mirrors #8224's ceiling shape verbatim (report_only, orientation ceiling, written bounds rationale, unique seed, >=50/12 floors).

Deliverables

  • Evidence-backed default recorded here (comparison tables)
  • DEFAULT_QUALITY_GATE_SCORE shipped + consumed as the nullable field's documented default
  • Registry entry + invariant tests, mirroring the slop knob

Links & Resources

#8224 (the ceiling precedent + recorded finding), #8223 (capture), src/services/loosening-knobs.ts

Boundaries

Report-only registration; the default must not change live gating behavior for repos with an explicit setting.

maintainer-only — gate-adjacent policy.

Metadata

Metadata

Assignees

Labels

maintainer-onlyOwner-only work — yields no Gittensor points.roadmapOn the Wave-2 agent-layer roadmap board (project 9)

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions