docs(selfhost): design doc for the scheduled docs-drift audit sweep - #5794
Conversation
…3048) Phase-3 catch-all for behavioral/prose docs drift that the two mechanical siblings (presence/shape lint, schema-anchored examples) can't catch mechanically. Proposes reusing the existing fileUpstreamDriftIssues drift-report -> consolidated-GitHub-issue pipeline (fingerprinted, update-not-duplicate, kill-switch respecting, already cron-wired) for the filing half, with new work scoped to just the detection step: a bounded, rotating per-run slice of docs pages re-verified against their mapped source through the existing self-host AI provider abstraction, structured findings only with a real file:line citation each. This is the design-doc phase the issue's own text says can stay open through -- the actual scheduled job lands once this is agreed.
|
Superagent didn't find any vulnerabilities or security issues in this PR. |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #5794 +/- ##
=======================================
Coverage 95.07% 95.07%
=======================================
Files 581 581
Lines 46178 46178
Branches 14809 14809
=======================================
Hits 43906 43906
Misses 1516 1516
Partials 756 756
Flags with carried forward coverage won't be shown. Click here to find out more. 🚀 New features to boost your workflow:
|
|
Tip 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 ✅ LoopOver review result - approve/merge recommendedReview updated: 2026-07-14 16:49:13 UTC
✅ Suggested Action - Approve/Merge
Review summary Nits — 6 non-blocking
Linked issue satisfactionPartially addressed Review context
Contributor next steps
Signal definitions
[BETA] Chat with GittensoryAsk Gittensory a question about this PR directly in a comment — grounded only in the same cached, public-safe facts shown above, never a new claim.
Full command reference: https://gittensory.aethereal.dev/docs/gittensory-commands 🟩 Safe / merged · 🟦 Advisory · 🟨 Held for review · 🟥 Blocked / closed 💰 Earn for open-source contributions like this. Gittensor lets GitHub contributors earn for the work they already do — register to start earning →. Checked by LoopOver, a quiet PR intelligence layer for OSS maintainers.
|
Summary
scripts/check-docs-drift.mjspresence/shape lint, and the schema-anchored-examples phase) can't catch: behavioral/prose drift, where a docs claim was true when written and quietly stopped being true.src/upstream/ruleset.ts'sfileUpstreamDriftIssuesdrift-report → consolidated-GitHub-issue pipeline (fingerprinted, update-not-duplicate, kill-switch respecting, already cron-wired at a slow cadence) for the filing half — genuinely new work is scoped to just the detection step: a bounded, rotating per-run slice of docs pages, re-verified against their mapped source through the existing self-host AI provider abstraction (src/selfhost/ai.ts), producing structured findings only with a realfile:linecitation each.file:line(per house style):fileUpstreamDriftIssues,driftIssueUnchanged,findGitHubIssueForFingerprint, therepo-doc-refresh-sweep/maintainer-recap cron cadence patterns insrc/index.ts, and the existingdocs.self-hosting-docs-audit.tsxpage→source mapping table this sweep's own page list should extend rather than duplicate.Scope
type(scope): short summaryConventional Commit format, for examplefix(api): restore profile access checks.CONTRIBUTING.mdand does not reintroduce GitHub Pages, VitePress,site/, orCNAME.Closes #123) — a linked open issue is required for every contributor PR.Closes #3048
Validation
git diff --checknpm run actionlintnpm run typechecknpm run test:coveragelocally;codecov/patchrequires ≥99% coverage of the lines AND branches you changed (aim for 100% on your diff so CI variance does not fail near the threshold). Global coverage is a non-blocking trend with a loose 90% backstop, not the gate.npm run test:workersnpm run build:mcpnpm run test:mcp-packnpm run ui:openapi:checknpm run ui:lintnpm run ui:typechecknpm run ui:buildnpm audit --audit-level=moderateAll ran via
npm run test:ci(the full local gate) plusnpm audit --audit-level=moderate, both clean. This PR is a pure documentation addition (src/selfhost/docs-drift-audit-sweep-rfc.md, a single new.mdfile) — no.ts/.jssource changed, so there is no new Codecov patch-coverage surface;docs:drift-checkandmanifest:drift-check(both part oftest:ci) also pass unaffected.If any required check was skipped, explain why:
npm run test:cichain ran end to end.Safety
UI Evidencesection below with JPG/JPEG or PNG screenshots arranged as organized, captioned, clickable thumbnails. SVG screenshots are not used as review evidence. Review-only screenshots or recordings are not committed to the repository.Not applicable: this PR adds a single internal design doc, not a UI/API/auth/session change.
Notes
docs_drift_reportstable, the detection job, the filing job, cron wiring) is intentionally NOT implemented here, per the issue's own explicit two-phase structure — a follow-up implementation issue is the natural next step once the design questions in the doc's final section are settled by a maintainer.