Skip to content

eval plan ACTIVE: audit fold (22/24 claims confirmed, 0/11 specs sound → all v2) + #923 board record - #924

Merged
AdaWorldAPI merged 2 commits into
mainfrom
claude/jirak-math-theorems-harvest-rfii13
Aug 11, 2026
Merged

eval plan ACTIVE: audit fold (22/24 claims confirmed, 0/11 specs sound → all v2) + #923 board record#924
AdaWorldAPI merged 2 commits into
mainfrom
claude/jirak-math-theorems-harvest-rfii13

Conversation

@AdaWorldAPI

@AdaWorldAPI AdaWorldAPI commented Aug 11, 2026

Copy link
Copy Markdown
Owner

Two commits. The first is the #923 board record (hygiene). The second — folded here per operator direction — is the audit fold that flips the evaluation plan ACTIVE, which makes this PR mixed, so it carries its own content and will warrant its own arc entry.

The audit (13 agents, 13/13 completed, 0 errors — plan §8 is the full record)

Verify: 22 of 24 KNOWN claims CONFIRMED against source with file:line quotes. 2 PARTIAL, corrected in place:

  • K-23 — the bitboard functions live at ndarray/src/bitwise.rs, not src/hpc/.
  • K-21 — "whole-field shift" overstated: legA rigid-translates a 24×24 sprite within a 256×256 field (bit-exact, O(1) in sprite pixels), toroidally. Knowledge doc gains §12.18 correcting §12.16's "2 bytes moves the whole field".

Attack: 11 of 11 EV specs NOT SOUND (10 VACUOUS, 1 UNDERSPECIFIED). Every §3 spec is rewritten to a v2 folding the fixes. Highlights:

EV v1 defect v2 fix
EV-1 calm-tile silence half was an identity comparison (shift rounds to 0 below 3.86 m/s); missing cos(lat) (up to 2.6× error where winds are strong) direction controls (reversed + 90°-rotated shifts must NOT win), zonal spacing corrected, clipped semantics pinned
EV-2 90°-sector silence half was an arithmetic tautology (circular == linear for |a−b| ≤ 128); count > 0 = the elimination_rate() defect verbatim ground-truth Δθ pinned circular-in-f64; tautology demoted to a labelled unit test; measured discordance gap with Jirak CI
EV-3 grid search whose only guard was pre-satisfied by committed data closed-form flip-point = 99th percentile of occupancy-weighted interior CI
EV-4 "monotone" satisfiable by a dead knob strict monotonicity + the 1e-12 knob-reached-the-code proof
EV-5 fixture 404s at the pinned timestep; the anomaly step destroys the bound-mass under test; Kelvin floors on fractions fixture gate + raw-[0,1] quantization + native-unit floors + re-based premise
EV-6 "exact to 1e-4" over 3-sig-fig prose constants AND Monte-Carlo statistics — the rounding incident rebuilt inside the gate full-precision constants for P1; own-seed K≥20 resamples with a 3σ gate for P2; frame-participation canary
EV-7a claim names top-k, no criterion touches top-k brute-force top-k reference + digest-pinned fixture + host-conditional envelope
EV-7b prescribed the instrument its own citation bans; two arms only prove arithmetic 2-D DFT only; third (coprime) arm; R_hi ≥ 10·R_lo pre-registered
EV-8 pass criterion could not fail; wrong n (the grid, not the 200 000 sampled pairs) seed-resample CIs; codec-consistency framing stated plainly
EV-9 two of four assertions implied by their own subject analytic tolerances, asymmetric disable-run, the SPREAD ratio (≥ 20×)
EV-10 a "winter" run could pass on stale summer bytes (fetch_bg.py hardcodes t, skips-if-exists) --t argument, per-timestep dirs, manifest assertion, one factor at a time

The meta-finding (banked as E-ZERO-FOR-ELEVEN-…-1)

The same author was 22/24 reliable about what IS and 0/11 about what would FALSIFY — one document after being corrected for exactly these failure modes, citing the falsifiability rule inside the specs themselves. Pre-registration review by independent adversarial readers is load-bearing, not ceremony: the spec's author is structurally the wrong person to find its vacuous pass routes.

Scope

Board hygiene (#923 record) + the plan §3 rewrite/§8/ACTIVE flip + knowledge-doc §12.18 + EPIPHANIES + AGENT_LOG. No code changes.

🤖 Generated with Claude Code

https://claude.ai/code/session_01CcpLeEC3XK8Eye53GKBVvi

Summary by CodeRabbit

  • Documentation
    • Updated evaluation guidance with corrected movement semantics and implementation notes.
    • Expanded validation criteria to cover formulas, fixtures, controls, deterministic behavior, and anti-vacuity checks.
    • Documented audit results, including identified specification gaps and corrected conclusions.
    • Added verification notes for circular-distance behavior and related measurements.
    • Refreshed project status, workflow history, and knowledge records with the latest findings.

… verdict inversions

#923 merged with neither board file updated. It shipped a plan, public code,
three epiphanies and four knowledge-doc corrections — squarely not hygiene-only,
so the merged-PR row's obligations apply in full.

The entry records what #923 settled:

- Topology selects the TABLE FORMULA; it never decides whether a quantity
  belongs in the palette domain. circular() = min(|a-b|, 256-|a-b|) proven a
  metric EXHAUSTIVELY (0 violations / 16,777,216 triples), so distance.rs's
  "raw-azimuth is NOT a metric (the 2pi wrap)" is about the formula, not angles.

- The LUT is the [a,b] amortization point: quantize() normalizes once at
  ingest, from_floor() folds the same normalization into the table, and
  afterwards comparisons are pure lookups in unit-free units. O(256^2) once
  instead of O(N^2).

- Judge a normalized representation by what its FIELD does, not by what one
  element decodes to — a per-element accuracy number is the round-trip metric
  wearing a different hat.

- Three verdict changes on ONE question are recorded as such: §12.13 ranked the
  bearing encodes by reconstruction error (the banned metric), §12.14 inverted
  it on field ergonomics, §12.15 found §12.14 too strong — the fix was never
  "abandon the direct path", it was give the wrapping lane its own table.

- The expensive one: perturbation_sim::RollingFloor ALREADY IS the corrected
  evaluation frame, Jirak citation included, and I re-derived it in Python. It
  is the fourth instance of one frame in this workspace.

Deferrals carried forward: the plan ships DRAFT-pending-audit (§8 folds a
13-agent verify/attack pass and flips it ACTIVE — that audit had NOT completed
at merge, so any [H] row stays unconfirmed); no from_bearing minted; EV-1..
EV-10 all Queued; D-1..D-6 open; the dormant-lane defect filed not fixed.

Also recorded: helix is root-workspace-excluded and in no CI workflow, so its
tests run only by hand; two pre-existing 1.97 clippy findings were deliberately
left alone rather than sweeping files outside scope; and the #922 merge race —
five commits stacked on merged history, rebased and reopened as #923, with
#922's description restored to describe only what it merged.

This commit is hygiene-only, so per the termination clause it generates no
further board obligations of its own.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01CcpLeEC3XK8Eye53GKBVvi
@cursor

cursor Bot commented Aug 11, 2026

Copy link
Copy Markdown

Bugbot couldn't run - usage limit reached

Bugbot is counted against Cursor usage for this user or team, and this run hit a usage or spend limit.

A user or team admin can review and increase usage limits in the Cursor dashboard.

(requestId: serverGenReqId_127bea55-ba86-4599-a4f2-f617680273f1)

@coderabbitai

coderabbitai Bot commented Aug 11, 2026

Copy link
Copy Markdown

Review Change Stack

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: a55f4dfc-0735-42d5-9a9f-8b10cdb32724

📥 Commits

Reviewing files that changed from the base of the PR and between 373d3b7 and f2e0d2c.

📒 Files selected for processing (6)
  • .claude/board/AGENT_LOG.md
  • .claude/board/EPIPHANIES.md
  • .claude/board/LATEST_STATE.md
  • .claude/board/PR_ARC_INVENTORY.md
  • .claude/knowledge/weather-normalized-substrate.md
  • .claude/plans/weather-substrate-evaluation-v1.md

📝 Walkthrough

Walkthrough

The change activates an audited weather-substrate evaluation plan, replaces EV-1 through EV-10 with corrected v2 specifications, and records audit findings, Morton-motion semantics, circular-distance results, and related architectural history.

Changes

Weather evaluation plan

Layer / File(s) Summary
Audit findings and plan activation
.claude/plans/weather-substrate-evaluation-v1.md, .claude/board/AGENT_LOG.md, .claude/board/EPIPHANIES.md
The plan is now ACTIVE. The audit records 22 confirmed claims, 2 partial claims, and 11 unsound v1 specifications.
Evaluation specification revisions
.claude/plans/weather-substrate-evaluation-v1.md
K-21 and K-23 are corrected. EV-1 through EV-10 now define revised formulas, controls, fixtures, gates, sampling, and anti-vacuity checks.
Board and knowledge record updates
.claude/knowledge/weather-normalized-substrate.md, .claude/board/LATEST_STATE.md, .claude/board/PR_ARC_INVENTORY.md
The records document circular distance, Morton-motion semantics, measured findings, evaluation status, and remaining decisions.

Estimated code review effort: 2 (Simple) | ~10 minutes

Suggested reviewers: claude

Poem

I’m a rabbit with a checklist bright,
I nibbled false test claims out of sight.
V2 paths now safely run,
With verified gates for everyone.
Hop, audit, and record the light!


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

…s sound; plan ACTIVE

The 13-agent audit completed (run wf_99d677e6-b45): 13/13 agents, 0 errors.

VERIFY — 22 of 24 KNOWN claims CONFIRMED against source with file:line; 2
PARTIAL, both corrected in place: K-23's path is ndarray/src/bitwise.rs (not
src/hpc/); K-21's "whole-field shift" overstates — legA rigid-translates a
24x24 SPRITE within a 256x256 field (bit-exact, O(1) in sprite pixels), and
the shift is toroidal with a separate clipped helper. Knowledge doc gains
§12.18 correcting §12.16's "2 bytes moves the whole field" accordingly.

ATTACK — 11 of 11 EV specs NOT SOUND (10 VACUOUS, 1 UNDERSPECIFIED). Every
§3 spec is rewritten to a v2 that folds the fixes: EV-1 loses its identity
silence-half (calm tiles round the shift to 0) and gains direction controls
(reversed + 90-degree-rotated shifts must NOT win), cos(lat) zonal spacing,
clipped semantics, and a single pass criterion; EV-2 pins the circular
ground-truth definition and demotes its tautological sector test to a
labelled unit test; EV-3 replaces the grid search with the closed-form
flip-point (the 99th percentile of occupancy-weighted interior CI); EV-4
requires STRICT monotonicity plus the 1e-12 knob-reached-the-code proof;
EV-5 gates on fixture existence (total_cloud_cover 404s at the pinned t;
sea_ice_cover is in neither fetcher), quantizes the RAW [0,1] field, and
re-bases its collapsed two-sidedness premise; EV-6 splits deterministic
(full-precision JSON constants) from Monte-Carlo (own-seed resamples,
3-sigma gate) and adds a frame-participation canary; EV-7a pins fixture
digest, host-conditional envelope, and an actual top-k correctness check;
EV-7b deletes its self-banned lag-k instrument, adds the third (coprime)
arm and pre-registered R_hi >= 10*R_lo bars, and fixes "aperiodic" to
period-17-incommensurate; EV-8 is re-scoped from a rubber-stamp to
seed-resample CIs with the correct n (200,000 pairs, not the grid); EV-9
drops its two self-implied assertions and pins analytic tolerances + an
asymmetric disable-run + the SPREAD ratio; EV-10 kills the stale-fixture
route (--t argument, per-timestep dirs, manifest assertion) and varies one
factor at a time.

§8 is the audit record; the plan header flips DRAFT -> ACTIVE.

Meta-finding, banked as E-ZERO-FOR-ELEVEN-THE-AUTHOR-CANNOT-AUDIT-HIS-OWN-
FALSIFIERS-1: the same author was 22/24 reliable about what IS and 0/11 about
what would FALSIFY, one document after being corrected for exactly these
modes. Pre-registration review by independent adversarial readers is
load-bearing, not ceremony.

AGENT_LOG carries the run entry (sole-writer rule: agents wrote no board
files; the orchestrator consolidates).

Per operator direction, this folds into the open follow-up PR (#924), which
is now mixed rather than hygiene-only.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01CcpLeEC3XK8Eye53GKBVvi
@AdaWorldAPI AdaWorldAPI changed the title docs(board): record #923 — the evaluation plan, circular(), and three verdict inversions eval plan ACTIVE: audit fold (22/24 claims confirmed, 0/11 specs sound → all v2) + #923 board record Aug 11, 2026
@AdaWorldAPI
AdaWorldAPI marked this pull request as ready for review August 11, 2026 10:36
@AdaWorldAPI
AdaWorldAPI merged commit 8812c47 into main Aug 11, 2026
1 check passed
AdaWorldAPI pushed a commit that referenced this pull request Aug 11, 2026
…the ACTIVE plan

#924 merged with neither board file updated. It was MIXED — hygiene for #923
plus the audit fold, the §3 v2 rewrite, §8, the DRAFT->ACTIVE flip, §12.18 and
two board entries — so the merged-PR obligations apply to the non-hygiene half.

The entry records what #924 settled:

- The meta-finding: pre-registration review by independent adversarial readers
  is load-bearing, not ceremony. The audit split sharply by KIND of statement —
  22 of 24 KNOWN claims CONFIRMED with file:line, but 0 of 11 EV test specs
  SOUND. The author was reliable about what IS and near-uniformly unreliable
  about what would FALSIFY, one document after being corrected for exactly
  those modes and citing the falsifiability rule inside the specs themselves.

- Two [G] ledger corrections: the bitboard primitives are at
  ndarray/src/bitwise.rs, not src/hpc/; and "whole-field shift" overstated —
  legA rigid-translates a 24x24 SPRITE within a 256x256 field, toroidally, so
  §12.16's "2 bytes moves the whole field" is corrected by §12.18. Whole-field
  advection is one (dx,dy) PER TILE, which is what EV-1 actually tests.

- The eleven spec defects catalogued by class, including the ones with teeth: a
  silence half that was an identity comparison; another that was an arithmetic
  tautology; a fixture that 404s at the pinned timestep feeding a pipeline whose
  anomaly step destroys the bound-mass under test; an "exact to 1e-4" gate over
  3-sig-fig prose AND Monte-Carlo statistics; a "winter" run that could pass on
  stale summer bytes; and a missing cos(lat) wrong by up to 2.6x exactly where
  the probe would fire.

Honest limit recorded in the Confidence line: the audit's verify half is [G]
(source quotes), but its attack half is a DESIGN REVIEW, not a measurement — a
v2 spec is audited, not validated. Validation is the probe run, and zero EVs
have run. STATUS_BOARD gains a note that the rows' descriptions summarize v1
shapes while the specs are now v2.

EV-9 (Wave 0) needs no data and is the unblocked next move; it closes the only
two [H] rows.

This commit is hygiene-only, so per the termination clause it generates no
further board obligations of its own.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01CcpLeEC3XK8Eye53GKBVvi
AdaWorldAPI added a commit that referenced this pull request Aug 11, 2026
…arvest-rfii13

docs(board): record #924 — the 0-of-11 spec audit and the ACTIVE plan
AdaWorldAPI pushed a commit that referenced this pull request Aug 12, 2026
…ng, and the append-only audit could not fail

Operator: "930 has comments / check also previous 5 / if you want go back
another 5." All 68 review comments on #920-#930 enumerated and checked against
the TREE, not the merge. Depth is non-uniform and said so: #922-#930
finding-by-finding; #920 (27) and #921 (5) spot-checked on P1/governance only
(both clean), ~30 older findings there left explicitly UNVERIFIED.

Clean: #922/#924/#925/#929 zero comments; all 27 of #926's findings fixed in
the tree (equal-budget grid_pts + regenerated E2 JSON, seam-wrapping
subgrid_min, find_center->None, F7d 35->40, CT_F12 NO-VERDICT, persisted storm
metadata, np.roll longitude, __file__-relative write, net-decay E6, the
93-97%->90.9-94.3% headline); #923's plan-status P2 resolved.

Three open, all frozen in append-only ledgers, all corrected in NEW entries:

1. "+92.76 Pa moves R2 in the 5th decimal" is refuted by the report's own
   carve table 15 lines above it: carve A's +92.76 Pa moved R2 0.9212->0.9129
   (0.0083, THIRD decimal); carve D's +1.59 Pa moved it 2.4e-06 (SIXTH). The
   var() BUG was blind at every magnitude; the STATISTIC is near-blind only in
   the single-digit-Pa regime -- which is exactly where "lossless" was claimed.
2. "10 probe scripts with committed JSON" undercounts: 15 .py added, 11 with a
   committed .json.
3. "+13/-0, +10/-0, +0/-0": measured +13/-0, +17/-0, and EPIPHANIES absent from
   the net diff -- it was +1/-1 at 0f9e6bc (the in-place edit), zeroed by the
   revert. The +0/-0 was a revert artefact, not evidence of purity.

And the audit METHOD is replaced: zero-deletions proves ADDITIVE, not PREPEND.
The suffix check (new.endswith(old)) proves it. Both halves measured before
banking: a constructed end-append scores zero-del=True/suffix=False; a true
prepend True/True. It also fires on THIS PR (LATEST_STATE suffix=False at
+15/-0) -- correctly, since #930 inserts table rows mid-file and composes an
unmerged entry in place. A False is a demand for justification, not a verdict.

Same defect shape as #930's relation error, twice in three days: two
individually-true numbers asserted of one pair when each belongs to a
different one. A figure-by-figure check cannot catch it; the relation must be
evaluated as a claim. Already standing in report SS10.1 and the worker
preamble of weather-w-probes-v1 (both verified present, not assumed).

Co-Authored-By: Claude <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01CcpLeEC3XK8Eye53GKBVvi
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants