Skip learn auto-init on -p — that was Pi’s wall win - #668
Closed
justrach wants to merge 2 commits into
Closed
Conversation
Pi's SWE wall win was not a shorter catalog. Every graff-dev task made 5 API calls — the bootstrap floor — then copied 132M graff-pinned and generated suites (~38s CPU). Interactive REPL/TUI/ACP still auto-init.
justrach
marked this pull request as ready for review
August 29, 2026 03:05
After the skip, graff-dev is 5/6 in 205s / 6.5s CPU (was 4/6, 456s, 230s CPU). json-stream passed this rep; label-sort still fails.
Owner
Author
|
The oneshot-only learn skip is not tip behavior — the hardlink pin is. Closing; do not merge. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Pi was not a smarter catalog. Same-seat SWE (
run-20260828-164346, ADR 0043) was a wash on tokens and calls (30 vs 31). Pi’s 276s vs graff’s 456s was 38s of local CPU on every task.Every graff-dev SWE task made exactly 5 API calls — the
learn_autobootstrap floor — thenstartBackgroundLearningcopied 132M.graff/learn-kit/graff-pinnedand generated suites.Change
startBackgroundLearningis a no-op on-p/--json. Interactive REPL/TUI/ACP still auto-init after 5 model calls.Confirm (
run-20260829-031139.jsonl)json-streampassed this rep (the model kept “no RS → empty” instead of inventing a missing-delimiter raise). That earlier Pi 5/6 vs graff 4/6 was one-rep noise on the same SPEC clause, not a catalog gap.label-sortstill fails — grok-build and Pi miss it too.Do not steal Pi’s 4-tool catalog or heap. RSS ~91M is the process, not the pin.
Recorded as ADR 0044.