Skip to content

feat(codex): sync persisted threads into T3 - #5741

Closed
seeb1337 wants to merge 3 commits into
pingdotgg:mainfrom
seeb1337:fix/codex-thread-discovery
Closed

feat(codex): sync persisted threads into T3#5741
seeb1337 wants to merge 3 commits into
pingdotgg:mainfrom
seeb1337:fix/codex-thread-discovery

Conversation

@seeb1337

@seeb1337 seeb1337 commented Aug 8, 2026

Copy link
Copy Markdown

Problem

T3 projects only threads created inside T3, so persisted conversations created by Codex do not appear in the T3 thread list even though Codex can enumerate and resume them.

Solution

  • Add an optional provider thread-catalog capability and implement it for Codex with the supported app-server thread/list API.
  • Fetch every non-archived page newest-first with rollout scan/repair enabled, de-duplicate overlapping pages, and guard repeated cursors.
  • Reconcile native Codex threads into T3 projects, threads, and durable resume bindings when the server becomes active, every 30 seconds, and when provider instances change.
  • Preserve existing T3-created mappings, locally deleted imports, user-edited titles, live session state, and current runtime-directory state.
  • Share Codex app-server connection setup between discovery and interactive sessions so binary, launch arguments, environment, and CODEX_HOME handling cannot drift.
  • Treat imported stopped sessions as established conversations while still honoring a selected New worktree mode on the first T3 follow-up.

Only lightweight catalog metadata and continuation bindings are imported. Existing Codex messages are not copied or modified.

Relates to #207.

Reliability

  • Stable project, thread, and command IDs make retries idempotent.
  • Compatible instances sharing one continuation identity are grouped to prevent duplicate discovery.
  • Provider pages are loaded before sampling T3 projections and live sessions.
  • Live adapter bindings take precedence over persisted stopped bindings.
  • Metadata refreshes never rewrite an existing projected session or runtime status.
  • Provider title updates carry an expected-title precondition, so a concurrent user rename always wins.
  • Discovery fibers park behind ServerActivation, so standby/trial servers cannot mutate the shared T3 home.
  • Per-source discovery is time-bounded, failure-isolated, and serialized.

Relationship to #5146

#5146 provides an explicit project-scoped snapshot import using thread/list and thread/read. This PR provides automatic ongoing catalog synchronization across configured Codex homes, with direct continuation of the native thread and no history snapshot.

Validation

Rebased onto current main at 0d38866dc.

  • pnpm exec vp check — 2,515 files formatted; 2,390 files linted with no warnings or errors.
  • pnpm exec vp run typecheck — all 15 targets passed.
  • Focused validation — 7 files, 94 tests passed:
    • decider.titleRegeneration.test.ts
    • CodexAppServerConnection.test.ts
    • ProviderThreadDiscovery.test.ts
    • CodexSessionRuntime.test.ts
    • CodexAdapter.test.ts
    • serverActivation.test.ts
    • ChatView.logic.test.ts

Implemented with Codex (GPT-5) through T3 Code.


Note

Medium Risk
Background discovery periodically spawns Codex processes and dispatches orchestration commands, but serialization, idempotent IDs, expectedTitle guards, and binding precedence reduce duplicate or destructive updates.

Overview
Adds automatic discovery and import of persisted Codex conversations into T3’s thread list, with ongoing reconciliation in the background.

Server / Codex: Optional listThreads on provider adapters; Codex lists non-ephemeral threads via app-server thread/list (paginated, de-duplicated). Shared makeCodexAppServerConnection replaces duplicated spawn/setup in session runtime. New ProviderThreadDiscovery layer runs on boot, every ~30s, and on provider instance changes—creating projects/threads and resume bindings for unlinked threads, refreshing metadata when Codex updatedAt moves, and skipping T3-native mappings, local deletes, and duplicate catalogs per CODEX_HOME.

Orchestration: thread.meta.update gains expectedTitle so provider-driven title refreshes do not overwrite titles the user changed after discovery sampled state (same pattern as expectedBranch).

Web: Send flow treats threads with a stopped imported session (no local messages) as already started—follow-ups resume instead of re-bootstrap/title seed. Worktree creation uses shouldPrepareWorktreeForSend (worktree mode + no path yet), not “first message only.”

Docs note that message history is not copied into T3.

Reviewed by Cursor Bugbot for commit 9bf0a9f. Bugbot is set up for automated code reviews on this repo. Configure here.

Note

Sync persisted Codex threads into T3 as importable projects

  • Adds ProviderThreadDiscoveryLive in ProviderThreadDiscovery.ts that runs every 30s and on instance changes, importing non-ephemeral Codex threads as T3 projects with durable resume bindings.
  • Adds listThreads to the Codex adapter, backed by a paginated listAllCodexThreads utility that de-duplicates across pages and stops safely on cursor repetition.
  • Extends thread.meta.update with an expectedTitle field for optimistic concurrency — title updates are skipped if the current title has diverged.
  • Updates ChatView send logic to treat imported threads as already-started, skipping re-bootstrap and only gating worktree preparation when needed.
  • Behavioral Change: the server runtime now runs background discovery; threads that Codex considers ephemeral are excluded from import.

Macroscope summarized 9bf0a9f.

@coderabbitai

coderabbitai Bot commented Aug 8, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Repository UI

Review profile: CHILL

Plan: Pro Plus

Run ID: c49d5376-1962-4e96-ade1-ef45dd6cfc09

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions github-actions Bot added vouch:unvouched PR author is not yet trusted in the VOUCHED list. size:XL 500-999 changed lines (additions + deletions). labels Aug 8, 2026
Comment thread apps/web/src/components/ChatView.tsx

@macroscopeapp macroscopeapp Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One error-modeling note on the new listThreads wrapper in CodexAdapter.ts. Everything else (namespace subpath imports, env-based dependency acquisition in makeCodexAppServerConnection and ProviderThreadDiscoveryLive, no ManagedRuntime/runPromise/fake Layer.succeed seams, layer wiring in server.ts) matches the conventions.

Posted via Macroscope — Effect Service Conventions

Comment thread apps/server/src/provider/Layers/CodexAdapter.ts Outdated
Comment thread apps/server/src/provider/Layers/ProviderThreadDiscovery.ts Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 18e0e5a32c

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread apps/server/src/provider/Layers/ProviderThreadDiscovery.ts Outdated
@macroscopeapp

macroscopeapp Bot commented Aug 8, 2026

Copy link
Copy Markdown
Contributor

Approvability

Verdict: Needs human review

This PR introduces a significant new feature (automatic Codex thread discovery and import) with background processing, external process spawning, and orchestration integration. New features with this scope warrant human review.

You can customize Macroscope's approvability policy. Learn more.

@seeb1337
seeb1337 force-pushed the fix/codex-thread-discovery branch from 18e0e5a to c72b57d Compare August 9, 2026 23:13
Comment thread apps/server/src/provider/Layers/ProviderThreadDiscovery.ts
@seeb1337

seeb1337 commented Aug 9, 2026

Copy link
Copy Markdown
Author

Corrected all mentioned things above. Its really useful feature, as some of users are working with T3 Code and sometimes with Codex, the threads aren't shared. Now it makes it fully synced with codex threads, and update in background live new threads so it becomes fully synced all time. A lot of people still use both, and this improves the UX of T3 Code.

@cursor cursor Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using high effort and found 2 potential issues.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 9bf0a9f. Configure here.

metadata: nextMetadata,
}),
};
yield* input.upsertBinding(nextBinding);

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Refresh clobbers worktree cwd

High Severity

Metadata refresh always upserts runtimePayload with cwd from the Codex catalog. After an imported thread's New worktree follow-up, ProviderService persists the worktree path, but the next discovery pass (Codex updatedAt advances) shallow-merges catalog cwd back over it. Later recoverSession / persisted-cwd resume can restart outside the worktree even though thread.worktreePath is set.

Additional Locations (1)
Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit 9bf0a9f. Configure here.

// The synchronizer keeps the first binding for a provider thread.
// Prefer the live adapter view so a persisted stopped binding cannot
// mask a follow-up that became active while discovery was running.
bindings: [...activeBindings, ...persistedBindings],

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Live bindings hide import metadata

Medium Severity

Active adapter bindings are preferred but omit runtimePayload, so readImportMetadata returns nothing and the synchronizer treats a running imported thread as a T3-native link and skips refresh. Title and recency sync are stalled for the whole live session even though a persisted import binding with metadata is available right behind it.

Additional Locations (1)
Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit 9bf0a9f. Configure here.

@t3dotgg

t3dotgg commented Aug 23, 2026

Copy link
Copy Markdown
Member

Note

🤖 GPT-5.6 Sol responding on behalf of Theo

Closing this PR after an automated pass over open pull requests. Adds a broad thread-import or state-transfer system that overlaps trusted work in #5499.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:XL 500-999 changed lines (additions + deletions). vouch:unvouched PR author is not yet trusted in the VOUCHED list.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants