Skip to content

cli: run warm proxy queries concurrently - #733

Merged
justrach merged 1 commit into
release/0.2.5850from
codex/cli-proxy-concurrency
Aug 29, 2026
Merged

cli: run warm proxy queries concurrently#733
justrach merged 1 commit into
release/0.2.5850from
codex/cli-proxy-concurrency

Conversation

@justrach

Copy link
Copy Markdown
Owner

Summary

  • replace the POSIX warm CLI proxy's sequential query dispatch with a bounded eight-way dispatcher
  • drain accepted work before a version/handoff retirement so Explorer/Store lifetimes stay safe
  • preserve the existing Windows named-pipe behavior until it has equivalent bounded ownership handoff
  • add a regression test for the concurrency gate

Why

The production embeddings origin is not the current bottleneck: it sustained 32 concurrent 25-input requests (800 embeddings) in 161.6 ms with 100% success. Agent-style codedb context calls were instead stair-stepping because the per-project warm CLI daemon handled one connection at a time.

Benchmark

Eight concurrent hybrid context calls on macOS, same workload:

Before After
Successes 8/8 8/8
Wall time 6.44 s 2.69 s
Median latency 3.30 s 2.18 s
Worst latency 6.43 s 2.68 s

This reduces concurrent wall time by about 58%. The GPU reported no new overload failures.

Verification

  • zig build test
  • python3 scripts/e2e_mcp_test.py --binary zig-out/bin/codedb --project /Users/blackfloofie/tmp/codedb-cli-concurrency (76/76 passed)
  • live eight-way hybrid context benchmark (8/8 passed)
  • direct origin concurrency matrix through 32 simultaneous requests (all passed)

@github-actions

Copy link
Copy Markdown

👋 Thanks for the contribution! Quick heads-up: this repo lands changes on the current release/* branch, not main.

Please retarget this PR via Edit → base branch to the active release/* branch shown in the repository branch list.

(Automated hint — reply here if you need a hand.)

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Aug 29, 2026

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review Completed 2026-08-29T04:17:32.075267Z 09ada3d PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@justrach
justrach changed the base branch from main to release/0.2.5850 August 29, 2026 04:15
@justrach
justrach merged commit fa73c70 into release/0.2.5850 Aug 29, 2026
3 of 4 checks passed
@justrach
justrach deleted the codex/cli-proxy-concurrency branch August 29, 2026 04:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant