Skip to content

semantic: use negotiated float16 transport - #730

Merged
justrach merged 1 commit into
release/0.2.5847from
codex/embeddings-f16-client
Aug 28, 2026
Merged

semantic: use negotiated float16 transport#730
justrach merged 1 commit into
release/0.2.5847from
codex/embeddings-f16-client

Conversation

@justrach

Copy link
Copy Markdown
Owner

Summary

  • request compact base64 little-endian float16 vectors from the hosted CodeDB embedding endpoint
  • preserve JSON-float requests for custom OpenAI-compatible endpoints
  • decode either transport with strict length, encoding, index, model, and finite-number validation
  • retry the hosted request once with a freshly signed legacy JSON body when an older edge rejects negotiation
  • share the validated vector parser with advisory cosine scoring

Validation

  • zig build test
  • python3 scripts/e2e_mcp_test.py --binary zig-out/bin/codedb --project "$PWD" (76/76)
  • live production hybrid context query succeeded against embeddings.wiki.codes
  • origin parity: 25x512 minimum self-cosine 0.9999967; compressed response size reduced 58.8%

Private origin/edge support is already deployed and remains backward-compatible with released clients.

@justrach
justrach merged commit 6b2ade5 into release/0.2.5847 Aug 28, 2026
3 checks passed
@justrach
justrach deleted the codex/embeddings-f16-client branch August 28, 2026 15:42
This was referenced Aug 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant