Conversation
…dpoints The built-in Bots resolve every model through the runtime's provider strings. On the OpenAI side that means the Responses API, which api.openai.com serves and a compatible endpoint that implements only /chat/completions answers with a 404 on every message. And a model the SDK does not recognise runs under a 4096-token output cap, which a thinking model can spend entirely on reasoning, ending the turn with no text and no tool calls. OPENBOT_OPENAI_CHAT_COMPLETIONS=true builds the chat-completions client directly for the openai provider, with the same resolved key, base URL and model name the string form uses. OPENBOT_MAX_OUTPUT_TOKENS names an explicit output budget for the built-in Bots. Both default to unset, which is the behaviour before this change.
shpaw415
requested review from
MikeRyanDev,
davidmckayv,
guidovizoso,
mxmzb and
tylerslaton
as code owners
October 3, 2026 00:58
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
…dpoints
The built-in Bots resolve every model through the runtime's provider strings. On the OpenAI side that means the Responses API, which api.openai.com serves and a compatible endpoint that implements only /chat/completions answers with a 404 on every message. And a model the SDK does not recognise runs under a 4096-token output cap, which a thinking model can spend entirely on reasoning, ending the turn with no text and no tool calls.
OPENBOT_OPENAI_CHAT_COMPLETIONS=true builds the chat-completions client directly for the openai provider, with the same resolved key, base URL and model name the string form uses. OPENBOT_MAX_OUTPUT_TOKENS names an explicit output budget for the built-in Bots.
Both default to unset, which is the behaviour before this change.
What this changes
Where it runs
OpenBot is deployed as several server processes behind a load balancer, serving a whole company.
Consecutive requests from the same person reach different processes, and the process that answered a
WebSocket upgrade is rarely the one that answers the next call on that conversation.
State that outlives a single request therefore has to be shared, or the change works on one machine
and stops working the moment there are two, without saying so. That failure is worse than not
shipping the feature: it passes review, passes CI, passes a local demo, and only surfaces as a Bot
that forgets, a question nobody can answer, or a boundary that never fires.
Answer these even when the answer is "none":
MaporSetheld in a module ora factory closure does not count as somewhere.
conditional update, or an advisory lock are answers. A check-then-write is not.
and what a hundred copies of it do.
Postgres is already there and is the default answer to all of the above: a table, a unique index, a
conditional update,
LISTEN/NOTIFYfor fan-out.Boundary and audit
Changelog
CHANGELOG.mdunderUnreleased, or a sentence on why a deployment behaves nodifferently afterwards.
Proof