Unable to use Ollama models - Adding chat/completions to URL

[clickbrain]

I have my Ollama endpoint on another machine and have a domain mapped to the endpoint. When I try to use it I get an error and logs seems to be saying it is not found. The model is installed, but it looks like Source is adding chat/completions to the URL. Is there any way to change this?

[jaimedevelop]

It happens the same to me. Ollama runs but somehow srcbook cannot get the models. I have srcbook running through WSL on windows.

[clickbrain]

Thought I would check in on this again to see if there is a workaround.

[nichochar]

We're using the ai SDK for ollama so I'm surprised this is happening. Can you share more about the configuration in settings and the logs you're seeing?

[abraganu-ryestrategy]

I'm having the same problem and it seems that the error is trying to reach this endpoint http://127.0.0.1:11434/api/chat/completions instead of this http://127.0.0.1:11434/api/chat my configuration is next

But srcbook keep adding the completions word at the end of the url

This is the error in the console

APICallError [AI_APICallError]: Not Found
    {
  cause: undefined,
  url: 'http://127.0.0.1:11434/api/chat/completions',
  requestBodyValues: {
    model: 'mistral-nemo',
    logit_bias: undefined,
    logprobs: undefined,
    top_logprobs: undefined,
    user: undefined,
    parallel_tool_calls: undefined,
    max_tokens: undefined,
    temperature: 0,
    top_p: undefined,
    frequency_penalty: undefined,
    presence_penalty: undefined,
    stop: undefined,
    seed: undefined,
    response_format: undefined,
    messages: [ [Object], [Object] ],
    tools: undefined,
    tool_choice: undefined
  },
  statusCode: 404,
  responseHeaders: {
    'content-length': '18',
    'content-type': 'text/plain',
    date: 'Mon, 24 Feb 2025 00:38:02 GMT'
  },
  responseBody: '404 page not found',
  isRetryable: false,
  data: undefined,
  [Symbol(vercel.ai.error)]: true,
  [Symbol(vercel.ai.error.AI_APICallError)]: true
}