Skip to content
ShopAssist Docs
AI

Ollama

Run ShopAssist on Ollama's cloud or your own Ollama server, with the context window set high enough.

Ollama cloud

Create an API key at ollama.com → Settings → Keys and choose the preset Ollama (cloud) (base URL https://ollama.com/v1).

Self-hosted Ollama

  1. Run Ollama behind a reverse proxy with TLS and authentication on a public HTTPS URL. ShopAssist never calls localhost or private addresses.
  2. Choose the preset Ollama (self-hosted) and enter the URL (for example https://llm.example.com/v1) and the API key your proxy expects.
  3. Pull a model with tool support.

Context window

Ollama truncates prompts to a small context by default, and ShopAssist's prompts are longer. Set num_ctx to 16384 or higher in a Modelfile:

FROM qwen3:14b
PARAMETER num_ctx 16384
ollama create shopassist-qwen -f Modelfile

Use shopassist-qwen as the model. Without it, the connection test fails with context_too_small.

Data location

Data location

Data goes wherever this endpoint runs. Self-hosted endpoints must be reachable over HTTPS with authentication.

Troubleshooting

  • endpoint_blocked: the URL is not public HTTPS on port 443.
  • ttft_slow: the first token takes more than 8 seconds; use a smaller model or a GPU.
  • tools_unsupported: the model has no tool template.

Last updated on

On this page