Running Open WebUI Locally with OLLAMA

docker run -d -p 3000:8080 \
  -v ollama:/root/.ollama \
  -v open-webui:/app/backend/data \
  --name open-webui \
  --restart always --gpus all \
  ghcr.io/open-webui/open-webui:ollama

Local Models (https://ollama.com/library)

• devstral-small-2:24b
• qwen3.6:27b
• gemma4:26b

Configuring OpenCode

  "openwebui": {
      "npm": "@ai-sdk/openai-compatible",
      "name": "Open WebUI",
      "options": {
        "baseURL": "http://10.20.30.40:3001/api",
        "apiKey": "eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpZCI6ImUzM2ViODcyLTUxZmYtNDU5ZS05ZmVmLWIyZWFhNjgwOTY5NCIsImV4cCI6MTc4MzIzOTIzNCwianRpIjoiZWJhZTVlYjUtZmYyNS00YjU1LThkOTQtNDhjZDhkNjAzNDc0IiwiaWF0IjoxNzgwODIwMDM0fQ.nWXNnpXTlo8AX0Dx8UmpmOnrS7t3QVQZEYrSOg4Y1tQ"
      },
      "models": {
        "devstral-small-2:24b": { "name": "devstral-small-2:24b" },
        "qwen2.5-coder:14b": { "name": "Qwen2.5 Coder 14B" }
      }
    }

ssh  user@10.20.30.40 -R 0.0.0.0:3001:localhost:3000