AI Providers

Codeep supports all major AI providers. You can configure multiple providers and switch between them at any time using /provider or /settings.

Supported Providers

Every model Codeep ships

Generated straight from the client catalogue, so it lists exactly what /model will offer — 97 models across 24 providers, as of [email protected]. Ids are the exact strings the API receives.

OpenRouter (Aggregator)

One API key, 100+ models from Anthropic, OpenAI, Google, Meta, Mistral, DeepSeek, Qwen, xAI and more. Useful when you want to experiment with multiple providers without managing separate keys, or want OpenRouter to auto-route to the best model for the task.

export OPENROUTER_API_KEY=sk-or-v1-...
codeep /provider openrouter
codeep /model                        # fetches the live 100+ model catalogue with pricing

Or, save your key once on the dashboard under Provider keys and sync to any machine with codeep account sync.

Codeep uses the cost OpenRouter reports per call (in usage.cost) — your dashboard sees the same figures as your OpenRouter invoice, no local pricing lookup needed.

Routing preferences

OpenRouter lets you bias which upstream provider its router picks for a given model (latency, cost, geography, privacy). Configure with:

/openrouter                      # show current preferences
/openrouter prefer DeepInfra,Together   # try these first in order
/openrouter ignore OpenAI               # never route through these
/openrouter fallbacks on|off            # allow fallback when preferred providers fail
/openrouter privacy strict|allow        # strict = data_collection: deny
/openrouter clear                       # drop all preferences

Ollama (Local AI)

Run AI models fully locally — or on a remote server — without an API key. Codeep fetches your installed models automatically via the Ollama API.

Local setup

Install Ollama, pull a model, and start the server:

ollama pull qwen2.5-coder:7b
ollama serve

Then in Codeep, select the provider and pick your model:

/provider     → select "ollama"
/model        → pick from installed models (shows on-disk size)
/model browse → curated catalog of coding models; pick one to pull
/model rm <m> → remove a local model to reclaim disk

New to local models? /model browse lists recommended coding models (Qwen2.5 Coder, DeepSeek Coder V2, Llama 3.1, DeepSeek R1, …) with parameter sizes, rough VRAM, and an agent-mode hint — select one and Codeep pulls it for you.

Remote Ollama (different machine)

If Ollama runs on another machine (e.g. a home server, NAS, or Docker container), start it with OLLAMA_HOST=0.0.0.0 so it accepts external connections:

Then in Codeep, open /settings and update the Ollama URL field to point to your server:

Agent mode and model size

Codeep's agent mode requires a model capable of reliable tool use and instruction following. With Ollama, use at least a 7B parameter model for agent tasks — for example qwen2.5-coder:7b or llama3.1:8b.

Native API (beta)

By default Codeep talks to Ollama through its OpenAI-compatible /v1 endpoint, which ignores a couple of Ollama-specific options. Turn on Ollama Native API (beta) in /settings to use the native /api/chat endpoint instead, which honors:

• num_ctx — the model uses its full context window instead of Ollama's small default (auto-detected from /api/show, or set ollamaNumCtx).
• keep_alive — keeps the model resident between turns, avoiding reload latency (ollamaKeepAlive, default 30m).

Custom (OpenAI-compatible endpoints)

Run your own model behind an OpenAI-compatible server — vLLM, LiteLLM, LM Studio, or text-generation-webui — and point Codeep straight at it. No commercial provider or API key required.

Pick Custom (OpenAI-compatible) in the welcome screen or with /provider, then set the endpoint under /settings → Custom Base URL (config key customBaseUrl). Use the full base, including /v1:

# ~/.codeep/config.json
{
  "provider": "custom",
  "customBaseUrl": "http://100.88.112.5:8000/v1",
  "model": "qwen3-coder-30b"
}

Then run /model to pick from the models your server advertises (fetched live from its /models endpoint). If your endpoint requires a key, set one with /login; otherwise leave it blank.

Switching providers

Use the /provider command to interactively switch between configured providers. The new provider takes effect immediately for the next message.

Using multiple providers

You can configure API keys for multiple providers. Codeep stores all keys securely. Use /login to add a key for any provider without changing the active one.