You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add ollama_cloud.json using the OpenAI-compatible engine with dynamic
model discovery via /v1/models.
Co-developed-by: Michael Neale <michael@michaelneale.com>
Copy file name to clipboardExpand all lines: documentation/docs/getting-started/providers.md
+4-2Lines changed: 4 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -38,6 +38,7 @@ goose is compatible with a wide range of LLM providers, allowing you to choose a
38
38
|[LM Studio](https://lmstudio.ai/)| Run local models with LM Studio's OpenAI-compatible server. **Because this provider runs locally, you must first [download a model](#local-llms).**| None required. Connects to local server at `localhost:1234` by default. |
39
39
|[Mistral AI](https://mistral.ai/)| Provides access to Mistral models including general-purpose models, specialized coding models (Codestral), and multimodal models (Pixtral). |`MISTRAL_API_KEY`|
40
40
|[Ollama](https://ollama.com/)| Local model runner supporting Qwen, Llama, DeepSeek, and other open-source models. **Because this provider runs locally, you must first [download and run a model](#local-llms).**|`OLLAMA_HOST`|
41
+
|[Ollama Cloud](https://ollama.com/)| Access hosted models on ollama.com via OpenAI-compatible API. Requires an Ollama account and API key. |`OLLAMA_CLOUD_API_KEY`|
41
42
|[OpenAI](https://platform.openai.com/api-keys)| Provides gpt-4o, o1, and other advanced language models. Also supports OpenAI-compatible endpoints (e.g., self-hosted LLaMA, vLLM, KServe). **o1-mini and o1-preview are not supported because goose uses tool calling.**|`OPENAI_API_KEY`, `OPENAI_HOST` (optional), `OPENAI_ORGANIZATION` (optional), `OPENAI_PROJECT` (optional), `OPENAI_CUSTOM_HEADERS` (optional) |
42
43
|[OpenRouter](https://openrouter.ai/)| API gateway for unified access to various models with features like rate-limiting management. |`OPENROUTER_API_KEY`|
43
44
|[OVHcloud AI](https://www.ovhcloud.com/en/public-cloud/ai-endpoints/)| Provides access to open-source models including Qwen, Llama, Mistral, and DeepSeek through AI Endpoints service. |`OVHCLOUD_API_KEY`|
@@ -993,9 +994,10 @@ Here are some local providers we support:
993
994
6. Enter the host where your model is running
994
995
995
996
:::info Endpoint
996
-
For Ollama, if you don't provide a host, we set it to `localhost:11434`.
997
-
When constructing the URL, we prepend `http://` if the scheme is not `http` or `https`.
997
+
For Ollama, if you don't provide a host, we set it to `localhost:11434`.
998
+
When constructing the URL, we prepend `http://` if the scheme is not `http` or `https`.
998
999
If you're running Ollama on a different server, you'll have to set `OLLAMA_HOST=http://{host}:{port}`.
1000
+
For hosted models on ollama.com, use the **Ollama Cloud** provider instead.
0 commit comments