Skip to content

[BUG] can't add ollama.com #517

@gotjoshua

Description

@gotjoshua

Bug Description

I ran into this situation that i could not succeed to add ollama.com cloud provider, not as a custom provider nor as an ollama

This will fix it but isn't merged quite yet:
BerriAI/litellm#17191

Hoping it will be merged and SurfSense will update soonish, as ollama.com offers great free models !

Deployment Type

  • SurfSense Cloud (hosted version)
  • Self-hosted version
    Both

Logs/Error Messages

frontend:
Image
backend:

backend-1   | 2025-12-02 12:38:42 - LiteLLM - DEBUG - Error getting model info: OllamaError: Error getting model info for cogito-2.1:671b. Set Ollama API Base via `OLLAMA_API_BASE` environment variable. Error: [Errno 111] Connection refused
backend-1   | 12:38:42 - LiteLLM:DEBUG: litellm_logging.py:1048 -
backend-1   |
backend-1   | POST Request Sent from LiteLLM:
backend-1   | curl -X POST \
backend-1   | https://ollama.com/api/generate \
backend-1   | -d '{'model': 'cogito-2.1:671b', 'prompt': '### User:\nHello\n\n', 'options': {}, 'stream': False, 'images': []}'
backend-1   |
backend-1   |
backend-1   | 2025-12-02 12:38:42 - LiteLLM - DEBUG -
backend-1   |
backend-1   | POST Request Sent from LiteLLM:
backend-1   | curl -X POST \
backend-1   | https://ollama.com/api/generate \
backend-1   | -d '{'model': 'cogito-2.1:671b', 'prompt': '### User:\nHello\n\n', 'options': {}, 'stream': False, 'images': []}'
backend-1   |
backend-1   |
backend-1   | 12:38:42 - LiteLLM:DEBUG: llm_http_handler.py:277 - Creating HTTP client with shared_session: None
backend-1   | 2025-12-02 12:38:42 - LiteLLM - DEBUG - Creating HTTP client with shared_session: None
backend-1   | 12:38:42 - LiteLLM:DEBUG: exception_mapping_utils.py:2357 - Logging Details: logger_fn - None | callable(logger_fn) - False
backend-1   | 2025-12-02 12:38:42 - LiteLLM - DEBUG - Logging Details: logger_fn - None | callable(logger_fn) - False
backend-1   | 12:38:42 - LiteLLM:DEBUG: litellm_logging.py:2692 - Logging Details LiteLLM-Failure Call: []
backend-1   | 2025-12-02 12:38:42 - LiteLLM - DEBUG - Logging Details LiteLLM-Failure Call: []
backend-1   | 2025-12-02 12:38:42 - app.services.llm_service - ERROR - Failed to validate LLM configuration: litellm.APIConnectionError: OllamaException - unauthorized

auth works via curl

⋗⫷⫸ curl -X POST https://ollama.com/api/chat \                                                          
          -H "Authorization: Bearer $OLLAMA_API_KEY" \
          -d '{
        "model": "cogito-2.1:671b",
        "messages": [{
          "role": "user",
          "content": "Why cant i add ollamacloud as a provider to surfsense?"
        }],
        "stream": false
      }'
{"model":"cogito-2.1:671b","created_at":"2025-12-02T12:34:58.608547609Z","message":{"role":"assistant","content":"I don't have any specific information about \"surfsense\" or \"ollamacloud\" in my knowledge base. These appear to be specific services or platforms that I'm not familiar with.\n\nIf you're trying to add a provider to a service, you might want to:\n\n1. Check the documentation for surfsense to see if ollamacloud is listed as a supported provider\n2. Look for any integration guides or API documentation\n3. Verify if you have the correct credentials or permissions needed for the integration\n4. Contact the support teams for either service for specific integration help\n\nWithout more context about what these services are and what you're trying to accomplish, I can't provide more specific guidance."},"done":true,"done_reason":"stop","total_duration":3512732379,"prompt_eval_count":45,"eval_count":146}


⋗⫷⫸ curl -X POST https://ollama.com/api/generate \                                                      
          -H "Authorization: Bearer $OLLAMA_API_KEY" \
          -d '{
        "model": "cogito-2.1:671b",
        "messages": [{
          "role": "user",
          "content": "Why cant i add ollamacloud as a provider to surfsense?"
        }],
        "stream": false
      }'
{"model":"cogito-2.1:671b","created_at":"2025-12-02T12:35:16.217464122Z","response":"","done":true,"done_reason":"load"}

Checklist

  • I have searched existing issues to ensure this is not a duplicate
  • I have provided all the required information above
  • I have added appropriate labels (bug, deployment type)

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions