[GH-ISSUE #10324] Add remote Model with local API Key (Proxy) #32539

Closed
opened 2026-04-22 13:54:40 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @9M6 on GitHub (Apr 17, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10324

I'm wondering if its possible to do a reverse proxy over to a 3rd party service, let say OpenAI/Anthropic/Huggingface, but having it accessible through Ollama API.

I was thinking of building this myself but it would be a nice feature' where Ollama becomes the defacto LLM manager.

Originally created by @9M6 on GitHub (Apr 17, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10324 I'm wondering if its possible to do a reverse proxy over to a 3rd party service, let say OpenAI/Anthropic/Huggingface, but having it accessible through Ollama API. I was thinking of building this myself but it would be a nice feature' where Ollama becomes the defacto LLM manager.
GiteaMirror added the feature request label 2026-04-22 13:54:40 -05:00
Author
Owner

@rick-github commented on GitHub (Apr 17, 2025):

litellm.

<!-- gh-comment-id:2814135169 --> @rick-github commented on GitHub (Apr 17, 2025): [litellm](https://github.com/BerriAI/litellm).
Author
Owner

@DarkReaperBoy commented on GitHub (Apr 22, 2025):

i wish the same, having ollama on background, it would be quality of life for such feature. while litellm exists, having on ollama will be decent.

<!-- gh-comment-id:2820243127 --> @DarkReaperBoy commented on GitHub (Apr 22, 2025): i wish the same, having ollama on background, it would be quality of life for such feature. while litellm exists, having on ollama will be decent.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#32539