[GH-ISSUE #3666] Ollama's API Confusion #28016

Closed
opened 2026-04-22 05:44:05 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @17Reset on GitHub (Apr 16, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3666

I started two ports in my server as ollama's api service ports, 8080 and 8081, 8080 as my LLM-api, 8081 as my Embedding-api, but when I add a model to 8080, I can actually see the model on port 8080 by using the following command, but the following command It should see the model for port 8081:
curl http://192.168.18.165:8081/api/tags

Originally created by @17Reset on GitHub (Apr 16, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3666 I started two ports in my server as ollama's api service ports, 8080 and 8081, 8080 as my LLM-api, 8081 as my Embedding-api, but when I add a model to 8080, I can actually see the model on port 8080 by using the following command, but the following command It should see the model for port 8081: curl http://192.168.18.165:8081/api/tags
Author
Owner

@dims commented on GitHub (Apr 16, 2024):

Are you using different OLLAMA_MODELS directory for each api service?

https://github.com/ollama/ollama/blob/main/docs/faq.md#where-are-models-stored

<!-- gh-comment-id:2058852083 --> @dims commented on GitHub (Apr 16, 2024): Are you using different `OLLAMA_MODELS` directory for each api service? https://github.com/ollama/ollama/blob/main/docs/faq.md#where-are-models-stored
Author
Owner

@dims commented on GitHub (Apr 16, 2024):

Duplicate of https://github.com/ollama/ollama/issues/3669

<!-- gh-comment-id:2058925916 --> @dims commented on GitHub (Apr 16, 2024): Duplicate of https://github.com/ollama/ollama/issues/3669
Author
Owner

@pdevine commented on GitHub (Apr 16, 2024):

This is the expected behaviour. You can use the OLLAMA_MODELS env variable as @dims mentioned to change the location.

<!-- gh-comment-id:2060055892 --> @pdevine commented on GitHub (Apr 16, 2024): This is the expected behaviour. You can use the `OLLAMA_MODELS` env variable as @dims mentioned to change the location.
Author
Owner

@17Reset commented on GitHub (Apr 17, 2024):

Thanks, I was the one who didn't read the documentation carefully.

<!-- gh-comment-id:2060261639 --> @17Reset commented on GitHub (Apr 17, 2024): Thanks, I was the one who didn't read the documentation carefully.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#28016