[GH-ISSUE #6799] Is it possible to configure ollama deployed in docker? #50800

Closed
opened 2026-04-28 17:08:06 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @wizounovziki on GitHub (Sep 14, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6799

I pull docker image from dockerhub and launched a few models and then found the num of user requests was limited.
In the documentation it shows that this could be solved by set up OLLAMA_NUM_PARALLEL by systemctl commands.
How can I do this since systemctl is not included in the docker container?

Originally created by @wizounovziki on GitHub (Sep 14, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6799 I pull docker image from dockerhub and launched a few models and then found the num of user requests was limited. In the documentation it shows that this could be solved by set up OLLAMA_NUM_PARALLEL by systemctl commands. How can I do this since systemctl is not included in the docker container?
GiteaMirror added the questiondocker labels 2026-04-28 17:08:06 -05:00
Author
Owner

@rick-github commented on GitHub (Sep 14, 2024):

Plain docker:

docker run -d -v ollama:/root/.ollama -p 11434:11434 -e OLLAMA_NUM_PARALLEL=2 --name ollama ollama/ollama

Docker compose:

services:
  ollama:
    image: ollama/ollama
    ports:
      - 11434:11434
    environment:
      - OLLAMA_NUM_PARALLEL=2 
<!-- gh-comment-id:2350957701 --> @rick-github commented on GitHub (Sep 14, 2024): Plain docker: ``` docker run -d -v ollama:/root/.ollama -p 11434:11434 -e OLLAMA_NUM_PARALLEL=2 --name ollama ollama/ollama ``` Docker compose: ```yaml services: ollama: image: ollama/ollama ports: - 11434:11434 environment: - OLLAMA_NUM_PARALLEL=2 ```
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#50800