github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-07-15 12:48:05 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #11803] Where can I find documentation on how to configure environment variables, such as setting concurrency and video memory usage #7830

New Issue
Closed
opened 2026-04-12 20:00:02 -05:00 by GiteaMirror · 3 comments
GiteaMirror commented 2026-04-12 20:00:02 -05:00
Owner
Copy Link

Originally created by @F5Psyche on GitHub (Aug 8, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/11803

Where can I find documentation on how to configure environment variables, such as setting concurrency and video memory usage

Originally created by @F5Psyche on GitHub (Aug 8, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/11803 Where can I find documentation on how to configure environment variables, such as setting concurrency and video memory usage
GiteaMirror commented 2026-04-12 20:00:03 -05:00
Author
Owner
Copy Link

@ice6 commented on GitHub (Aug 8, 2025):

+1 for OLLAMA_KEEP_ALIVE, it seems the env params setting is not work for the GUI app on windows 11.

<!-- gh-comment-id:3167074594 --> @ice6 commented on GitHub (Aug 8, 2025): +1 for `OLLAMA_KEEP_ALIVE`, it seems the env params setting is not work for the GUI app on windows 11.
GiteaMirror commented 2026-04-12 20:00:04 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Aug 8, 2025):

https://github.com/ollama/ollama/blob/main/docs/faq.md#how-do-i-configure-ollama-server

The ollama server can show this list of tunable parameters (although some of the newer ones haven't been added yet):

$ ollama serve --help
Start ollama

Usage:
  ollama serve [flags]

Aliases:
  serve, start

Flags:
  -h, --help   help for serve

Environment Variables:
      OLLAMA_DEBUG               Show additional debug information (e.g. OLLAMA_DEBUG=1)
      OLLAMA_HOST                IP Address for the ollama server (default 127.0.0.1:11434)
      OLLAMA_KEEP_ALIVE          The duration that models stay loaded in memory (default "5m")
      OLLAMA_MAX_LOADED_MODELS   Maximum number of loaded models per GPU
      OLLAMA_MAX_QUEUE           Maximum number of queued requests
      OLLAMA_MODELS              The path to the models directory
      OLLAMA_NUM_PARALLEL        Maximum number of parallel requests
      OLLAMA_NOPRUNE             Do not prune model blobs on startup
      OLLAMA_ORIGINS             A comma separated list of allowed origins
      OLLAMA_SCHED_SPREAD        Always schedule model across all GPUs
      OLLAMA_FLASH_ATTENTION     Enabled flash attention
      OLLAMA_KV_CACHE_TYPE       Quantization type for the K/V cache (default: f16)
      OLLAMA_LLM_LIBRARY         Set LLM library to bypass autodetection
      OLLAMA_GPU_OVERHEAD        Reserve a portion of VRAM per GPU (bytes)
      OLLAMA_LOAD_TIMEOUT        How long to allow model loads to stall before giving up (default "5m")
<!-- gh-comment-id:3167843935 --> @rick-github commented on GitHub (Aug 8, 2025): https://github.com/ollama/ollama/blob/main/docs/faq.md#how-do-i-configure-ollama-server The ollama server can show this list of tunable parameters (although some of the newer ones haven't been added yet): ```console $ ollama serve --help Start ollama Usage: ollama serve [flags] Aliases: serve, start Flags: -h, --help help for serve Environment Variables: OLLAMA_DEBUG Show additional debug information (e.g. OLLAMA_DEBUG=1) OLLAMA_HOST IP Address for the ollama server (default 127.0.0.1:11434) OLLAMA_KEEP_ALIVE The duration that models stay loaded in memory (default "5m") OLLAMA_MAX_LOADED_MODELS Maximum number of loaded models per GPU OLLAMA_MAX_QUEUE Maximum number of queued requests OLLAMA_MODELS The path to the models directory OLLAMA_NUM_PARALLEL Maximum number of parallel requests OLLAMA_NOPRUNE Do not prune model blobs on startup OLLAMA_ORIGINS A comma separated list of allowed origins OLLAMA_SCHED_SPREAD Always schedule model across all GPUs OLLAMA_FLASH_ATTENTION Enabled flash attention OLLAMA_KV_CACHE_TYPE Quantization type for the K/V cache (default: f16) OLLAMA_LLM_LIBRARY Set LLM library to bypass autodetection OLLAMA_GPU_OVERHEAD Reserve a portion of VRAM per GPU (bytes) OLLAMA_LOAD_TIMEOUT How long to allow model loads to stall before giving up (default "5m") ```
GiteaMirror commented 2026-04-12 20:00:04 -05:00
Author
Owner
Copy Link

@ice6 commented on GitHub (Aug 9, 2025):

+1 for OLLAMA_KEEP_ALIVE, it seems the env params setting is not work for the GUI app on windows 11.

it works now, it should be a win11 problem.

<!-- gh-comment-id:3169663445 --> @ice6 commented on GitHub (Aug 9, 2025): > +1 for `OLLAMA_KEEP_ALIVE`, it seems the env params setting is not work for the GUI app on windows 11. it works now, it should be a win11 problem.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#7830
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?