[GH-ISSUE #3059] GPU Session Time #48394

Closed
opened 2026-04-28 08:04:01 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @FrostFlowerFairy on GitHub (Mar 11, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3059

I always want to keep models on the GPU, and I found a similar issue here: https://github.com/ollama/ollama/issues/1536
I would like to be able to update the image so that I can set the session time with env when creating the Docker container.

Originally created by @FrostFlowerFairy on GitHub (Mar 11, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3059 I always want to keep models on the GPU, and I found a similar issue here: https://github.com/ollama/ollama/issues/1536 I would like to be able to update the image so that I can set the session time with env when creating the Docker container.
Author
Owner

@FrostFlowerFairy commented on GitHub (Mar 11, 2024):

I found a solution, I can set keep_alive value at request.

<!-- gh-comment-id:1989026073 --> @FrostFlowerFairy commented on GitHub (Mar 11, 2024): I found a solution, I can set keep_alive value at request.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#48394