[PR #1273] [CLOSED] added llama_runner_timeout ModelFile parameter for longer timeouts #10534

Closed
opened 2026-04-12 23:02:38 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/1273
Author: @bigattichouse
Created: 11/25/2023
Status: Closed

Base: mainHead: main


📝 Commits (1)

  • 29c0bc1 added llama_runner_timeout ModelFile parameter to allow user to select longer or shorter timeouts when waiting for the llama runner in response to 'timed out waiting for llama runner to start' error

📊 Changes

3 files changed (+6 additions, -1 deletions)

View changed files

📝 api/types.go (+1 -0)
📝 llm/llama.go (+1 -1)
📝 llm/llm.go (+4 -0)

📄 Description

Allows the user to choose longer or shorter timeouts in the ModelFile for how long the server will wait for the llama runner. Created this patch in response to 'timed out waiting for llama runner to start' error.

Defaults to the 3 minutes hard coded in the current main branch.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/1273 **Author:** [@bigattichouse](https://github.com/bigattichouse) **Created:** 11/25/2023 **Status:** ❌ Closed **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (1) - [`29c0bc1`](https://github.com/ollama/ollama/commit/29c0bc16d25ecdbba63d44edf7e97dc6b631b13b) added llama_runner_timeout ModelFile parameter to allow user to select longer or shorter timeouts when waiting for the llama runner in response to 'timed out waiting for llama runner to start' error ### 📊 Changes **3 files changed** (+6 additions, -1 deletions) <details> <summary>View changed files</summary> 📝 `api/types.go` (+1 -0) 📝 `llm/llama.go` (+1 -1) 📝 `llm/llm.go` (+4 -0) </details> ### 📄 Description Allows the user to choose longer or shorter timeouts in the ModelFile for how long the server will wait for the llama runner. Created this patch in response to 'timed out waiting for llama runner to start' error. Defaults to the 3 minutes hard coded in the current main branch. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-12 23:02:38 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#10534