[PR #11330] [MERGED] Reduce default parallelism to 1 #18781

Closed
opened 2026-04-16 06:46:18 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/11330
Author: @dhiltgen
Created: 7/8/2025
Status: Merged
Merged: 7/8/2025
Merged by: @dhiltgen

Base: mainHead: num_parallel


📝 Commits (1)

  • 1598ef8 Reduce default parallelism to 1

📊 Changes

3 files changed (+4 additions, -6 deletions)

View changed files

📝 docs/faq.md (+2 -2)
📝 envconfig/config.go (+1 -1)
📝 server/sched.go (+1 -3)

📄 Description

The current scheduler algorithm of picking the paralellism based on available VRAM complicates the upcoming dynamic layer memory allocation algorithm. This changes the default to 1, with the intent going forward that parallelism is explicit and will no longer be dynamically determinied. Removal of the dynamic logic will come in a follow up.

This behavior change should be release noted.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/11330 **Author:** [@dhiltgen](https://github.com/dhiltgen) **Created:** 7/8/2025 **Status:** ✅ Merged **Merged:** 7/8/2025 **Merged by:** [@dhiltgen](https://github.com/dhiltgen) **Base:** `main` ← **Head:** `num_parallel` --- ### 📝 Commits (1) - [`1598ef8`](https://github.com/ollama/ollama/commit/1598ef87700dc9afaee430ca1848bb407f78e307) Reduce default parallelism to 1 ### 📊 Changes **3 files changed** (+4 additions, -6 deletions) <details> <summary>View changed files</summary> 📝 `docs/faq.md` (+2 -2) 📝 `envconfig/config.go` (+1 -1) 📝 `server/sched.go` (+1 -3) </details> ### 📄 Description The current scheduler algorithm of picking the paralellism based on available VRAM complicates the upcoming dynamic layer memory allocation algorithm. This changes the default to 1, with the intent going forward that parallelism is explicit and will no longer be dynamically determinied. Removal of the dynamic logic will come in a follow up. This behavior change should be release noted. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-16 06:46:18 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#18781