[PR #10135] [MERGED] create blobs in parallel #44402

Closed
opened 2026-04-24 23:54:01 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/10135
Author: @mxyng
Created: 4/5/2025
Status: Merged
Merged: 5/5/2025
Merged by: @mxyng

Base: mainHead: mxyng/parallel-create-blobs


📝 Commits (3)

📊 Changes

6 files changed (+110 additions, -22 deletions)

View changed files

📝 cmd/cmd.go (+32 -14)
📝 cmd/cmd_test.go (+1 -1)
📝 parser/parser.go (+22 -4)
📝 progress/bar.go (+1 -1)
📝 progress/progress.go (+16 -2)
types/syncmap/syncmap.go (+38 -0)

📄 Description

quick tests show roughly 75% (30s -> 7.5s) reduction in time to create mistralai/Mistral-Small-3.1-24B-Instruct-2503.

this also caps the number of lines outputted by the progress writer however there is still much to be improved. since it only outputs the last lines that fit into the terminal, it's possible active progress lines are truncated


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/10135 **Author:** [@mxyng](https://github.com/mxyng) **Created:** 4/5/2025 **Status:** ✅ Merged **Merged:** 5/5/2025 **Merged by:** [@mxyng](https://github.com/mxyng) **Base:** `main` ← **Head:** `mxyng/parallel-create-blobs` --- ### 📝 Commits (3) - [`4dfb00e`](https://github.com/ollama/ollama/commit/4dfb00e785323ff195d3a928cf0b752c6dde8b37) default max term height - [`5cde18a`](https://github.com/ollama/ollama/commit/5cde18a5d79c857a4e723e591450f5a075613f17) error on out of tree files - [`53081fc`](https://github.com/ollama/ollama/commit/53081fc41ea9bb2176b199da18c28882817e34c4) create blobs in parallel ### 📊 Changes **6 files changed** (+110 additions, -22 deletions) <details> <summary>View changed files</summary> 📝 `cmd/cmd.go` (+32 -14) 📝 `cmd/cmd_test.go` (+1 -1) 📝 `parser/parser.go` (+22 -4) 📝 `progress/bar.go` (+1 -1) 📝 `progress/progress.go` (+16 -2) ➕ `types/syncmap/syncmap.go` (+38 -0) </details> ### 📄 Description quick tests show roughly 75% (30s -> 7.5s) reduction in time to create [mistralai/Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503). this also caps the number of lines outputted by the progress writer however there is still much to be improved. since it only outputs the last lines that fit into the terminal, it's possible active progress lines are truncated --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-24 23:54:01 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#44402