[PR #5353] [CLOSED] Draft: Support Moore Threads GPU #11755

Closed
opened 2026-04-12 23:38:15 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/5353
Author: @yeahdongcn
Created: 6/28/2024
Status: Closed

Base: mainHead: mtgpu


📝 Commits (1)

  • 1da0155 Support Moore Threads GPU

📊 Changes

4 files changed (+275 additions, -0 deletions)

View changed files

📝 envconfig/config.go (+8 -0)
📝 gpu/gpu.go (+12 -0)
gpu/musa_linux.go (+248 -0)
📝 gpu/types.go (+7 -0)

📄 Description

Moore Threads, a cutting-edge GPU startup, introduces MUSA (Moore Threads Unified System Architecture) as its foundational technology. This pull request marks the initial integration of MT GPU support into Ollama, leveraging MUSA's capabilities to enhance LLM inference performance.

I am also working on integrating MTGPU support into llama.cpp and am optimistic that there will be no significant blocker issues.

Update 0703:
I was able to get it working on MTGPU.
Screenshot 2024-07-03 at 15 58 51


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/5353 **Author:** [@yeahdongcn](https://github.com/yeahdongcn) **Created:** 6/28/2024 **Status:** ❌ Closed **Base:** `main` ← **Head:** `mtgpu` --- ### 📝 Commits (1) - [`1da0155`](https://github.com/ollama/ollama/commit/1da0155f67880b9554418a8d20dd6b336a562720) Support Moore Threads GPU ### 📊 Changes **4 files changed** (+275 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `envconfig/config.go` (+8 -0) 📝 `gpu/gpu.go` (+12 -0) ➕ `gpu/musa_linux.go` (+248 -0) 📝 `gpu/types.go` (+7 -0) </details> ### 📄 Description Moore Threads, a cutting-edge GPU startup, introduces MUSA (Moore Threads Unified System Architecture) as its foundational technology. This pull request marks the initial integration of MT GPU support into Ollama, leveraging MUSA's capabilities to enhance LLM inference performance. I am also working on integrating MTGPU support into llama.cpp and am optimistic that there will be no significant blocker issues. Update 0703: I was able to get it working on MTGPU. <img width="957" alt="Screenshot 2024-07-03 at 15 58 51" src="https://github.com/ollama/ollama/assets/2831050/1237baba-71be-4335-853c-9120bcdd1f8d"> --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-12 23:38:15 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#11755