[PR #15566] [MERGED] mlx: Support NVIDIA TensorRT Model Optimizer import #77504

Closed
opened 2026-05-05 10:10:29 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/15566
Author: @dhiltgen
Created: 4/14/2026
Status: Merged
Merged: 4/28/2026
Merged by: @dhiltgen

Base: mainHead: mlx-nvidia-modelopt


📝 Commits (3)

  • 1ff086c mlx: Support NVIDIA TensorRT Model Optimizer import
  • 73b953b x/create: support FP8 safetensors import
  • d2deaf2 review comments

📊 Changes

12 files changed (+1570 additions, -331 deletions)

View changed files

📝 x/create/client/quantize.go (+9 -5)
x/create/client/quantize_test.go (+24 -0)
📝 x/create/create.go (+794 -27)
📝 x/create/create_test.go (+592 -2)
📝 x/create/dtype.go (+4 -0)
📝 x/imagegen/safetensors/safetensors.go (+2 -0)
📝 x/mlxrunner/mlx/io.go (+16 -1)
📝 x/mlxrunner/model/linear.go (+16 -7)
📝 x/models/nn/nn.go (+20 -8)
📝 x/safetensors/extractor.go (+13 -0)
📝 x/server/show.go (+14 -88)
📝 x/server/show_test.go (+66 -193)

📄 Description

Follow up from #15244


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/15566 **Author:** [@dhiltgen](https://github.com/dhiltgen) **Created:** 4/14/2026 **Status:** ✅ Merged **Merged:** 4/28/2026 **Merged by:** [@dhiltgen](https://github.com/dhiltgen) **Base:** `main` ← **Head:** `mlx-nvidia-modelopt` --- ### 📝 Commits (3) - [`1ff086c`](https://github.com/ollama/ollama/commit/1ff086c5064aff5d580e6f6b1bab525c52fd1151) mlx: Support NVIDIA TensorRT Model Optimizer import - [`73b953b`](https://github.com/ollama/ollama/commit/73b953b7aae381518818ba170a152808458c5476) x/create: support FP8 safetensors import - [`d2deaf2`](https://github.com/ollama/ollama/commit/d2deaf2f940db71ca506135cf0e9ed39214a1308) review comments ### 📊 Changes **12 files changed** (+1570 additions, -331 deletions) <details> <summary>View changed files</summary> 📝 `x/create/client/quantize.go` (+9 -5) ➕ `x/create/client/quantize_test.go` (+24 -0) 📝 `x/create/create.go` (+794 -27) 📝 `x/create/create_test.go` (+592 -2) 📝 `x/create/dtype.go` (+4 -0) 📝 `x/imagegen/safetensors/safetensors.go` (+2 -0) 📝 `x/mlxrunner/mlx/io.go` (+16 -1) 📝 `x/mlxrunner/model/linear.go` (+16 -7) 📝 `x/models/nn/nn.go` (+20 -8) 📝 `x/safetensors/extractor.go` (+13 -0) 📝 `x/server/show.go` (+14 -88) 📝 `x/server/show_test.go` (+66 -193) </details> ### 📄 Description Follow up from #15244 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-05-05 10:10:29 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#77504