[PR #15566] mlx: Support NVIDIA TensorRT Model Optimizer import #41083

Open
opened 2026-04-23 01:49:07 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/15566
Author: @dhiltgen
Created: 4/14/2026
Status: 🔄 Open

Base: mainHead: mlx-nvidia-modelopt


📝 Commits (2)

  • 903c342 mlx: Support NVIDIA TensorRT Model Optimizer import
  • 04819c7 x/create: support FP8 safetensors import

📊 Changes

11 files changed (+679 additions, -46 deletions)

View changed files

📝 x/create/client/quantize.go (+9 -5)
x/create/client/quantize_test.go (+24 -0)
📝 x/create/create.go (+293 -16)
📝 x/create/create_test.go (+194 -2)
📝 x/create/dtype.go (+4 -0)
📝 x/imagegen/safetensors/safetensors.go (+2 -0)
📝 x/mlxrunner/mlx/ops_extra.go (+27 -0)
📝 x/mlxrunner/model/linear.go (+16 -7)
📝 x/models/nn/nn.go (+20 -8)
📝 x/server/show.go (+14 -8)
📝 x/server/show_test.go (+76 -0)

📄 Description

Follow up from #15244


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/15566 **Author:** [@dhiltgen](https://github.com/dhiltgen) **Created:** 4/14/2026 **Status:** 🔄 Open **Base:** `main` ← **Head:** `mlx-nvidia-modelopt` --- ### 📝 Commits (2) - [`903c342`](https://github.com/ollama/ollama/commit/903c342bac03eda6fa79080701a8b3f7e99eb57e) mlx: Support NVIDIA TensorRT Model Optimizer import - [`04819c7`](https://github.com/ollama/ollama/commit/04819c74292c644b9498b4758a45d2dc545a73ee) x/create: support FP8 safetensors import ### 📊 Changes **11 files changed** (+679 additions, -46 deletions) <details> <summary>View changed files</summary> 📝 `x/create/client/quantize.go` (+9 -5) ➕ `x/create/client/quantize_test.go` (+24 -0) 📝 `x/create/create.go` (+293 -16) 📝 `x/create/create_test.go` (+194 -2) 📝 `x/create/dtype.go` (+4 -0) 📝 `x/imagegen/safetensors/safetensors.go` (+2 -0) 📝 `x/mlxrunner/mlx/ops_extra.go` (+27 -0) 📝 `x/mlxrunner/model/linear.go` (+16 -7) 📝 `x/models/nn/nn.go` (+20 -8) 📝 `x/server/show.go` (+14 -8) 📝 `x/server/show_test.go` (+76 -0) </details> ### 📄 Description Follow up from #15244 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-23 01:49:07 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#41083