github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-08 08:59:13 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #9058] Mixtral doesn't support tools in Ollama Registry, but it should #5897

New Issue
Closed
opened 2026-04-12 17:14:01 -05:00 by GiteaMirror · 5 comments
GiteaMirror commented 2026-04-12 17:14:01 -05:00
Owner
Copy Link

Originally created by @lemassykoi on GitHub (Feb 12, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9058

What is the issue?

I ran ollama pull mixtral:latest to get the 8B model.

When trying to use it with tools in a python script, an Exception is raised :

ERROR - Exception : registry.ollama.ai/library/mixtral:latest does not support tools

but on Ollama website, "TOOLS" are mentioned, so that should be working.

I deleted the model ollama rm mixtral:latest and downloaded it again, but with the precise name :

ollama pull mixtral:8x7b

But I got the same error, same problem.

Finally, I tried with mixtral:22b, and after 5 minutes, it gives up with an error 500.
It seems that my hardware is not suitable for this kind of models.

I would like to try mixtral with tools, what should I do? Thanks.

Relevant log output

Exception : registry.ollama.ai/library/mixtral:latest does not support tools (status code: 400)

ollama._types.ResponseError: registry.ollama.ai/library/mixtral:8x7b does not support tools (status code: 400)

OS

Windows

GPU

Nvidia

CPU

Intel

Ollama version

0.5.7

Originally created by @lemassykoi on GitHub (Feb 12, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9058 ### What is the issue? I ran `ollama pull mixtral:latest` to get the 8B model. When trying to use it with tools in a python script, an Exception is raised : `ERROR - Exception : registry.ollama.ai/library/mixtral:latest does not support tools` but on Ollama website, "TOOLS" are mentioned, so that should be working. I deleted the model `ollama rm mixtral:latest` and downloaded it again, but with the precise name : `ollama pull mixtral:8x7b` But I got the same error, same problem. Finally, I tried with mixtral:22b, and after 5 minutes, it gives up with an error 500. It seems that my hardware is not suitable for this kind of models. I would like to try mixtral with tools, what should I do? Thanks. ### Relevant log output ```shell Exception : registry.ollama.ai/library/mixtral:latest does not support tools (status code: 400) ollama._types.ResponseError: registry.ollama.ai/library/mixtral:8x7b does not support tools (status code: 400) ``` ### OS Windows ### GPU Nvidia ### CPU Intel ### Ollama version 0.5.7
GiteaMirror added the bug label 2026-04-12 17:14:01 -05:00
GiteaMirror commented 2026-04-12 17:14:02 -05:00
Author
Owner
Copy Link

@jmorganca commented on GitHub (Feb 12, 2025):

Hi @lemassykoi - I don't believe the Mixtral 8x7B model was trained to support tool calling. The Mistral 8x22B model was, however it requires quite a large amount of VRAM to run – which kind of machine are you running this on and which error are you seeing? Sorry about that.

<!-- gh-comment-id:2655024251 --> @jmorganca commented on GitHub (Feb 12, 2025): Hi @lemassykoi - I don't believe the Mixtral 8x7B model was trained to support tool calling. The Mistral 8x22B model _was_, however it requires quite a large amount of VRAM to run – which kind of machine are you running this on and which error are you seeing? Sorry about that.
GiteaMirror commented 2026-04-12 17:14:03 -05:00
Author
Owner
Copy Link

@lemassykoi commented on GitHub (Feb 12, 2025):

Ok, thanks. I was refering myself to Mixtral Model Page informations.
Nevermind, I will use mistral-small, which works with tools, and seems to be newer. Thanks.

<!-- gh-comment-id:2655029841 --> @lemassykoi commented on GitHub (Feb 12, 2025): Ok, thanks. I was refering myself to [Mixtral Model Page](https://ollama.com/library/mixtral:8x7b) informations. Nevermind, I will use mistral-small, which works with tools, and seems to be newer. Thanks.
GiteaMirror commented 2026-04-12 17:14:03 -05:00
Author
Owner
Copy Link

@lemassykoi commented on GitHub (Feb 16, 2025):

I tried with mixtral:8x22b-text-v0.1-q2_K which could load on my hardware, and I had the same message:

registry.ollama.ai/library/mixtral:8x22b-text-v0.1-q2_K does not support tools

So, tools or no tools on Mixtral (which has a tools tag on ollama website)

thanks

<!-- gh-comment-id:2661248720 --> @lemassykoi commented on GitHub (Feb 16, 2025): I tried with mixtral:8x22b-text-v0.1-q2_K which could load on my hardware, and I had the same message: ```registry.ollama.ai/library/mixtral:8x22b-text-v0.1-q2_K does not support tools``` So, tools or no tools on Mixtral (which has a tools tag on ollama website) thanks
GiteaMirror commented 2026-04-12 17:14:03 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 16, 2025):

mixtral:8x22b-text-v0.1-q2_K is pre-trained (that's what text means) and does not support tools. Try mixtral:8x22b-instruct-v0.1-q2_K.

<!-- gh-comment-id:2661670757 --> @rick-github commented on GitHub (Feb 16, 2025): `mixtral:8x22b-text-v0.1-q2_K` is pre-trained (that's what `text` means) and does not support tools. Try [mixtral:8x22b-instruct-v0.1-q2_K](https://ollama.com/library/mixtral:8x22b-instruct-v0.1-q2_K).
GiteaMirror commented 2026-04-12 17:14:04 -05:00
Author
Owner
Copy Link

@lemassykoi commented on GitHub (Feb 17, 2025):

mixtral:8x22b-text-v0.1-q2_K is pre-trained (that's what text means) and does not support tools. Try mixtral:8x22b-instruct-v0.1-q2_K.

you were right, finally, I have a mixtral version with tools. Thanks

<!-- gh-comment-id:2663134315 --> @lemassykoi commented on GitHub (Feb 17, 2025): > `mixtral:8x22b-text-v0.1-q2_K` is pre-trained (that's what `text` means) and does not support tools. Try [mixtral:8x22b-instruct-v0.1-q2_K](https://ollama.com/library/mixtral:8x22b-instruct-v0.1-q2_K). you were right, finally, I have a mixtral version with tools. Thanks
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#5897
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?