[GH-ISSUE #9647] Phi4 14b with tool calling and full quantization #6294

Closed
opened 2026-04-12 17:44:11 -05:00 by GiteaMirror · 9 comments
Owner

Originally created by @andrea-tomassi-sharelock on GitHub (Mar 11, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9647

Currently this is the only phi4 with tool calling support:
https://ollama.com/jacob-ebey/phi4-tools

Is there an ETA for supporting phi4 with tools as well as phi4-mini ?

Originally created by @andrea-tomassi-sharelock on GitHub (Mar 11, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9647 Currently this is the only phi4 with tool calling support: [https://ollama.com/jacob-ebey/phi4-tools](https://ollama.com/jacob-ebey/phi4-tools) Is there an ETA for supporting phi4 with tools as well as phi4-mini ?
GiteaMirror added the model label 2026-04-12 17:44:11 -05:00
Author
Owner

@rick-github commented on GitHub (Mar 11, 2025):

Phi4 was not trained in tool use, so the official model is unlikely to get a tool supporting template. Phi4-mini already supports tools.

<!-- gh-comment-id:2713567870 --> @rick-github commented on GitHub (Mar 11, 2025): Phi4 was not trained in tool use, so the official model is unlikely to get a tool supporting template. Phi4-mini already supports tools.
Author
Owner

@pdevine commented on GitHub (Mar 21, 2025):

cc @ParthSareen

<!-- gh-comment-id:2744511183 --> @pdevine commented on GitHub (Mar 21, 2025): cc @ParthSareen
Author
Owner

@pdevine commented on GitHub (Mar 21, 2025):

I'm going to go ahead and close this since I believe we have both phi4 and phi4-mini in the main library correct. The other repos are cool (where people have hacked in tools) but for the main repo it should track the upstream model as closely as possible.

<!-- gh-comment-id:2744517800 --> @pdevine commented on GitHub (Mar 21, 2025): I'm going to go ahead and close this since I believe we have both phi4 and phi4-mini in the main library correct. The other repos are cool (where people have hacked in tools) but for the main repo it should track the upstream model as closely as possible.
Author
Owner

@negarnejati-dev commented on GitHub (Apr 16, 2025):

What about phi3.5 instruct? is there a possibility to get support for tool calling?

<!-- gh-comment-id:2810368606 --> @negarnejati-dev commented on GitHub (Apr 16, 2025): What about phi3.5 instruct? is there a possibility to get support for tool calling?
Author
Owner

@rick-github commented on GitHub (Apr 16, 2025):

phi3.5 instruct has not been trained in tool use so the quality of response may be poor. You can enable tool use by modifying the template or by supplying a system message that gives the model direction, see https://github.com/ollama/ollama/issues/5793#issuecomment-2238938100.

<!-- gh-comment-id:2810653285 --> @rick-github commented on GitHub (Apr 16, 2025): phi3.5 instruct has not been trained in tool use so the quality of response may be poor. You can enable tool use by modifying the template or by supplying a system message that gives the model direction, see https://github.com/ollama/ollama/issues/5793#issuecomment-2238938100.
Author
Owner

@sinedied commented on GitHub (Oct 9, 2025):

@pdevine It might be a newer version, but phi4 works with tools in both Foundry local and Docker Models, but not Ollama. I'm wondering why the difference here?

<!-- gh-comment-id:3386433014 --> @sinedied commented on GitHub (Oct 9, 2025): @pdevine It might be a newer version, but phi4 works with tools in both Foundry local and Docker Models, but not Ollama. I'm wondering why the difference here?
Author
Owner

@rick-github commented on GitHub (Oct 10, 2025):

phi4 has not been trained in tool use so the quality of response may be poor. You can enable tool use by modifying the template or by supplying a system message that gives the model direction, see https://github.com/ollama/ollama/issues/5793#issuecomment-2238938100.

<!-- gh-comment-id:3391339812 --> @rick-github commented on GitHub (Oct 10, 2025): phi4 has [not been trained](https://huggingface.co/microsoft/phi-4/blob/main/tokenizer_config.json#L774) in tool use so the quality of response may be poor. You can enable tool use by [modifying the template](https://ollama.com/search?c=tools&q=phi4) or by supplying a system message that gives the model direction, see https://github.com/ollama/ollama/issues/5793#issuecomment-2238938100.
Author
Owner

@sinedied commented on GitHub (Oct 10, 2025):

There are other versions of phi4 that support tool calling: https://ai.azure.com/catalog/models/Phi-4-multimodal-instruct

<!-- gh-comment-id:3391566308 --> @sinedied commented on GitHub (Oct 10, 2025): There are other versions of phi4 that support tool calling: https://ai.azure.com/catalog/models/Phi-4-multimodal-instruct
Author
Owner

@rick-github commented on GitHub (Oct 10, 2025):

Ollama does not currently support phi4-multimodal.

<!-- gh-comment-id:3391625814 --> @rick-github commented on GitHub (Oct 10, 2025): Ollama does not currently support phi4-multimodal.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#6294