[GH-ISSUE #4092] microsoft/Phi-3-mini-128k-instruct #64578

Closed
opened 2026-05-03 18:15:24 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @andsty on GitHub (May 2, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4092

Hi. Is it possible to add version 128k of phi-3 in ollama?Thanks in advance.

Originally created by @andsty on GitHub (May 2, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4092 Hi. Is it possible to add version 128k of phi-3 in ollama?Thanks in advance.
GiteaMirror added the model label 2026-05-03 18:15:24 -05:00
Author
Owner

@f0rodo commented on GitHub (May 3, 2024):

There is a GGUF here https://huggingface.co/PrunaAI/Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed/tree/main

You can just FROM :)

<!-- gh-comment-id:2092070865 --> @f0rodo commented on GitHub (May 3, 2024): There is a GGUF here https://huggingface.co/PrunaAI/Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed/tree/main You can just FROM :)
Author
Owner

@dkjsnnr1 commented on GitHub (May 28, 2024):

@f0rodo how would the modelfile look like? Like this?:

FROM https://huggingface.co/PrunaAI/Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed/tree/main

# Set parameters

PARAMETER temperature 0.8
PARAMETER stop Result

SYSTEM """"""```
<!-- gh-comment-id:2134482430 --> @dkjsnnr1 commented on GitHub (May 28, 2024): @f0rodo how would the modelfile look like? Like this?: ``` FROM https://huggingface.co/PrunaAI/Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed/tree/main # Set parameters PARAMETER temperature 0.8 PARAMETER stop Result SYSTEM """"""```
Author
Owner

@mxyng commented on GitHub (Jul 30, 2024):

this is now available https://ollama.com/library/phi3:mini-128k

<!-- gh-comment-id:2259316862 --> @mxyng commented on GitHub (Jul 30, 2024): this is now available https://ollama.com/library/phi3:mini-128k
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#64578