github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 16:11:34 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #11239] We need the Hunyuan-A13B-Instruct,thanks! #69463

New Issue
Open
opened 2026-05-04 18:11:12 -05:00 by GiteaMirror · 5 comments
GiteaMirror commented 2026-05-04 18:11:12 -05:00
Owner
Copy Link

Originally created by @enryteam on GitHub (Jun 30, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/11239

https://github.com/Tencent-Hunyuan/Hunyuan-A13B

https://huggingface.co/tencent/Hunyuan-A13B-Instruct

Originally created by @enryteam on GitHub (Jun 30, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/11239 https://github.com/Tencent-Hunyuan/Hunyuan-A13B https://huggingface.co/tencent/Hunyuan-A13B-Instruct
GiteaMirror added the model label 2026-05-04 18:11:12 -05:00
GiteaMirror commented 2026-05-04 18:11:16 -05:00
Author
Owner
Copy Link

@bold84 commented on GitHub (Jun 30, 2025):

Wait for this to be merged and then ollama updating their dependencies.

https://github.com/ggml-org/llama.cpp/pull/14425

<!-- gh-comment-id:3020226420 --> @bold84 commented on GitHub (Jun 30, 2025): Wait for this to be merged and then ollama updating their dependencies. https://github.com/ggml-org/llama.cpp/pull/14425
GiteaMirror commented 2026-05-04 18:11:17 -05:00
Author
Owner
Copy Link

@ShahNewazKhan commented on GitHub (Jul 3, 2025):

Wait for this to be merged and then ollama updating their dependencies.

ggml-org/llama.cpp#14425

Perfect, looking forward to it, thanks!

<!-- gh-comment-id:3030371855 --> @ShahNewazKhan commented on GitHub (Jul 3, 2025): > Wait for this to be merged and then ollama updating their dependencies. > > [ggml-org/llama.cpp#14425](https://github.com/ggml-org/llama.cpp/pull/14425) Perfect, looking forward to it, thanks!
GiteaMirror commented 2026-05-04 18:11:18 -05:00
Author
Owner
Copy Link

@ImJoyed commented on GitHub (Jul 9, 2025):

Wait for this to be merged and then ollama updating their dependencies.
ggml-org/llama.cpp#14425

Perfect, looking forward to it, thanks!

This has been merged and closed — looking forward to your next work!​ Thinks! :)

<!-- gh-comment-id:3050966395 --> @ImJoyed commented on GitHub (Jul 9, 2025): > > Wait for this to be merged and then ollama updating their dependencies. > > [ggml-org/llama.cpp#14425](https://github.com/ggml-org/llama.cpp/pull/14425) > > Perfect, looking forward to it, thanks! This has been merged and closed — looking forward to your next work!​ Thinks! :)
GiteaMirror commented 2026-05-04 18:11:19 -05:00
Author
Owner
Copy Link

@DirtyKnightForVi commented on GitHub (Jul 31, 2025):

any progress?

<!-- gh-comment-id:3138988181 --> @DirtyKnightForVi commented on GitHub (Jul 31, 2025): any progress?
GiteaMirror commented 2026-05-04 18:11:21 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Dec 1, 2025):

$ ollama -v
ollama version is 0.13.0

$ ollama run hf.co/unsloth/Hunyuan-A13B-Instruct-GGUF:Q4_K_M hello
<think>
Okay, the user said "hello". That's straightforward. I should respond in a friendly and welcoming manner.

Maybe start with a greeting like "Hello there!" to be warm. Then offer assistance, something like "How can I help you today?" That invites 
them to ask their question or let me know what they need.

I should keep it simple and not overcomplicate things. Make sure the tone is approachable and positive. Avoid any technical jargon since 
they might just be testing the waters or starting a casual conversation.

Also, check if there's any specific context from previous interactions, but since this seems like the first message, no need to reference 
anything else. Just keep it open-ended so they feel comfortable to ask whatever they have in mind.
</think>
<answer>
Hello there!
How can I help you today?
</answer>

The following Modelfile removes the think and answer tags:

FROM hf.co/unsloth/Hunyuan-A13B-Instruct-GGUF:Q4_K_M

TEMPLATE """
{{- $lastUserIdx := -1 }}
{{- range $i, $_ := .Messages }}
{{- if eq .Role "user" }}{{- $lastUserIdx = $i }}{{ end }}
{{- end -}}
{{- if .System }}<|startoftext|>
{{- .System }}<|extra_4|>
{{- end }}
{{- range $i, $_ := .Messages }}
{{- $last := eq (len (slice $.Messages $i)) 1 }}
{{- if eq .Role "user" }}<|startoftext|>
{{- .Content }}<|extra_0|>
{{- else if eq .Role "assistant" }}<|startoftext|>
{{- if (and $.IsThinkSet (and .Thinking (or $last (gt $i $lastUserIdx)))) -}}
<think>{{ .Thinking }}</think>
<answer>
{{- end }}
{{- .Content }}<|eos|>
{{- end }}
{{- if and $.IsThinkSet (not $.Think) -}}
<think>

</think>
<answer>
{{ end -}}
{{- end }}"""

PARAMETER stop <|startoftext|>
PARAMETER stop <|extra_4|>
PARAMETER stop <|extra_0|>
PARAMETER stop <|eos|>
PARAMETER stop </answer>

$ ollama create hunyuan:80b-a13b-q4_K_M -f Modelfile

$ ollama run hunyuan:80b-a13b-q4_K_M hello
Thinking...
Okay, the user said "hello". That's straightforward. I need to respond in a friendly and welcoming way.

I should start with a greeting back, maybe "Hi there!" or "Hello!". Then add something nice to make it more engaging. Maybe offer help or 
ask how I can assist them today. Keep it open-ended so they feel encouraged to ask anything.

Let me check if there's any specific context from previous messages. Wait, no, this is the first interaction. Alright, keep it simple and 
positive.

Avoid being too formal. Use an exclamation point to convey enthusiasm. Maybe add a smiley emoji to keep the tone light, but since emojis 
can sometimes be off in text, maybe just stick to words that convey warmth.

Putting it all together: "Hello there!" followed by a friendly offer to help. Yeah, that should work.
...done thinking.

Hello there!

$ ollama run hunyuan:80b-a13b-q4_K_M --think=false hello
Hello there！How can I assist you today? 😊
<!-- gh-comment-id:3598672444 --> @rick-github commented on GitHub (Dec 1, 2025): ```console $ ollama -v ollama version is 0.13.0 $ ollama run hf.co/unsloth/Hunyuan-A13B-Instruct-GGUF:Q4_K_M hello <think> Okay, the user said "hello". That's straightforward. I should respond in a friendly and welcoming manner. Maybe start with a greeting like "Hello there!" to be warm. Then offer assistance, something like "How can I help you today?" That invites them to ask their question or let me know what they need. I should keep it simple and not overcomplicate things. Make sure the tone is approachable and positive. Avoid any technical jargon since they might just be testing the waters or starting a casual conversation. Also, check if there's any specific context from previous interactions, but since this seems like the first message, no need to reference anything else. Just keep it open-ended so they feel comfortable to ask whatever they have in mind. </think> <answer> Hello there! How can I help you today? </answer> ``` The following Modelfile removes the `think` and `answer` tags: ```dockerfile FROM hf.co/unsloth/Hunyuan-A13B-Instruct-GGUF:Q4_K_M TEMPLATE """ {{- $lastUserIdx := -1 }} {{- range $i, $_ := .Messages }} {{- if eq .Role "user" }}{{- $lastUserIdx = $i }}{{ end }} {{- end -}} {{- if .System }}<|startoftext|> {{- .System }}<|extra_4|> {{- end }} {{- range $i, $_ := .Messages }} {{- $last := eq (len (slice $.Messages $i)) 1 }} {{- if eq .Role "user" }}<|startoftext|> {{- .Content }}<|extra_0|> {{- else if eq .Role "assistant" }}<|startoftext|> {{- if (and $.IsThinkSet (and .Thinking (or $last (gt $i $lastUserIdx)))) -}} <think>{{ .Thinking }}</think> <answer> {{- end }} {{- .Content }}<|eos|> {{- end }} {{- if and $.IsThinkSet (not $.Think) -}} <think> </think> <answer> {{ end -}} {{- end }}""" PARAMETER stop <|startoftext|> PARAMETER stop <|extra_4|> PARAMETER stop <|extra_0|> PARAMETER stop <|eos|> PARAMETER stop </answer> ``` ```console $ ollama create hunyuan:80b-a13b-q4_K_M -f Modelfile ``` ```console $ ollama run hunyuan:80b-a13b-q4_K_M hello Thinking... Okay, the user said "hello". That's straightforward. I need to respond in a friendly and welcoming way. I should start with a greeting back, maybe "Hi there!" or "Hello!". Then add something nice to make it more engaging. Maybe offer help or ask how I can assist them today. Keep it open-ended so they feel encouraged to ask anything. Let me check if there's any specific context from previous messages. Wait, no, this is the first interaction. Alright, keep it simple and positive. Avoid being too formal. Use an exclamation point to convey enthusiasm. Maybe add a smiley emoji to keep the tone light, but since emojis can sometimes be off in text, maybe just stick to words that convey warmth. Putting it all together: "Hello there!" followed by a friendly offer to help. Yeah, that should work. ...done thinking. Hello there! $ ollama run hunyuan:80b-a13b-q4_K_M --think=false hello Hello there！How can I assist you today? 😊 ```
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label model
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#69463
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?