github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 00:22:43 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #2475] Request to add leo-hessianai to ollama #27208

New Issue
Open
opened 2026-04-22 04:17:58 -05:00 by GiteaMirror · 2 comments
GiteaMirror commented 2026-04-22 04:17:58 -05:00
Owner
Copy Link

Originally created by @arsenij-ust on GitHub (Feb 13, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2475

Hi guys,
I tried to use the leo-hessianai-7B model on Ollama. I use the GGUF file (Q4_K_M.gguf from here https://huggingface.co/TheBloke/leo-hessianai-7B-GGUF/tree/main) and followed the instructions from Ollama (https://github.com/ollama/ollama/blob/main/docs/import.md). I already managed to generate answers with the model, but they are extremely wrong and hallucinating (you can say crazy). Unfortunately, I don't know what I'm doing wrong. I assume that the parameters or the template (in the Modelfile you have to create for Ollama) are incorrect.
Hope you can help me out 🙂

I tried the following Modelfiles:

FROM ./leo-hessianai-7b.Q4_K_M.gguf
TEMPLATE """{{- if .System }}
<|im_start|>system {{ .System }}<|im_end|>
{{- end }}
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""

SYSTEM """"""

PARAMETER stop <|im_start|>
PARAMETER stop <|im_end|>

FROM ./leo-hessianai-7b.Q4_K_M.gguf
TEMPLATE "[INST] {{ .Prompt }} [/INST]"

(The same problem occurred when I used the safetensors from this repo and used the ollama tools to convert and quantize the model.)

--> So it would be great if leo-hessianai-7B, leo-hessianai-13B, and leo-hessianai-70B could be added to ollama - find the models at https://huggingface.co/LeoLM

Originally created by @arsenij-ust on GitHub (Feb 13, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2475 Hi guys, I tried to use the leo-hessianai-7B model on Ollama. I use the GGUF file (Q4_K_M.gguf from here https://huggingface.co/TheBloke/leo-hessianai-7B-GGUF/tree/main) and followed the instructions from Ollama (https://github.com/ollama/ollama/blob/main/docs/import.md). I already managed to generate answers with the model, but they are extremely wrong and hallucinating (you can say crazy). Unfortunately, I don't know what I'm doing wrong. I assume that the parameters or the template (in the Modelfile you have to create for Ollama) are incorrect. Hope you can help me out 🙂 I tried the following Modelfiles: ``` FROM ./leo-hessianai-7b.Q4_K_M.gguf TEMPLATE """{{- if .System }} <|im_start|>system {{ .System }}<|im_end|> {{- end }} <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant """ SYSTEM """""" PARAMETER stop <|im_start|> PARAMETER stop <|im_end|> ``` ``` FROM ./leo-hessianai-7b.Q4_K_M.gguf TEMPLATE "[INST] {{ .Prompt }} [/INST]" ``` (The same problem occurred when I used the safetensors from this repo and used the ollama tools to convert and quantize the model.) --> So it would be great if `leo-hessianai-7B`, `leo-hessianai-13B`, and `leo-hessianai-70B` could be added to ollama - find the models at https://huggingface.co/LeoLM
GiteaMirror added the help wanted label 2026-04-22 04:17:58 -05:00
GiteaMirror commented 2026-04-22 04:17:59 -05:00
Author
Owner
Copy Link

@n-bluefield commented on GitHub (Mar 8, 2024):

I ran into the same problem using https://huggingface.co/TheBloke/leo-hessianai-13B-chat-bilingual-GGUF in Ollama.
On HuggingFace the template is given as a ChatML prompt template, as you showed above. I tried different ways of formatting the modelfile, always with hallucinating results. Seems to me it's revealing training data.

Did you find a solution? Does anyone else know how to make it work? Help would be much appreciated!

<!-- gh-comment-id:1986005759 --> @n-bluefield commented on GitHub (Mar 8, 2024): I ran into the same problem using https://huggingface.co/TheBloke/leo-hessianai-13B-chat-bilingual-GGUF in Ollama. On HuggingFace the template is given as a ChatML prompt template, as you showed above. I tried different ways of formatting the modelfile, always with hallucinating results. Seems to me it's revealing training data. Did you find a solution? Does anyone else know how to make it work? Help would be much appreciated!
GiteaMirror commented 2026-04-22 04:18:00 -05:00
Author
Owner
Copy Link

@arsenij-ust commented on GitHub (Mar 11, 2024):

@n-bluefield Hi, no, unfortunately I didn't find a solution. My Discord request, as well as the same question on https://huggingface.co/LeoLM/leo-hessianai-7b-chat/discussions/7 was not answered yet.

<!-- gh-comment-id:1988346423 --> @arsenij-ust commented on GitHub (Mar 11, 2024): @n-bluefield Hi, no, unfortunately I didn't find a solution. My Discord request, as well as the same question on https://huggingface.co/LeoLM/leo-hessianai-7b-chat/discussions/7 was not answered yet.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label help wanted
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#27208
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?