[GH-ISSUE #7028] Add gguf cerebras/Llama3-DocChat-1.0-8B to ollama #4456

Closed
opened 2026-04-12 15:23:03 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @djaffer on GitHub (Sep 29, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/7028

Can this model be added?

https://huggingface.co/bartowski/Llama3-DocChat-1.0-8B-GGUF

https://huggingface.co/bartowski/Llama3-DocChat-1.0-8B-GGUF

FROM ./Llama3-DocChat-1.0-8B.Q6_K.gguf

TEMPLATE "{{ if .System }}System: {{ .System }}

{{ end }}{{ if .Prompt }}User: {{ .Prompt }}

{{ end }}Assistant: <|begin_of_text|>{{ .Response }}
"

I tried adding but it hallucinates.
image

Originally created by @djaffer on GitHub (Sep 29, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/7028 Can this model be added? https://huggingface.co/bartowski/Llama3-DocChat-1.0-8B-GGUF https://huggingface.co/bartowski/Llama3-DocChat-1.0-8B-GGUF ``` FROM ./Llama3-DocChat-1.0-8B.Q6_K.gguf TEMPLATE "{{ if .System }}System: {{ .System }} {{ end }}{{ if .Prompt }}User: {{ .Prompt }} {{ end }}Assistant: <|begin_of_text|>{{ .Response }} " ``` I tried adding but it hallucinates. ![image](https://github.com/user-attachments/assets/8e3717b1-b8cc-46b8-b722-ffcde8fa21a1)
GiteaMirror added the model label 2026-04-12 15:23:03 -05:00
Author
Owner

@djaffer commented on GitHub (Sep 29, 2024):

The solution was not to add template manually.

FROM ./Llama3-DocChat-1.0-8B.Q6_K.gguf
<!-- gh-comment-id:2381127824 --> @djaffer commented on GitHub (Sep 29, 2024): The solution was not to add template manually. ``` FROM ./Llama3-DocChat-1.0-8B.Q6_K.gguf ```
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#4456