[GH-ISSUE #7848] Teuken-7b #82702

Closed
opened 2026-05-09 15:35:11 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @tilllt on GitHub (Nov 26, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/7848

https://huggingface.co/openGPT-X/Teuken-7B-instruct-research-v0.4

Originally created by @tilllt on GitHub (Nov 26, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/7848 https://huggingface.co/openGPT-X/Teuken-7B-instruct-research-v0.4
GiteaMirror added the model label 2026-05-09 15:35:11 -05:00
Author
Owner

@derjoshder commented on GitHub (Dec 5, 2024):

Meanwhile you can use llamafile to get Teuken running.
You might want to check out:
https://www.johannesholstein.de/gsCMS/index.php?id=neue-bundes-ai
for a short tutorial with links and all on how to achieve that.
The llama people, as far as I know, are currently working on something about the file that is different from other models, so be patient, it will probably work with ollama soon.

<!-- gh-comment-id:2519705412 --> @derjoshder commented on GitHub (Dec 5, 2024): Meanwhile you can use llamafile to get Teuken running. You might want to check out: [https://www.johannesholstein.de/gsCMS/index.php?id=neue-bundes-ai](https://www.johannesholstein.de/gsCMS/index.php?id=neue-bundes-ai) for a short tutorial with links and all on how to achieve that. The llama people, as far as I know, are currently working on something about the file that is different from other models, so be patient, it will probably work with ollama soon.
Author
Owner

@tilllt commented on GitHub (Dec 5, 2024):

It's working in LM Studio as well, but I kinda settled with Ollama / OpenWebUI so I have to wait.

<!-- gh-comment-id:2520593693 --> @tilllt commented on GitHub (Dec 5, 2024): It's working in LM Studio as well, but I kinda settled with Ollama / OpenWebUI so I have to wait.
Author
Owner

@krille90 commented on GitHub (Apr 3, 2025):

Hello :)

Any update on this model?

<!-- gh-comment-id:2774948745 --> @krille90 commented on GitHub (Apr 3, 2025): Hello :) Any update on this model?
Author
Owner

@rick-github commented on GitHub (Jan 11, 2026):

FROM hf.co/QuantFactory/Teuken-7B-instruct-commercial-v0.4-GGUF:Q4_K_M
TEMPLATE """{{ .System }}
User: {{ .Prompt }}
Assistant: """
PARAMETER stop User:
PARAMETER stop Assistant:
$ ollama create teuken:7b-instruct-commercial-0.4-q4_K_M
gathering model components 
using existing layer sha256:5f161ae376f2719db65c1f4978104d1de5cd1614bd110163ac5f25965f1fbe6a 
creating new layer sha256:738fe0ea99dd0ee398aa23ef848496db9522c9a8b9dea4e018f0ca78da63746d 
using existing layer sha256:19f2fb9e8bc65a143f47903ec07dce010fd2873f994b900ea735a4b5022e968d 
writing manifest 
success 
$ ollama run teuken:7b-instruct-commercial-0.4-q4_K_M
>>> hello
 Hello! How can I assist you today?

>>> why is the sky blue?
 The color of the sky changes throughout the day, and it's a result of how light interacts with
Earth's atmosphere. When sunlight passes through our atmosphere, the shorter wavelengths
(blue and violet)  are scattered more than longer wavelengths (red and orange). This causes
blue light to be scattered in all directions, making the sky appear blue to us on Earth.  However,
this is a simplified explanation of why the sky is blue. There's actually quite a bit more going on
with the physics of how light interacts with our atmosphere that can get very complex and technical!
<!-- gh-comment-id:3735704132 --> @rick-github commented on GitHub (Jan 11, 2026): ```dockerfile FROM hf.co/QuantFactory/Teuken-7B-instruct-commercial-v0.4-GGUF:Q4_K_M TEMPLATE """{{ .System }} User: {{ .Prompt }} Assistant: """ PARAMETER stop User: PARAMETER stop Assistant: ``` ```console $ ollama create teuken:7b-instruct-commercial-0.4-q4_K_M gathering model components using existing layer sha256:5f161ae376f2719db65c1f4978104d1de5cd1614bd110163ac5f25965f1fbe6a creating new layer sha256:738fe0ea99dd0ee398aa23ef848496db9522c9a8b9dea4e018f0ca78da63746d using existing layer sha256:19f2fb9e8bc65a143f47903ec07dce010fd2873f994b900ea735a4b5022e968d writing manifest success ``` ```console $ ollama run teuken:7b-instruct-commercial-0.4-q4_K_M >>> hello Hello! How can I assist you today? >>> why is the sky blue? The color of the sky changes throughout the day, and it's a result of how light interacts with Earth's atmosphere. When sunlight passes through our atmosphere, the shorter wavelengths (blue and violet) are scattered more than longer wavelengths (red and orange). This causes blue light to be scattered in all directions, making the sky appear blue to us on Earth. However, this is a simplified explanation of why the sky is blue. There's actually quite a bit more going on with the physics of how light interacts with our atmosphere that can get very complex and technical! ```
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#82702