github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-07-16 05:05:37 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #5810] Tinyllama has issues understanding the Modelfile #3621

New Issue
Closed
opened 2026-04-12 14:23:18 -05:00 by GiteaMirror · 2 comments
GiteaMirror commented 2026-04-12 14:23:18 -05:00
Owner
Copy Link

Originally created by @DuilioPerez on GitHub (Jul 20, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/5810

What is the issue?

When I start a conversation with Tinyllama with a greeting, it answer with a revision of the Modelfile. That's strange. Here is an example
chrome_screenshot_20 jul 2024 6_39_17 a  m CST

OS

Linux

GPU

Other

CPU

Other

Ollama version

0.2.7

Originally created by @DuilioPerez on GitHub (Jul 20, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/5810 ### What is the issue? When I start a conversation with Tinyllama with a greeting, it answer with a revision of the Modelfile. That's strange. Here is an example ![chrome_screenshot_20 jul 2024 6_39_17 a  m CST](https://github.com/user-attachments/assets/4bbb17a2-8411-4b1d-a8c5-2f86f63c7e40) ### OS Linux ### GPU Other ### CPU Other ### Ollama version 0.2.7
GiteaMirror added the bug label 2026-04-12 14:23:18 -05:00
GiteaMirror commented 2026-04-12 14:23:20 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jul 20, 2024):

tinyllama is a, well, tiny model, and as such, has little internal guidance on how to do completions that are open ended. It works better if you have specific questions or instructions:

$ ollama run tinyllama:latest "why is the sky blue?"
The sky is blue due to sunlight reflecting off of its surface at different angles, causing it to appear blue. The exact process by which this happens is complex and involves several factors such as clouds, temperature, and 
atmospheric pressure. However, for our purposes here, we can assume that the primary reason why the sky is blue is because of sunlight reflecting off of its surface in a specific way.

It's also pretty old as models go, there are more recent small models that perform better. For example, qwen2 has a version that is of similar size and is less prone to running off it's "mouth":

$ ollama run qwen2:0.5b-instruct-q4_K_M "Hello"
Hello! How can I assist you today?
$ ollama run qwen2:0.5b-instruct-q4_K_M "why is the sky blue?"
Blue is considered a characteristic of water. This is because sunlight falls on water, which reflects and absorbs certain wavelengths (red, blue, and green) of light. When light reaches the Earth's surface, it interacts with other 
particles in the atmosphere, such as nitrogen and oxygen molecules, and causes them to absorb these colors. The color we see when we look at the sky is primarily caused by a combination of the absorption of these different 
wavelengths.
<!-- gh-comment-id:2241199602 --> @rick-github commented on GitHub (Jul 20, 2024): tinyllama is a, well, tiny model, and as such, has little internal guidance on how to do completions that are open ended. It works better if you have specific questions or instructions: ``` $ ollama run tinyllama:latest "why is the sky blue?" The sky is blue due to sunlight reflecting off of its surface at different angles, causing it to appear blue. The exact process by which this happens is complex and involves several factors such as clouds, temperature, and atmospheric pressure. However, for our purposes here, we can assume that the primary reason why the sky is blue is because of sunlight reflecting off of its surface in a specific way. ``` It's also pretty old as models go, there are more recent small models that perform better. For example, qwen2 has a version that is of similar size and is less prone to running off it's "mouth": ``` $ ollama run qwen2:0.5b-instruct-q4_K_M "Hello" Hello! How can I assist you today? $ ollama run qwen2:0.5b-instruct-q4_K_M "why is the sky blue?" Blue is considered a characteristic of water. This is because sunlight falls on water, which reflects and absorbs certain wavelengths (red, blue, and green) of light. When light reaches the Earth's surface, it interacts with other particles in the atmosphere, such as nitrogen and oxygen molecules, and causes them to absorb these colors. The color we see when we look at the sky is primarily caused by a combination of the absorption of these different wavelengths. ```
GiteaMirror commented 2026-04-12 14:23:21 -05:00
Author
Owner
Copy Link

@pdevine commented on GitHub (Sep 12, 2024):

I would also recommend gemma2:2b. Lots of cool small models out there!

I'm going to close this, but feel free to keep commenting.

<!-- gh-comment-id:2347339466 --> @pdevine commented on GitHub (Sep 12, 2024): I would also recommend `gemma2:2b`. Lots of cool small models out there! I'm going to close this, but feel free to keep commenting.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#3621
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?