[GH-ISSUE #6310] llama3.1 8b template seems to be different from that in huggingface #29717

Open
opened 2026-04-22 08:52:53 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @fzyzcjy on GitHub (Aug 11, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6310

Originally assigned to: @jmorganca on GitHub.

What is the issue?

Hi thanks for the tool! When reading https://ollama.com/library/llama3.1:8b-instruct-q4_K_M/blobs/11ce4ee3e170, it seems different from https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct/blob/main/tokenizer_config.json#L2053. For example, it does not mention Cutting Knowledge Date: December 2023.

Therefore, I wonder whether it is expected or a bug? I have heard some people seems to say small models are sensitive to templates, so making it exactly the same as the official one may be useful.

OS

No response

GPU

No response

CPU

No response

Ollama version

No response

Originally created by @fzyzcjy on GitHub (Aug 11, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6310 Originally assigned to: @jmorganca on GitHub. ### What is the issue? Hi thanks for the tool! When reading https://ollama.com/library/llama3.1:8b-instruct-q4_K_M/blobs/11ce4ee3e170, it seems different from https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct/blob/main/tokenizer_config.json#L2053. For example, it does not mention `Cutting Knowledge Date: December 2023`. Therefore, I wonder whether it is expected or a bug? I have heard some people seems to say small models are sensitive to templates, so making it exactly the same as the official one may be useful. ### OS _No response_ ### GPU _No response_ ### CPU _No response_ ### Ollama version _No response_
GiteaMirror added the bug label 2026-04-22 08:52:53 -05:00
Author
Owner

@mxyng commented on GitHub (Aug 15, 2024):

template has been updated but not uploaded yet due to some technical difficulties

<!-- gh-comment-id:2292335234 --> @mxyng commented on GitHub (Aug 15, 2024): template has been updated but not uploaded yet due to some technical difficulties
Author
Owner

@fzyzcjy commented on GitHub (Aug 23, 2024):

Hi, is there any updates? Looking forward to the fix, thanks!

<!-- gh-comment-id:2306410620 --> @fzyzcjy commented on GitHub (Aug 23, 2024): Hi, is there any updates? Looking forward to the fix, thanks!
Author
Owner

@fzyzcjy commented on GitHub (Oct 22, 2024):

Hi, is there any updates after two months? I am happy to fix it.

It seems that e.g. the ollama template does not have the "today date" part

<!-- gh-comment-id:2428018536 --> @fzyzcjy commented on GitHub (Oct 22, 2024): Hi, is there any updates after two months? I am happy to fix it. It seems that e.g. the ollama template does not have the "today date" part
Author
Owner

@spro commented on GitHub (Dec 25, 2024):

The actual text "Cutting Knowledge Date" is also weird - should be "Knowledge Cutoff Date" I think. Not sure how to update that besides making a new model.

<!-- gh-comment-id:2562012818 --> @spro commented on GitHub (Dec 25, 2024): The actual text "Cutting Knowledge Date" is also weird - should be "Knowledge Cutoff Date" I think. Not sure how to update that besides making a new model.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#29717