[GH-ISSUE #5202] DevCoders Llama3 uncensored breaks between 0.1.42 -> 0.1.43 #3269

Open
opened 2026-04-12 13:48:56 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @ricky-davis on GitHub (Jun 21, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/5202

What is the issue?

Importing and quantizing this model: https://huggingface.co/DevsDoCode/LLama-3-8b-Uncensored
(ollama create -q Q4_K_M llama3-uncensored)
with this Modelfile:

FROM /path/to/LLama-3-8b-Uncensored
TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>

{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>

{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>

{{ .Response }}<|eot_id|>"""
PARAMETER stop "<|start_header_id|>"
PARAMETER stop "<|end_header_id|>"
PARAMETER stop "<|eot_id|>"
PARAMETER num_keep 24

has broken between v0.1.42 and v0.1.43

On 0.1.42, the model responds normally:

$ ollama -v
ollama version is 0.1.42
$ ollama run llama3-uncensored:latest
>>> hello
Hello there, how can I assist you today?
>>> whats up
Not much, just hanging out. What about you?

On 0.1.43, the model responds with gibberish:

$ ollama -v
ollama version is 0.1.43
$ ollama run llama3-uncensored:latest
>>> hello
http://www/other/sat/else/where/more//www/else/where//else/where/else//www/else/where/where//www/else/where/where//http://www/other/sat/else/where/more//www/else/where//else/where/else//www/else/where/where//www/else/where/where//www/elle/where//www/elle/Where//www/elle/Where//www/Where//www/elle// Where//www/elle// Where//www/elle//
Where//www/elle/Where//www/elle// Where//www/elle// Where//^C

>>> whats up
http://www/else/where:// www/else/ where:// http://www/else/ Where // www/else/ where: `http://www/else/ Where **
www/else**/ where: `http://www/else/ Where:** `http://www/else/ Where:** `http://www/else/ Where:**
`http://www/else/ Where:** ` http:// www/ else/ ` http:// www / else/ Where ` http:// www/ else/ ` http:// www /
else// where: ` http:// ` http:// www / else/ ` http:// ` ` http:// ` http:// ` http:// ` ` h http:// ` ` http://
` ` h http:// ` ` h ` http:// ` ' h ** ` h ** ` h ** ` h ** ` h ** ** ` h ** ` h** ** ` h ** ** ` h ** ** ` h **
** `h** ** **h ** ** **h** ** **h** ** **h** ** **h** ** **h** ** **h** ** **h** ** **h** ** **h** ** **h** **
**h** ** **

OS

WSL2

GPU

Nvidia

CPU

AMD

Ollama version

0.1.43

Originally created by @ricky-davis on GitHub (Jun 21, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/5202 ### What is the issue? Importing and quantizing this model: https://huggingface.co/DevsDoCode/LLama-3-8b-Uncensored (`ollama create -q Q4_K_M llama3-uncensored`) with this Modelfile: ``` FROM /path/to/LLama-3-8b-Uncensored TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|> {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|> {{ .Response }}<|eot_id|>""" PARAMETER stop "<|start_header_id|>" PARAMETER stop "<|end_header_id|>" PARAMETER stop "<|eot_id|>" PARAMETER num_keep 24 ``` has broken between v0.1.42 and v0.1.43 On 0.1.42, the model responds normally: ``` $ ollama -v ollama version is 0.1.42 $ ollama run llama3-uncensored:latest >>> hello Hello there, how can I assist you today? >>> whats up Not much, just hanging out. What about you? ``` On 0.1.43, the model responds with gibberish: ``` $ ollama -v ollama version is 0.1.43 $ ollama run llama3-uncensored:latest >>> hello http://www/other/sat/else/where/more//www/else/where//else/where/else//www/else/where/where//www/else/where/where//http://www/other/sat/else/where/more//www/else/where//else/where/else//www/else/where/where//www/else/where/where//www/elle/where//www/elle/Where//www/elle/Where//www/Where//www/elle// Where//www/elle// Where//www/elle// Where//www/elle/Where//www/elle// Where//www/elle// Where//^C >>> whats up http://www/else/where:// www/else/ where:// http://www/else/ Where // www/else/ where: `http://www/else/ Where ** www/else**/ where: `http://www/else/ Where:** `http://www/else/ Where:** `http://www/else/ Where:** `http://www/else/ Where:** ` http:// www/ else/ ` http:// www / else/ Where ` http:// www/ else/ ` http:// www / else// where: ` http:// ` http:// www / else/ ` http:// ` ` http:// ` http:// ` http:// ` ` h http:// ` ` http:// ` ` h http:// ` ` h ` http:// ` ' h ** ` h ** ` h ** ` h ** ` h ** ** ` h ** ` h** ** ` h ** ** ` h ** ** ` h ** ** `h** ** **h ** ** **h** ** **h** ** **h** ** **h** ** **h** ** **h** ** **h** ** **h** ** **h** ** **h** ** **h** ** ** ``` ### OS WSL2 ### GPU Nvidia ### CPU AMD ### Ollama version 0.1.43
GiteaMirror added the bug label 2026-04-12 13:48:56 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#3269