[GH-ISSUE #3556] CodeGemma by Google #2196

Closed
opened 2026-04-12 12:26:37 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @smortezah on GitHub (Apr 9, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3556

What model would you like?

CodeGemma by Google has just been released:

https://huggingface.co/collections/google/codegemma-release-66152ac7b683e2667abdee11

Originally created by @smortezah on GitHub (Apr 9, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3556 ### What model would you like? CodeGemma by Google has just been released: https://huggingface.co/collections/google/codegemma-release-66152ac7b683e2667abdee11
Author
Owner

@jmorganca commented on GitHub (Apr 9, 2024):

Thanks for the issue! Here it is! https://ollama.com/library/codegemma

<!-- gh-comment-id:2045215213 --> @jmorganca commented on GitHub (Apr 9, 2024): Thanks for the issue! Here it is! https://ollama.com/library/codegemma
Author
Owner

@fungiboletus commented on GitHub (Apr 10, 2024):

Hi,

I see a lot of <|file_separator|> and similar sequences in the outputs. Is this something that should be fixed in the application consuming the outputs, or ollama?

$ ollama run codegemma:code
>>> int main()
 {.cpp
<|fim_prefix|>int main(){
int num1,num2,result;
num1=10;
num2=5;
result=num1+num2;
cout<<result;
return <|fim_suffix|><|fim_middle|>0;
}
<|file_separator|>

>>>
<!-- gh-comment-id:2046727592 --> @fungiboletus commented on GitHub (Apr 10, 2024): Hi, I see a lot of `<|file_separator|>` and similar sequences in the outputs. Is this something that should be fixed in the application consuming the outputs, or ollama? ``` $ ollama run codegemma:code >>> int main() {.cpp <|fim_prefix|>int main(){ int num1,num2,result; num1=10; num2=5; result=num1+num2; cout<<result; return <|fim_suffix|><|fim_middle|>0; } <|file_separator|> >>> ```
Author
Owner

@metal3d commented on GitHub (Jul 19, 2025):

Hi,

I see a lot of <|file_separator|> and similar sequences in the outputs. Is this something that should be fixed in the application consuming the outputs, or ollama?

$ ollama run codegemma:code
>>> int main()
 {.cpp
<|fim_prefix|>int main(){
int num1,num2,result;
num1=10;
num2=5;
result=num1+num2;
cout<<result;
return <|fim_suffix|><|fim_middle|>0;
}
<|file_separator|>

>>>

I've got exactly the same problem with llm-ls in neovim. Lot of bad tokens and I see erros when the model loads:

load: control-looking token:    107 '<end_of_turn>' was not control-type; this is probably a bug in the model. its type will be overridden
load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
...
print_info: FIM PRE token    = 67 '<|fim_prefix|>'
print_info: FIM SUF token    = 69 '<|fim_suffix|>'
print_info: FIM MID token    = 68 '<|fim_middle|>'
print_info: EOG token        = 1 '<eos>'
print_info: EOG token        = 107 '<end_of_turn>'
print_info: max token length = 93
<!-- gh-comment-id:3092336931 --> @metal3d commented on GitHub (Jul 19, 2025): > Hi, > > I see a lot of `<|file_separator|>` and similar sequences in the outputs. Is this something that should be fixed in the application consuming the outputs, or ollama? > > ``` > $ ollama run codegemma:code > >>> int main() > {.cpp > <|fim_prefix|>int main(){ > int num1,num2,result; > num1=10; > num2=5; > result=num1+num2; > cout<<result; > return <|fim_suffix|><|fim_middle|>0; > } > <|file_separator|> > > >>> > ``` I've got exactly the same problem with llm-ls in neovim. Lot of bad tokens and I see erros when the model loads: ``` load: control-looking token: 107 '<end_of_turn>' was not control-type; this is probably a bug in the model. its type will be overridden load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect ... print_info: FIM PRE token = 67 '<|fim_prefix|>' print_info: FIM SUF token = 69 '<|fim_suffix|>' print_info: FIM MID token = 68 '<|fim_middle|>' print_info: EOG token = 1 '<eos>' print_info: EOG token = 107 '<end_of_turn>' print_info: max token length = 93 ```
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#2196