[GH-ISSUE #12381] embeddings required but some input tokens were not marked as outputs #8223

Open
opened 2026-04-12 20:42:43 -05:00 by GiteaMirror · 13 comments
Owner

Originally created by @Arslan-Mehmood1 on GitHub (Sep 23, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/12381

What is the issue?

snowflake-arctic-embed2
ollama version is 0.11.11

Relevant log output

ollama service logs

init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.11.11

Originally created by @Arslan-Mehmood1 on GitHub (Sep 23, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/12381 ### What is the issue? snowflake-arctic-embed2 ollama version is 0.11.11 ### Relevant log output ```shell ollama service logs init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding ``` ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.11.11
GiteaMirror added the bug label 2026-04-12 20:42:43 -05:00
Author
Owner

@Powerkrieger commented on GitHub (Oct 7, 2025):

I get the pretty much the same

Okt 07 15:44:57 mylab ollama[397923]: [GIN] 2025/10/07 - 15:44:57 | 200 |   35.791593ms |  <MY_IP>  | POST     "/api/embed"
Okt 07 15:44:57 mylab ollama[397923]: init: embeddings required but some input tokens were not marked as outputs -> overriding
Okt 07 15:44:57 mylab ollama[397923]: init: embeddings required but some input tokens were not marked as outputs -> overriding
Okt 07 15:44:57 mylab ollama[397923]: [GIN] 2025/10/07 - 15:44:57 | 200 |   35.811343ms |   <MY_IP>  | POST     "/api/embed"
Okt 07 15:44:57 mylab ollama[397923]: init: embeddings required but some input tokens were not marked as outputs -> overriding
Okt 07 15:44:57 mylab ollama[397923]: init: embeddings required but some input tokens were not marked as outputs -> overriding

running ollama version 0.12.3; OS ubuntu24.04; GPU NVIDIA;
Its probably got to do with the way the query is structured but im yet to debug deeper.
Did you ever find out anything more specific?

<!-- gh-comment-id:3377020910 --> @Powerkrieger commented on GitHub (Oct 7, 2025): I get the pretty much the same ``` Okt 07 15:44:57 mylab ollama[397923]: [GIN] 2025/10/07 - 15:44:57 | 200 | 35.791593ms | <MY_IP> | POST "/api/embed" Okt 07 15:44:57 mylab ollama[397923]: init: embeddings required but some input tokens were not marked as outputs -> overriding Okt 07 15:44:57 mylab ollama[397923]: init: embeddings required but some input tokens were not marked as outputs -> overriding Okt 07 15:44:57 mylab ollama[397923]: [GIN] 2025/10/07 - 15:44:57 | 200 | 35.811343ms | <MY_IP> | POST "/api/embed" Okt 07 15:44:57 mylab ollama[397923]: init: embeddings required but some input tokens were not marked as outputs -> overriding Okt 07 15:44:57 mylab ollama[397923]: init: embeddings required but some input tokens were not marked as outputs -> overriding ``` running ollama version 0.12.3; OS ubuntu24.04; GPU NVIDIA; Its probably got to do with the way the query is structured but im yet to debug deeper. Did you ever find out anything more specific?
Author
Owner

@emaayan commented on GitHub (Oct 9, 2025):

i'm noticing the same thing here, i'm, i'm trying to embed 27k textsegments (from an xml file) and it takes forever untill i timeout
(but this can happen even with one text segment)

<!-- gh-comment-id:3386977271 --> @emaayan commented on GitHub (Oct 9, 2025): i'm noticing the same thing here, i'm, i'm trying to embed 27k textsegments (from an xml file) and it takes forever untill i timeout (but this can happen even with one text segment)
Author
Owner

@odilovicc commented on GitHub (Oct 17, 2025):

Image

I'm also getting this. What should I do?
Running in Docker Desktop in m2 air

embedding: bge-m3

<!-- gh-comment-id:3416286998 --> @odilovicc commented on GitHub (Oct 17, 2025): <img width="1260" height="716" alt="Image" src="https://github.com/user-attachments/assets/c1299753-e508-4fd0-92ef-fad42188a2ef" /> I'm also getting this. What should I do? Running in Docker Desktop in m2 air embedding: bge-m3
Author
Owner

@liaoweiguo commented on GitHub (Oct 24, 2025):

the occurs in Mac ollama 0.12.6 bge-m3, but in Nvidia ollama 0.12.6 bge-m3 OK

<!-- gh-comment-id:3441328891 --> @liaoweiguo commented on GitHub (Oct 24, 2025): the occurs in Mac ollama 0.12.6 bge-m3, but in Nvidia ollama 0.12.6 bge-m3 OK
Author
Owner

@tatankam commented on GitHub (Oct 29, 2025):

Same here:

ollama[1009483]: init: embeddings required but some input tokens were not marked as outputs -> overriding

ollama 0.12.6
bge-m3:latest

<!-- gh-comment-id:3460338946 --> @tatankam commented on GitHub (Oct 29, 2025): Same here: ollama[1009483]: init: embeddings required but some input tokens were not marked as outputs -> overriding ollama 0.12.6 bge-m3:latest
Author
Owner

@dscholles81 commented on GitHub (Nov 6, 2025):

Also the same:
ollama version is 0.12.9
bge-m3:567m

<!-- gh-comment-id:3495803777 --> @dscholles81 commented on GitHub (Nov 6, 2025): Also the same: ollama version is 0.12.9 bge-m3:567m
Author
Owner

@ZaneITRI commented on GitHub (Nov 11, 2025):

Same here.

os : unumtu
ollama : 0.12.10
model:smartcreation/zpoint_large_embedding_zh

curl --location 'http://127.0.0.1:30007/v1/embeddings'
--header 'Content-Type: application/json'
--data '{
"model":"smartcreation/zpoint_large_embedding_zh",
"input":"black"
}'

init: embeddings required but some input tokens were not marked as outputs -> overriding
[GIN] 2025/11/11 - 08:16:16 | 200 | 80.826562ms | 10.244.0.0 | POST "/v1/embeddings"

but, after change to model:embeddinggemma, with the same curl script, the warning message disappear!
So, the root cause of the message is model?

<!-- gh-comment-id:3514463562 --> @ZaneITRI commented on GitHub (Nov 11, 2025): Same here. os : unumtu ollama : 0.12.10 model:smartcreation/zpoint_large_embedding_zh curl --location 'http://127.0.0.1:30007/v1/embeddings' \ --header 'Content-Type: application/json' \ --data '{ "model":"smartcreation/zpoint_large_embedding_zh", "input":"black" }' init: embeddings required but some input tokens were not marked as outputs -> overriding [GIN] 2025/11/11 - 08:16:16 | 200 | 80.826562ms | 10.244.0.0 | POST "/v1/embeddings" but, after change to model:embeddinggemma, with the same curl script, the warning message disappear! So, the root cause of the message is model?
Author
Owner

@ZaneITRI commented on GitHub (Nov 13, 2025):

I test on two embedding LLMs today:
A. smartcreation/zpoint_large_embedding_zh (This one will cause the "init: embeddings required but some input tokens were not marked as outputs -> overriding" error log)
B. embeddinggemma

in ollama 0.12.10,
Test A, I run in terminal shell: ollama run smartcreation/zpoint_large_embedding_zh "Hello world!"
and get the following result :
[unused22][unused5][unused22][unused7][unused19][unused23][unused20][unused12][unused13][unused13][unus[unused22][unused5][unused22][unused7]...

Test B. I run in terminal shell : ollama run embeddinggemma "Hello world!"
and get the following result :
[-0.19457138,0.018566499,0.06602225,-0.026832959,0.015119292,-0.0006574104,-0.0024458389,-0.010158638,-0.00513058,-0.030...

<!-- gh-comment-id:3525865638 --> @ZaneITRI commented on GitHub (Nov 13, 2025): I test on two embedding LLMs today: A. smartcreation/zpoint_large_embedding_zh (This one will cause the "init: embeddings required but some input tokens were not marked as outputs -> overriding" error log) B. embeddinggemma in ollama 0.12.10, Test A, I run in terminal shell: ollama run smartcreation/zpoint_large_embedding_zh "Hello world!" and get the following result : [unused22][unused5][unused22][unused7][unused19][unused23][unused20][unused12][unused13][unused13][unus[unused22][unused5][unused22][unused7]... Test B. I run in terminal shell : ollama run embeddinggemma "Hello world!" and get the following result : [-0.19457138,0.018566499,0.06602225,-0.026832959,0.015119292,-0.0006574104,-0.0024458389,-0.010158638,-0.00513058,-0.030...
Author
Owner

@Joao620 commented on GitHub (Dec 12, 2025):

Was getting the same logs on 0.13.0-2, even though the embeddings was returning successfully. But was resolved on 0.13.2-1

<!-- gh-comment-id:3648381578 --> @Joao620 commented on GitHub (Dec 12, 2025): Was getting the same logs on 0.13.0-2, even though the embeddings was returning successfully. But was resolved on 0.13.2-1
Author
Owner

@somera commented on GitHub (Feb 14, 2026):

See the same in v0.16.1 with bge-m3 with Open WebUI:

[GIN] 2026/02/14 - 22:45:28 | 200 |  3.268726557s |    172.31.144.1 | POST     "/api/embed"
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
[GIN] 2026/02/14 - 22:45:28 | 200 |  3.473966109s |    172.31.144.1 | POST     "/api/embed"
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
[GIN] 2026/02/14 - 22:45:28 | 200 |    3.4367671s |    172.31.144.1 | POST     "/api/embed"
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
[GIN] 2026/02/14 - 22:45:28 | 200 |  3.544790428s |    172.31.144.1 | POST     "/api/embed"
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
[GIN] 2026/02/14 - 22:45:28 | 200 |  3.627316373s |    172.31.144.1 | POST     "/api/embed"
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
<!-- gh-comment-id:3902593074 --> @somera commented on GitHub (Feb 14, 2026): See the same in v0.16.1 with `bge-m3` with Open WebUI: ``` [GIN] 2026/02/14 - 22:45:28 | 200 | 3.268726557s | 172.31.144.1 | POST "/api/embed" init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding [GIN] 2026/02/14 - 22:45:28 | 200 | 3.473966109s | 172.31.144.1 | POST "/api/embed" init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding [GIN] 2026/02/14 - 22:45:28 | 200 | 3.4367671s | 172.31.144.1 | POST "/api/embed" init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding [GIN] 2026/02/14 - 22:45:28 | 200 | 3.544790428s | 172.31.144.1 | POST "/api/embed" init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding [GIN] 2026/02/14 - 22:45:28 | 200 | 3.627316373s | 172.31.144.1 | POST "/api/embed" init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding init: embeddings required but some input tokens were not marked as outputs -> overriding ```
Author
Owner

@Elusv commented on GitHub (Feb 15, 2026):

Same. Ollama 0.15.6 on MacOs - embedding using bge-m3:latest (at tiime of post bge-m3:567m)

Does not seem to hurt performance for me - I get back the embeddings requested (as far as i can tell) quickly.

<!-- gh-comment-id:3904843823 --> @Elusv commented on GitHub (Feb 15, 2026): Same. Ollama 0.15.6 on MacOs - embedding using bge-m3:latest (at tiime of post bge-m3:567m) Does not seem to hurt performance for me - I get back the embeddings requested (as far as i can tell) quickly.
Author
Owner

@somera commented on GitHub (Feb 15, 2026):

See the same in v0.16.1 with bge-m3 with Open WebUI:

[GIN] 2026/02/14 - 22:45:28 | 200 |  3.268726557s |    172.31.144.1 | POST     "/api/embed"
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding

And I see an error(warning in Open WebUI when I drag'n'drop some files into the prompt.

Image
<!-- gh-comment-id:3904953040 --> @somera commented on GitHub (Feb 15, 2026): > See the same in v0.16.1 with `bge-m3` with Open WebUI: > > ``` > [GIN] 2026/02/14 - 22:45:28 | 200 | 3.268726557s | 172.31.144.1 | POST "/api/embed" > init: embeddings required but some input tokens were not marked as outputs -> overriding > init: embeddings required but some input tokens were not marked as outputs -> overriding > init: embeddings required but some input tokens were not marked as outputs -> overriding > init: embeddings required but some input tokens were not marked as outputs -> overriding > ``` And I see an error(warning in Open WebUI when I drag'n'drop some files into the prompt. <img width="226" height="81" alt="Image" src="https://github.com/user-attachments/assets/6defe340-45d9-4835-bc67-4c3952d6f024" />
Author
Owner

@holem commented on GitHub (Apr 7, 2026):

Same in v0.20.3 with bge-m3 (Docker, MacOS m1).

init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
init: embeddings required but some input tokens were not marked as outputs -> overriding
[GIN] 2026/04/07 - 13:58:26 | 200 | 1m21s | 192.168.65.1 | POST "/api/embed"
init: embeddings required but some input tokens were not marked as outputs -> overriding

<!-- gh-comment-id:4199525779 --> @holem commented on GitHub (Apr 7, 2026): Same in v0.20.3 with bge-m3 (Docker, MacOS m1). > init: embeddings required but some input tokens were not marked as outputs -> overriding > init: embeddings required but some input tokens were not marked as outputs -> overriding > init: embeddings required but some input tokens were not marked as outputs -> overriding > init: embeddings required but some input tokens were not marked as outputs -> overriding > [GIN] 2026/04/07 - 13:58:26 | 200 | 1m21s | 192.168.65.1 | POST "/api/embed" > init: embeddings required but some input tokens were not marked as outputs -> overriding
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#8223