[GH-ISSUE #22671] issue: Error 500 on ollama with RAG_EMBEDDING_ENGINE=ollama and RAG_EMBEDDING_MODEL=bge-m3 #35312

Closed
opened 2026-04-25 09:32:52 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @bibi21000 on GitHub (Mar 14, 2026).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/22671

Check Existing Issues

  • I have searched for any existing and/or related issues.
  • I have searched for any existing and/or related discussions.
  • I have also searched in the CLOSED issues AND CLOSED discussions and found no related items (your issue might already be addressed on the development branch!).
  • I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

0.8.10

Ollama Version (if applicable)

0.18.0

Operating System

Ubuntu 24.04 (using https://github.com/bibi21000/open-webui-tools)

Browser (if applicable)

No response

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided every relevant configuration, setting, and environment variable used in my setup.
  • I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
  • I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
  • Start with the initial platform/version/OS and dependencies used,
  • Specify exact install/launch/configure commands,
  • List URLs visited, user input (incl. example values/emails/passwords if needed),
  • Describe all options and toggles enabled or changed,
  • Include any files or environmental changes,
  • Identify the expected and actual result at each stage,
  • Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

Using Open WebUI with RAG_EMBEDDING_ENGINE=ollama and RAG_EMBEDDING_MODEL=bge-m3

Actual Behavior

Got an error 500 from Ollama when adding file to a knowledge via API

I don't know if problem come from Open WebUI or Ollama

Steps to Reproduce

app_DEFAULT_LOCALE=fr
app_PDF_EXTRACT_IMAGES=true
app_RAG_TEXT_SPLITTER=token
app_CHUNK_SIZE=1512
app_CHUNK_OVERLAP=400
app_CHUNK_MIN_SIZE_TARGET=500
app_RAG_TOP_K=20
app_ENABLE_RAG_HYBRID_SEARCH=true
app_RAG_EMBEDDING_ENGINE=ollama
app_RAG_EMBEDDING_MODEL=bge-m3
app_RAG_RELEVANCE_THRESHOLD=0.1
#app_RAG_RERANKING_MODEL=BAAI/bge-reranker-v2-m3
app_RAG_RERANKING_MODEL=jinaai/jina-reranker-v2-base-multilingual
app_API_KEYS=true
app_GLOBAL_LOG_LEVEL=DEBUG

OLLAMA_MODELS=llama3.2,bge-m3

ollama_OLLAMA_DEBUG=2

OWEBUI_IMAGE=ghcr.io/open-webui/open-webui:main-slim
OWEBUI_DEVICE=

Logs & Screenshots

Open WebUI log

2026-03-14 10:26:03.747 | ERROR | open_webui.retrieval.utils:agenerate_ollama_batch_embeddings:819 - Error generating ollama batch embeddings: 500, message='Internal Server Error', url='http://172.17.0.3:11434/api/embed'
Traceback (most recent call last):

File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 4, in
uvicorn.main()
│ └
└ <module 'uvicorn' from '/usr/local/lib/python3.11/site-packages/uvicorn/init.py'>
File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1485, in call
return self.main(args, **kwargs)
│ │ │ └ {}
│ │ └ ()
│ └ <function Command.main at 0x75ed12376e80>

File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1406, in main
rv = self.invoke(ctx)
│ │ └ <click.core.Context object at 0x75ed130bca50>
│ └ <function Command.invoke at 0x75ed12376b60>

File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1269, in invoke
return ctx.invoke(self.callback, **ctx.params)
│ │ │ │ │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '
', 'workers': 1, 'app': 'open_webui.main:app', 'uds': None, 'fd': ...
│ │ │ │ └ <click.core.Context object at 0x75ed130bca50>
│ │ │ └ <function main at 0x75ed1200d4e0>
│ │ └
│ └ <function Context.invoke at 0x75ed12375da0>
└ <click.core.Context object at 0x75ed130bca50>
File "/usr/local/lib/python3.11/site-packages/click/core.py", line 824, in invoke
return callback(args, **kwargs)
│ │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '
', 'workers': 1, 'app': 'open_webui.main:app', 'uds': None, 'fd': ...
│ └ ()
└ <function main at 0x75ed1200d4e0>
File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 433, in main
run(
└ <function run at 0x75ed122ad580>
File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 606, in run
server.run()
│ └ <function Server.run at 0x75ed122ace00>
└ <uvicorn.server.Server object at 0x75ed123af250>
File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 75, in run
return asyncio_run(self.serve(sockets=sockets), loop_factory=self.config.get_loop_factory())
│ │ │ │ │ │ └ <function Config.get_loop_factory at 0x75ed124494e0>
│ │ │ │ │ └ <uvicorn.config.Config object at 0x75ed1200b850>
│ │ │ │ └ <uvicorn.server.Server object at 0x75ed123af250>
│ │ │ └ None
│ │ └ <function Server.serve at 0x75ed122acea0>
│ └ <uvicorn.server.Server object at 0x75ed123af250>
└ <function asyncio_run at 0x75ed1237de40>
File "/usr/local/lib/python3.11/site-packages/uvicorn/_compat.py", line 30, in asyncio_run
return runner.run(main)
│ │ └ <coroutine object Server.serve at 0x75ed11ffd7b0>
│ └ <function Runner.run at 0x75ed12614fe0>
└ <asyncio.runners.Runner object at 0x75ed1202f210>
File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
│ │ │ └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:79> wai...
│ │ └ <cyfunction Loop.run_until_complete at 0x75ed12070280>
│ └ <uvloop.Loop running=True closed=False debug=False>
└ <asyncio.runners.Runner object at 0x75ed1202f210>

File "/app/backend/open_webui/retrieval/utils.py", line 940, in generate_embeddings
embeddings = await agenerate_ollama_batch_embeddings(
└ <function agenerate_ollama_batch_embeddings at 0x75ec8e94c0e0>

File "/app/backend/open_webui/retrieval/utils.py", line 812, in agenerate_ollama_batch_embeddings
r.raise_for_status()
│ └ <function ClientResponse.raise_for_status at 0x75ed0fe79620>
└ <ClientResponse(http://172.17.0.3:11434/api/embed) [500 Internal Server Error]>
<CIMultiDictProxy('Content-Type': 'applicatio...

File "/usr/local/lib/python3.11/site-packages/aiohttp/client_reqrep.py", line 636, in raise_for_status
raise ClientResponseError(
└ <class 'aiohttp.client_exceptions.ClientResponseError'>

aiohttp.client_exceptions.ClientResponseError: 500, message='Internal Server Error', url='http://172.17.0.3:11434/api/embed'

When starting Open WebUi docker image i have this message (Not sure it's related)

v0.8.10 - building the best AI user interface.

https://github.com/open-webui/open-webui

Fetching 24 files: 100%|██████████| 24/24 [00:00<00:00, 32274.22it/s]
torch_dtype is deprecated! Use dtype instead!
ERROR [open_webui.routers.retrieval] CrossEncoder: cannot import name 'create_position_ids_from_input_ids' from 'transformers.models.xlm_roberta.modeling_xlm_roberta' (/usr/local/lib/python3.11/site-packages/transformers/models/xlm_roberta/modeling_xlm_roberta.py)
ERROR [open_webui.main] Error updating models: [ERROR: CrossEncoder error]
INFO: Started server process [1]
INFO: Waiting for application startup.

Ollama log

time=2026-03-14T10:29:10.021Z level=DEBUG source=sched.go:431 msg="context for request finished" runner.name=registry.ollama.ai/library/bge-m3:latest runner.inference="[{ID:GPU-70f0802d-d6b4-3217-79e4-a43c885bb2a0 Library:CUDA}]" runner.size="1.1 GiB" runner.vram="1.1 GiB" runner.parallel=1 runner.pid=118 runner.model=/root/.ollama/models/blobs/sha256-daec91ffb5dd0c27411bd71f29932917c49cf529a641d0168496c3a501e3062c runner.num_ctx=4096
time=2026-03-14T10:29:10.021Z level=DEBUG source=sched.go:354 msg="after processing request finished event" runner.name=registry.ollama.ai/library/bge-m3:latest runner.inference="[{ID:GPU-70f0802d-d6b4-3217-79e4-a43c885bb2a0 Library:CUDA}]" runner.size="1.1 GiB" runner.vram="1.1 GiB" runner.parallel=1 runner.pid=118 runner.model=/root/.ollama/models/blobs/sha256-daec91ffb5dd0c27411bd71f29932917c49cf529a641d0168496c3a501e3062c runner.num_ctx=4096 refCount=39
time=2026-03-14T10:29:10.024Z level=DEBUG source=cache.go:104 msg="loading cache slot" id=0 cache=1621 prompt=1658 used=0 remaining=1658
decode: cannot decode batches with this context (calling encode() instead)
init: embeddings required but some input tokens were not marked as outputs -> overriding
[GIN] 2026/03/14 - 10:29:12 | 500 | 4m0s | 172.17.0.4 | POST "/api/embed"

Additional Information

Env for Open WebUI docker image

PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
HOSTNAME=3b23f96da885
TERM=xterm
RAG_TOP_K=20
RAG_EMBEDDING_MODEL=bge-m3
RAG_RERANKING_MODEL=jinaai/jina-reranker-v2-base-multilingual
API_KEYS=true
PDF_EXTRACT_IMAGES=true
RAG_EMBEDDING_ENGINE=ollama
RAG_RELEVANCE_THRESHOLD=0.1
RAG_OLLAMA_BASE_URL=http://172.17.0.3:11434
DEFAULT_LOCALE=fr
CHUNK_MIN_SIZE_TARGET=500
ENABLE_RAG_HYBRID_SEARCH=true
VECTOR_DB=pgvector
GLOBAL_LOG_LEVEL=DEBUG
RAG_TEXT_SPLITTER=token
CHUNK_SIZE=1512
CHUNK_OVERLAP=400
DATABASE_URL=postgresql://owebui:badpasswd@172.17.0.2:5432/owebui_db
OLLAMA_BASE_URL=http://172.17.0.3:11434
PGVECTOR_DB_URL=postgresql://owebui:badpasswd@172.17.0.2:5432/owebui_db
LANG=C.UTF-8
GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D
PYTHON_VERSION=3.11.14
PYTHON_SHA256=8d3ed8ec5c88c1c95f5e558612a725450d2452813ddad5e58fdb1a53b1209b78
PYTHONUNBUFFERED=1
ENV=prod
PORT=8080
USE_OLLAMA_DOCKER=false
USE_CUDA_DOCKER=false
USE_SLIM_DOCKER=true
USE_CUDA_DOCKER_VER=cu128
USE_EMBEDDING_MODEL_DOCKER=sentence-transformers/all-MiniLM-L6-v2
USE_RERANKING_MODEL_DOCKER=
USE_AUXILIARY_EMBEDDING_MODEL_DOCKER=TaylorAI/bge-micro-v2
OPENAI_API_BASE_URL=
OPENAI_API_KEY=
SCARF_NO_ANALYTICS=true
DO_NOT_TRACK=true
ANONYMIZED_TELEMETRY=false
WHISPER_MODEL=base
WHISPER_MODEL_DIR=/app/backend/data/cache/whisper/models
AUXILIARY_EMBEDDING_MODEL=TaylorAI/bge-micro-v2
SENTENCE_TRANSFORMERS_HOME=/app/backend/data/cache/embedding/models
TIKTOKEN_ENCODING_NAME=cl100k_base
TIKTOKEN_CACHE_DIR=/app/backend/data/cache/tiktoken
HF_HOME=/app/backend/data/cache/embedding/models
HOME=/root
WEBUI_BUILD_VERSION=e4e69a10ec08a725bf2ab3db499ef664f2bd7570
DOCKER=true

Env for Ollama docker image

PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
HOSTNAME=47142efd3c6f
TERM=xterm
OLLAMA_DEBUG=2
LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
NVIDIA_DRIVER_CAPABILITIES=compute,utility
NVIDIA_VISIBLE_DEVICES=all
OLLAMA_HOST=0.0.0.0:11434
HOME=/root

Env for Postgresql docker image

PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/postgresql/18/bin
HOSTNAME=31bd0288f59b
TERM=xterm
POSTGRES_PASSWORD=badpasswd
POSTGRES_USER=owebui
POSTGRES_DB=owebui_db
GOSU_VERSION=1.19
LANG=en_US.utf8
PG_MAJOR=18
PG_VERSION=18.3-1.pgdg13+1
PGDATA=/var/lib/postgresql/18/docker
HOME=/root

Originally created by @bibi21000 on GitHub (Mar 14, 2026). Original GitHub issue: https://github.com/open-webui/open-webui/issues/22671 ### Check Existing Issues - [x] I have searched for any existing and/or related issues. - [x] I have searched for any existing and/or related discussions. - [x] I have also searched in the CLOSED issues AND CLOSED discussions and found no related items (your issue might already be addressed on the development branch!). - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version 0.8.10 ### Ollama Version (if applicable) 0.18.0 ### Operating System Ubuntu 24.04 (using https://github.com/bibi21000/open-webui-tools) ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior Using Open WebUI with RAG_EMBEDDING_ENGINE=ollama and RAG_EMBEDDING_MODEL=bge-m3 ### Actual Behavior Got an error 500 from Ollama when adding file to a knowledge via API I don't know if problem come from Open WebUI or Ollama ### Steps to Reproduce - Install Open WebUI, Ollama and Postgresql using https://github.com/bibi21000/open-webui-tools - Use the following local configuration (/etc/open-webui/open-webui-local.conf) > app_DEFAULT_LOCALE=fr > app_PDF_EXTRACT_IMAGES=true > app_RAG_TEXT_SPLITTER=token > app_CHUNK_SIZE=1512 > app_CHUNK_OVERLAP=400 > app_CHUNK_MIN_SIZE_TARGET=500 > app_RAG_TOP_K=20 > app_ENABLE_RAG_HYBRID_SEARCH=true > app_RAG_EMBEDDING_ENGINE=ollama > app_RAG_EMBEDDING_MODEL=bge-m3 > app_RAG_RELEVANCE_THRESHOLD=0.1 > #app_RAG_RERANKING_MODEL=BAAI/bge-reranker-v2-m3 > app_RAG_RERANKING_MODEL=jinaai/jina-reranker-v2-base-multilingual > app_API_KEYS=true > app_GLOBAL_LOG_LEVEL=DEBUG > > OLLAMA_MODELS=llama3.2,bge-m3 > > ollama_OLLAMA_DEBUG=2 > > OWEBUI_IMAGE=ghcr.io/open-webui/open-webui:main-slim > OWEBUI_DEVICE= ### Logs & Screenshots Open WebUI log > 2026-03-14 10:26:03.747 | ERROR | open_webui.retrieval.utils:agenerate_ollama_batch_embeddings:819 - Error generating ollama batch embeddings: 500, message='Internal Server Error', url='http://172.17.0.3:11434/api/embed' > Traceback (most recent call last): > > File "<frozen runpy>", line 198, in _run_module_as_main > File "<frozen runpy>", line 88, in _run_code > File "/usr/local/lib/python3.11/site-packages/uvicorn/__main__.py", line 4, in <module> > uvicorn.main() > │ └ <Command main> > └ <module 'uvicorn' from '/usr/local/lib/python3.11/site-packages/uvicorn/__init__.py'> > File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1485, in __call__ > return self.main(*args, **kwargs) > │ │ │ └ {} > │ │ └ () > │ └ <function Command.main at 0x75ed12376e80> > └ <Command main> > File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1406, in main > rv = self.invoke(ctx) > │ │ └ <click.core.Context object at 0x75ed130bca50> > │ └ <function Command.invoke at 0x75ed12376b60> > └ <Command main> > File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1269, in invoke > return ctx.invoke(self.callback, **ctx.params) > │ │ │ │ │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'workers': 1, 'app': 'open_webui.main:app', 'uds': None, 'fd': ... > │ │ │ │ └ <click.core.Context object at 0x75ed130bca50> > │ │ │ └ <function main at 0x75ed1200d4e0> > │ │ └ <Command main> > │ └ <function Context.invoke at 0x75ed12375da0> > └ <click.core.Context object at 0x75ed130bca50> > File "/usr/local/lib/python3.11/site-packages/click/core.py", line 824, in invoke > return callback(*args, **kwargs) > │ │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'workers': 1, 'app': 'open_webui.main:app', 'uds': None, 'fd': ... > │ └ () > └ <function main at 0x75ed1200d4e0> > File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 433, in main > run( > └ <function run at 0x75ed122ad580> > File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 606, in run > server.run() > │ └ <function Server.run at 0x75ed122ace00> > └ <uvicorn.server.Server object at 0x75ed123af250> > File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 75, in run > return asyncio_run(self.serve(sockets=sockets), loop_factory=self.config.get_loop_factory()) > │ │ │ │ │ │ └ <function Config.get_loop_factory at 0x75ed124494e0> > │ │ │ │ │ └ <uvicorn.config.Config object at 0x75ed1200b850> > │ │ │ │ └ <uvicorn.server.Server object at 0x75ed123af250> > │ │ │ └ None > │ │ └ <function Server.serve at 0x75ed122acea0> > │ └ <uvicorn.server.Server object at 0x75ed123af250> > └ <function asyncio_run at 0x75ed1237de40> > File "/usr/local/lib/python3.11/site-packages/uvicorn/_compat.py", line 30, in asyncio_run > return runner.run(main) > │ │ └ <coroutine object Server.serve at 0x75ed11ffd7b0> > │ └ <function Runner.run at 0x75ed12614fe0> > └ <asyncio.runners.Runner object at 0x75ed1202f210> > File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run > return self._loop.run_until_complete(task) > │ │ │ └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:79> wai... > │ │ └ <cyfunction Loop.run_until_complete at 0x75ed12070280> > │ └ <uvloop.Loop running=True closed=False debug=False> > └ <asyncio.runners.Runner object at 0x75ed1202f210> > > File "/app/backend/open_webui/retrieval/utils.py", line 940, in generate_embeddings > embeddings = await agenerate_ollama_batch_embeddings( > └ <function agenerate_ollama_batch_embeddings at 0x75ec8e94c0e0> > > > File "/app/backend/open_webui/retrieval/utils.py", line 812, in agenerate_ollama_batch_embeddings > r.raise_for_status() > │ └ <function ClientResponse.raise_for_status at 0x75ed0fe79620> > └ <ClientResponse(http://172.17.0.3:11434/api/embed) [500 Internal Server Error]> > <CIMultiDictProxy('Content-Type': 'applicatio... > > File "/usr/local/lib/python3.11/site-packages/aiohttp/client_reqrep.py", line 636, in raise_for_status > raise ClientResponseError( > └ <class 'aiohttp.client_exceptions.ClientResponseError'> > > aiohttp.client_exceptions.ClientResponseError: 500, message='Internal Server Error', url='http://172.17.0.3:11434/api/embed' When starting Open WebUi docker image i have this message (Not sure it's related) > v0.8.10 - building the best AI user interface. > > https://github.com/open-webui/open-webui > > Fetching 24 files: 100%|██████████| 24/24 [00:00<00:00, 32274.22it/s] > `torch_dtype` is deprecated! Use `dtype` instead! > ERROR [open_webui.routers.retrieval] CrossEncoder: cannot import name 'create_position_ids_from_input_ids' from 'transformers.models.xlm_roberta.modeling_xlm_roberta' (/usr/local/lib/python3.11/site-packages/transformers/models/xlm_roberta/modeling_xlm_roberta.py) > ERROR [open_webui.main] Error updating models: [ERROR: CrossEncoder error] > INFO: Started server process [1] > INFO: Waiting for application startup. Ollama log > time=2026-03-14T10:29:10.021Z level=DEBUG source=sched.go:431 msg="context for request finished" runner.name=registry.ollama.ai/library/bge-m3:latest runner.inference="[{ID:GPU-70f0802d-d6b4-3217-79e4-a43c885bb2a0 Library:CUDA}]" runner.size="1.1 GiB" runner.vram="1.1 GiB" runner.parallel=1 runner.pid=118 runner.model=/root/.ollama/models/blobs/sha256-daec91ffb5dd0c27411bd71f29932917c49cf529a641d0168496c3a501e3062c runner.num_ctx=4096 > time=2026-03-14T10:29:10.021Z level=DEBUG source=sched.go:354 msg="after processing request finished event" runner.name=registry.ollama.ai/library/bge-m3:latest runner.inference="[{ID:GPU-70f0802d-d6b4-3217-79e4-a43c885bb2a0 Library:CUDA}]" runner.size="1.1 GiB" runner.vram="1.1 GiB" runner.parallel=1 runner.pid=118 runner.model=/root/.ollama/models/blobs/sha256-daec91ffb5dd0c27411bd71f29932917c49cf529a641d0168496c3a501e3062c runner.num_ctx=4096 refCount=39 > time=2026-03-14T10:29:10.024Z level=DEBUG source=cache.go:104 msg="loading cache slot" id=0 cache=1621 prompt=1658 used=0 remaining=1658 > decode: cannot decode batches with this context (calling encode() instead) > init: embeddings required but some input tokens were not marked as outputs -> overriding > [GIN] 2026/03/14 - 10:29:12 | 500 | 4m0s | 172.17.0.4 | POST "/api/embed" ### Additional Information Env for Open WebUI docker image > PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin > HOSTNAME=3b23f96da885 > TERM=xterm > RAG_TOP_K=20 > RAG_EMBEDDING_MODEL=bge-m3 > RAG_RERANKING_MODEL=jinaai/jina-reranker-v2-base-multilingual > API_KEYS=true > PDF_EXTRACT_IMAGES=true > RAG_EMBEDDING_ENGINE=ollama > RAG_RELEVANCE_THRESHOLD=0.1 > RAG_OLLAMA_BASE_URL=http://172.17.0.3:11434 > DEFAULT_LOCALE=fr > CHUNK_MIN_SIZE_TARGET=500 > ENABLE_RAG_HYBRID_SEARCH=true > VECTOR_DB=pgvector > GLOBAL_LOG_LEVEL=DEBUG > RAG_TEXT_SPLITTER=token > CHUNK_SIZE=1512 > CHUNK_OVERLAP=400 > DATABASE_URL=postgresql://owebui:badpasswd@172.17.0.2:5432/owebui_db > OLLAMA_BASE_URL=http://172.17.0.3:11434 > PGVECTOR_DB_URL=postgresql://owebui:badpasswd@172.17.0.2:5432/owebui_db > LANG=C.UTF-8 > GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D > PYTHON_VERSION=3.11.14 > PYTHON_SHA256=8d3ed8ec5c88c1c95f5e558612a725450d2452813ddad5e58fdb1a53b1209b78 > PYTHONUNBUFFERED=1 > ENV=prod > PORT=8080 > USE_OLLAMA_DOCKER=false > USE_CUDA_DOCKER=false > USE_SLIM_DOCKER=true > USE_CUDA_DOCKER_VER=cu128 > USE_EMBEDDING_MODEL_DOCKER=sentence-transformers/all-MiniLM-L6-v2 > USE_RERANKING_MODEL_DOCKER= > USE_AUXILIARY_EMBEDDING_MODEL_DOCKER=TaylorAI/bge-micro-v2 > OPENAI_API_BASE_URL= > OPENAI_API_KEY= > SCARF_NO_ANALYTICS=true > DO_NOT_TRACK=true > ANONYMIZED_TELEMETRY=false > WHISPER_MODEL=base > WHISPER_MODEL_DIR=/app/backend/data/cache/whisper/models > AUXILIARY_EMBEDDING_MODEL=TaylorAI/bge-micro-v2 > SENTENCE_TRANSFORMERS_HOME=/app/backend/data/cache/embedding/models > TIKTOKEN_ENCODING_NAME=cl100k_base > TIKTOKEN_CACHE_DIR=/app/backend/data/cache/tiktoken > HF_HOME=/app/backend/data/cache/embedding/models > HOME=/root > WEBUI_BUILD_VERSION=e4e69a10ec08a725bf2ab3db499ef664f2bd7570 > DOCKER=true Env for Ollama docker image > PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin > HOSTNAME=47142efd3c6f > TERM=xterm > OLLAMA_DEBUG=2 > LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 > NVIDIA_DRIVER_CAPABILITIES=compute,utility > NVIDIA_VISIBLE_DEVICES=all > OLLAMA_HOST=0.0.0.0:11434 > HOME=/root Env for Postgresql docker image > PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/postgresql/18/bin > HOSTNAME=31bd0288f59b > TERM=xterm > POSTGRES_PASSWORD=badpasswd > POSTGRES_USER=owebui > POSTGRES_DB=owebui_db > GOSU_VERSION=1.19 > LANG=en_US.utf8 > PG_MAJOR=18 > PG_VERSION=18.3-1.pgdg13+1 > PGDATA=/var/lib/postgresql/18/docker > HOME=/root
GiteaMirror added the bug label 2026-04-25 09:32:52 -05:00
Author
Owner

@bibi21000 commented on GitHub (Mar 20, 2026):

Seem this probelem is related to bge-m3.
Works fine with nomic-embed-text-v2-moe
Let me know if you want i test and report with bge-m3 after you publish your PR
TY for this project

<!-- gh-comment-id:4097981283 --> @bibi21000 commented on GitHub (Mar 20, 2026): Seem this probelem is related to bge-m3. Works fine with nomic-embed-text-v2-moe Let me know if you want i test and report with bge-m3 after you publish your PR TY for this project
Author
Owner

@tjbck commented on GitHub (Mar 24, 2026):

Should be addressed in dev.

<!-- gh-comment-id:4121696590 --> @tjbck commented on GitHub (Mar 24, 2026): Should be addressed in dev.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#35312