github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-03-11 00:04:08 -05:00
Code Issues 308 Packages Projects Releases 100 Wiki Activity

Chromadb warns that my database needs to be vacuumed #2645

New Issue
Closed
opened 2025-11-11 15:11:15 -06:00 by GiteaMirror · 0 comments
GiteaMirror commented 2025-11-11 15:11:15 -06:00
Owner
Copy Link

Originally created by @ivy on GitHub (Nov 13, 2024).

Bug Report

Thanks for making Open WebUI! 🙌💜 I'm not sure if this classifies as a bug or a feature request. Details to follow…

Installation Method

Docker image (details within) 
[
    {
        "Id": "sha256:9f81d42888e3246e44c568d5e638a7e985bd6f866a9bc24be4ff80b06d2ca668",
        "RepoTags": [
            "ghcr.io/open-webui/open-webui:main"
        ],
        "RepoDigests": [
            "ghcr.io/open-webui/open-webui@sha256:f9b59ec6872d19d38d650debe3656e8e81e29e19275827330500965d7b2739d6"
        ],
        "Parent": "",
        "Comment": "buildkit.dockerfile.v0",
        "Created": "2024-11-10T02:07:51.354921458Z",
        "DockerVersion": "",
        "Author": "",
        "Config": {
            "Hostname": "",
            "Domainname": "",
            "User": "0:0",
            "AttachStdin": false,
            "AttachStdout": false,
            "AttachStderr": false,
            "ExposedPorts": {
                "8080/tcp": {}
            },
            "Tty": false,
            "OpenStdin": false,
            "StdinOnce": false,
            "Env": [
                "PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
                "LANG=C.UTF-8",
                "GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D",
                "PYTHON_VERSION=3.11.10",
                "PYTHON_SHA256=07a4356e912900e61a15cb0949a06c4a05012e213ecd6b4e84d0f67aabbee372",
                "ENV=prod",
                "PORT=8080",
                "USE_OLLAMA_DOCKER=false",
                "USE_CUDA_DOCKER=false",
                "USE_CUDA_DOCKER_VER=cu121",
                "USE_EMBEDDING_MODEL_DOCKER=sentence-transformers/all-MiniLM-L6-v2",
                "USE_RERANKING_MODEL_DOCKER=",
                "OLLAMA_BASE_URL=/ollama",
                "OPENAI_API_BASE_URL=",
                "OPENAI_API_KEY=",
                "WEBUI_SECRET_KEY=",
                "SCARF_NO_ANALYTICS=true",
                "DO_NOT_TRACK=true",
                "ANONYMIZED_TELEMETRY=false",
                "WHISPER_MODEL=base",
                "WHISPER_MODEL_DIR=/app/backend/data/cache/whisper/models",
                "RAG_EMBEDDING_MODEL=sentence-transformers/all-MiniLM-L6-v2",
                "RAG_RERANKING_MODEL=",
                "SENTENCE_TRANSFORMERS_HOME=/app/backend/data/cache/embedding/models",
                "TIKTOKEN_ENCODING_NAME=cl100k_base",
                "TIKTOKEN_CACHE_DIR=/app/backend/data/cache/tiktoken",
                "HF_HOME=/app/backend/data/cache/embedding/models",
                "HOME=/root",
                "WEBUI_BUILD_VERSION=96c865404d36637eafadb6d2dd2365c85d452648",
                "DOCKER=true"
            ],
            "Cmd": [
                "bash",
                "start.sh"
            ],
            "Healthcheck": {
                "Test": [
                    "CMD-SHELL",
                    "curl --silent --fail http://localhost:${PORT:-8080}/health | jq -ne 'input.status == true' || exit 1"
                ]
            },
            "ArgsEscaped": true,
            "Image": "",
            "Volumes": null,
            "WorkingDir": "/app/backend",
            "Entrypoint": null,
            "OnBuild": null,
            "Labels": {
                "org.opencontainers.image.created": "2024-11-10T02:01:47.409Z",
                "org.opencontainers.image.description": "User-friendly AI Interface (Supports Ollama, OpenAI API, ...)",
                "org.opencontainers.image.licenses": "MIT",
                "org.opencontainers.image.revision": "96c865404d36637eafadb6d2dd2365c85d452648",
                "org.opencontainers.image.source": "https://github.com/open-webui/open-webui",
                "org.opencontainers.image.title": "open-webui",
                "org.opencontainers.image.url": "https://github.com/open-webui/open-webui",
                "org.opencontainers.image.version": "main"
            }
        },
        "Architecture": "arm64",
        "Os": "linux",
        "Size": 3680538255,
        "GraphDriver": {
            "Data": {
                "LowerDir": "/var/lib/docker/overlay2/486e45297c946e61b75e1f16c24e7f0cf7af67033131fbd8036ed28ecac674b5/diff:/var/lib/docker/overlay2/4a8d4ef6818f0a077ffba812f76a275e9bf6e3c735973323278316ce1119fa8c/diff:/var/lib/docker/overlay2/6b84580a48a5bd2e8024f90a93e3b76e1bba2597d238c9c0d604539fd8ce6978/diff:/var/lib/docker/overlay2/87edd5023cdc38e6f08bb9493f09182a86870d5e4851fea0414569c6c4f1ddc7/diff:/var/lib/docker/overlay2/dc3a122c2612683c4cb13b14e750178dc120625fd86b9d6efef51d15764d6c38/diff:/var/lib/docker/overlay2/84a39d5110cb6ffd4fda3680f77ae647fed3260f2e231c721d7be3e733d3ffc3/diff:/var/lib/docker/overlay2/822ad4792fc9955d3a8f8ca8a8dff83be2855b001ee0083b7b17d937f8bd10a7/diff:/var/lib/docker/overlay2/7f747f4c0b323cf47ad5d15b5432a3ab9d203cc6df80be1eacc628143ae53a65/diff:/var/lib/docker/overlay2/5c9edcc0af2b3a2446e86849f4fcc39eb4484230e932bb82571bc7fd3737570d/diff:/var/lib/docker/overlay2/4c70196bbf2b5698f7c0f34c0c3719e23c3cef8487926e0e3da703afa0c5b4a9/diff:/var/lib/docker/overlay2/8e3b19d4fa22375d0cb81b6045ad39dcb409d225cb38af92f1954b9159e50b9a/diff:/var/lib/docker/overlay2/fd8bd8b5fc79505654e78029eacc4300c03f1e71d1905c93e44f585461ea11b9/diff:/var/lib/docker/overlay2/458a91be28a193f994b695d46606d1c1fd14437f88a68cedee222164d043fe21/diff:/var/lib/docker/overlay2/9d7a259786a38ff2fd1917660551b72407bef300715ba8fadf174c3e77d4336f/diff:/var/lib/docker/overlay2/8a9ea0475571a7686d535ad1c44dc03d3847e81bbdf4da7f85ae26042dfa1fed/diff",
                "MergedDir": "/var/lib/docker/overlay2/8f442d502f8b8b9799383115e55c72ad045aeb7f2cd4e66af6a1b472a0ef2eb4/merged",
                "UpperDir": "/var/lib/docker/overlay2/8f442d502f8b8b9799383115e55c72ad045aeb7f2cd4e66af6a1b472a0ef2eb4/diff",
                "WorkDir": "/var/lib/docker/overlay2/8f442d502f8b8b9799383115e55c72ad045aeb7f2cd4e66af6a1b472a0ef2eb4/work"
            },
            "Name": "overlay2"
        },
        "RootFS": {
            "Type": "layers",
            "Layers": [
                "sha256:f0f039847c0897e41273775d599cc761049c809342ff8362efb4caf561186ada",
                "sha256:c6fe574d28cee88986e7a83cd3aa90cf971e618ce75dc5ef30fbeaaf74ab10b8",
                "sha256:d37582ba90d59a93322a22baf56a21e074dcf0fdf641f12c7af4ba76e156b0c6",
                "sha256:069dda5e673b37b18c361c6b5938bfdd9cf1f979d3a87cbe4a7bd501ca570119",
                "sha256:10141a24bd842d8d97b7b355fe4527294c903dc0a3340d095c40765bf521dfd5",
                "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
                "sha256:0b3f016125e32708ac9f979bf0e62db26b699bc5a7b76ef3e8ec7e53a8ec7aab",
                "sha256:2ee6958913ee79a8df0e1112adb8e999c2b85dfba3cb7bac00064124f77d3524",
                "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
                "sha256:8605fab1816c120ee049c7b8dd1285a2603c07a3be15c72981149595fa707517",
                "sha256:fc593493f49a1ed57afbea55ddc426a992563acd2795654e7d04c7e6486668d0",
                "sha256:2dd286073ed4454f85a80ec9c152c07a8f2f16bc294be8692e8cf39f877721bf",
                "sha256:099c47ecbeef18b3b250dceb1265affd4a8d2dc16eb4254fa0a0d2cf7f3326cb",
                "sha256:33f89fed9395d2ce9c7f0ff93cdb5fb7948f6e18c213dc70799b7b5607fa8db8",
                "sha256:6c51df98b12fe430778dc4de32490cb24d882b338693c54c63c997a446a500bb",
                "sha256:a89350848ec8982fd2a7ef9e9c2a5c06bd8163dc22924d6489d54a13403e10d7"
            ]
        },
        "Metadata": {
            "LastTagTime": "0001-01-01T00:00:00Z"
        }
    }
]

Environment

  • Open WebUI Version: v0.3.35
  • Ollama (if applicable): n/a
  • Operating System: macOS Sonoma 14.6.1 (23G93)
  • Browser (if applicable): n/a

Confirmation:

  • I have read and followed all the instructions provided in the README.md.
  • I am on the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.

Expected Behavior:

I think Open WebUI should either:

  • Package executable utilities like chromadb with its Docker image so users can perform maintenance tasks; or
  • Open WebUI should perform database maintenance on its own when required (maybe there's a config setting in chromadb to support this?).

Actual Behavior:

Chromadb logs a message:

WARNI [chromadb.db.impl.sqlite] ⚠️ It looks like you upgraded from a version below 0.6 and could benefit from vacuuming your database. Run chromadb utils vacuum --help for more information.

I'm not sure what changes were made in chromadb to prompt this and unfortunately, chromadb isn't an executable on my $PATH within the distributed Docker image:

docker exec <open-webui container ID> /bin/bash
root@cf06ca28c6a1:/app/backend# chromadb utils vacuum --help
bash: chromadb: command not found
root@cf06ca28c6a1:/app/backend# find / -type f -name chromadb -executable
[no output -- nothing found]

Description

Bug Summary: Changes to chromadb are recommending running chromadb utils vacuum but this utility isn't available in the Docker image. Additionally, I'm wondering if Open WebUI should do this on its own (through a config setting or calling applicable methods).

Reproduction Details

Steps to Reproduce: I believe the steps to reproduce are to run a copy of Open WebUI with an earlier release of chromadb (create some data) then upgrade to the latest version (and dependencies). Subsequent startups will result in this log message.

Logs and Screenshots

Browser Console Logs: n/a

Docker Container Logs (expand to view) 
Loading WEBUI_SECRET_KEY from file, not provided as an environment variable.
Generating WEBUI_SECRET_KEY
Loading WEBUI_SECRET_KEY from .webui_secret_key
/app/backend/open_webui
/app/backend
/app
Running migrations
INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
WARNI [open_webui.env] 

WARNING: CORS_ALLOW_ORIGIN IS SET TO '*' - NOT RECOMMENDED FOR PRODUCTION DEPLOYMENTS.

INFO  [open_webui.env] 'CONTENT_EXTRACTION_ENGINE' loaded from the latest database entry
INFO  [open_webui.env] 'TIKA_SERVER_URL' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_TOP_K' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_RELEVANCE_THRESHOLD' loaded from the latest database entry
INFO  [open_webui.env] 'ENABLE_RAG_HYBRID_SEARCH' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_EMBEDDING_ENGINE' loaded from the latest database entry
INFO  [open_webui.env] 'PDF_EXTRACT_IMAGES' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_EMBEDDING_MODEL' loaded from the latest database entry
INFO  [open_webui.env] Embedding model set: sentence-transformers/all-MiniLM-L6-v2
INFO  [open_webui.env] 'CHUNK_SIZE' loaded from the latest database entry
INFO  [open_webui.env] 'CHUNK_OVERLAP' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_TEMPLATE' loaded from the latest database entry
INFO  [open_webui.env] 'YOUTUBE_LOADER_LANGUAGE' loaded from the latest database entry
INFO  [open_webui.env] 'ENABLE_RAG_WEB_SEARCH' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_WEB_SEARCH_ENGINE' loaded from the latest database entry
INFO  [open_webui.env] 'SEARXNG_QUERY_URL' loaded from the latest database entry
INFO  [open_webui.env] 'GOOGLE_PSE_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'GOOGLE_PSE_ENGINE_ID' loaded from the latest database entry
INFO  [open_webui.env] 'BRAVE_SEARCH_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'SERPSTACK_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'SERPSTACK_HTTPS' loaded from the latest database entry
INFO  [open_webui.env] 'SERPER_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'SERPLY_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'TAVILY_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_WEB_SEARCH_RESULT_COUNT' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_WEB_SEARCH_CONCURRENT_REQUESTS' loaded from the latest database entry
INFO  [open_webui.env] 'IMAGE_GENERATION_ENGINE' loaded from the latest database entry
INFO  [open_webui.env] 'ENABLE_IMAGE_GENERATION' loaded from the latest database entry
INFO  [open_webui.env] 'IMAGES_OPENAI_API_BASE_URL' loaded from the latest database entry
INFO  [open_webui.env] 'IMAGES_OPENAI_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'IMAGE_SIZE' loaded from the latest database entry
INFO  [open_webui.env] 'IMAGE_STEPS' loaded from the latest database entry
INFO  [open_webui.env] 'IMAGE_GENERATION_MODEL' loaded from the latest database entry
INFO  [open_webui.apps.audio.main] whisper_device_type: cpu
WARNI [chromadb.db.impl.sqlite] ⚠️ It looks like you upgraded from a version below 0.6 and could benefit from vacuuming your database. Run chromadb utils vacuum --help for more information.
WARNI [langchain_community.utils.user_agent] USER_AGENT environment variable not set, consider setting it to identify your requests.
INFO:     Started server process [1]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
INFO  [open_webui.apps.openai.main] get_all_models()
INFO  [open_webui.apps.ollama.main] get_all_models()
ERROR [open_webui.apps.ollama.main] Connection error: Cannot connect to host host.docker.internal:11434 ssl:default [Connect call failed ('192.168.5.2', 11434)]

  ___                    __        __   _     _   _ ___
 / _ \ _ __   ___ _ __   \ \      / /__| |__ | | | |_ _|
| | | | '_ \ / _ \ '_ \   \ \ /\ / / _ \ '_ \| | | || |
| |_| | |_) |  __/ | | |   \ V  V /  __/ |_) | |_| || |
 \___/| .__/ \___|_| |_|    \_/\_/ \___|_.__/ \___/|___|
      |_|


v0.3.35 - building the best open-source AI user interface.

https://github.com/open-webui/open-webui

Screenshots/Screen Recordings (if applicable): n/a

Additional Information

It looks like chromadb's provided utility just performs a VACUUM (see this changeset).

Originally created by @ivy on GitHub (Nov 13, 2024). # Bug Report Thanks for making Open WebUI! 🙌💜 I'm not sure if this classifies as a bug or a feature request. Details to follow… ## Installation Method <details><summary>Docker image (details within)</summary> ```json [ { "Id": "sha256:9f81d42888e3246e44c568d5e638a7e985bd6f866a9bc24be4ff80b06d2ca668", "RepoTags": [ "ghcr.io/open-webui/open-webui:main" ], "RepoDigests": [ "ghcr.io/open-webui/open-webui@sha256:f9b59ec6872d19d38d650debe3656e8e81e29e19275827330500965d7b2739d6" ], "Parent": "", "Comment": "buildkit.dockerfile.v0", "Created": "2024-11-10T02:07:51.354921458Z", "DockerVersion": "", "Author": "", "Config": { "Hostname": "", "Domainname": "", "User": "0:0", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "ExposedPorts": { "8080/tcp": {} }, "Tty": false, "OpenStdin": false, "StdinOnce": false, "Env": [ "PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin", "LANG=C.UTF-8", "GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D", "PYTHON_VERSION=3.11.10", "PYTHON_SHA256=07a4356e912900e61a15cb0949a06c4a05012e213ecd6b4e84d0f67aabbee372", "ENV=prod", "PORT=8080", "USE_OLLAMA_DOCKER=false", "USE_CUDA_DOCKER=false", "USE_CUDA_DOCKER_VER=cu121", "USE_EMBEDDING_MODEL_DOCKER=sentence-transformers/all-MiniLM-L6-v2", "USE_RERANKING_MODEL_DOCKER=", "OLLAMA_BASE_URL=/ollama", "OPENAI_API_BASE_URL=", "OPENAI_API_KEY=", "WEBUI_SECRET_KEY=", "SCARF_NO_ANALYTICS=true", "DO_NOT_TRACK=true", "ANONYMIZED_TELEMETRY=false", "WHISPER_MODEL=base", "WHISPER_MODEL_DIR=/app/backend/data/cache/whisper/models", "RAG_EMBEDDING_MODEL=sentence-transformers/all-MiniLM-L6-v2", "RAG_RERANKING_MODEL=", "SENTENCE_TRANSFORMERS_HOME=/app/backend/data/cache/embedding/models", "TIKTOKEN_ENCODING_NAME=cl100k_base", "TIKTOKEN_CACHE_DIR=/app/backend/data/cache/tiktoken", "HF_HOME=/app/backend/data/cache/embedding/models", "HOME=/root", "WEBUI_BUILD_VERSION=96c865404d36637eafadb6d2dd2365c85d452648", "DOCKER=true" ], "Cmd": [ "bash", "start.sh" ], "Healthcheck": { "Test": [ "CMD-SHELL", "curl --silent --fail http://localhost:${PORT:-8080}/health | jq -ne 'input.status == true' || exit 1" ] }, "ArgsEscaped": true, "Image": "", "Volumes": null, "WorkingDir": "/app/backend", "Entrypoint": null, "OnBuild": null, "Labels": { "org.opencontainers.image.created": "2024-11-10T02:01:47.409Z", "org.opencontainers.image.description": "User-friendly AI Interface (Supports Ollama, OpenAI API, ...)", "org.opencontainers.image.licenses": "MIT", "org.opencontainers.image.revision": "96c865404d36637eafadb6d2dd2365c85d452648", "org.opencontainers.image.source": "https://github.com/open-webui/open-webui", "org.opencontainers.image.title": "open-webui", "org.opencontainers.image.url": "https://github.com/open-webui/open-webui", "org.opencontainers.image.version": "main" } }, "Architecture": "arm64", "Os": "linux", "Size": 3680538255, "GraphDriver": { "Data": { "LowerDir": "/var/lib/docker/overlay2/486e45297c946e61b75e1f16c24e7f0cf7af67033131fbd8036ed28ecac674b5/diff:/var/lib/docker/overlay2/4a8d4ef6818f0a077ffba812f76a275e9bf6e3c735973323278316ce1119fa8c/diff:/var/lib/docker/overlay2/6b84580a48a5bd2e8024f90a93e3b76e1bba2597d238c9c0d604539fd8ce6978/diff:/var/lib/docker/overlay2/87edd5023cdc38e6f08bb9493f09182a86870d5e4851fea0414569c6c4f1ddc7/diff:/var/lib/docker/overlay2/dc3a122c2612683c4cb13b14e750178dc120625fd86b9d6efef51d15764d6c38/diff:/var/lib/docker/overlay2/84a39d5110cb6ffd4fda3680f77ae647fed3260f2e231c721d7be3e733d3ffc3/diff:/var/lib/docker/overlay2/822ad4792fc9955d3a8f8ca8a8dff83be2855b001ee0083b7b17d937f8bd10a7/diff:/var/lib/docker/overlay2/7f747f4c0b323cf47ad5d15b5432a3ab9d203cc6df80be1eacc628143ae53a65/diff:/var/lib/docker/overlay2/5c9edcc0af2b3a2446e86849f4fcc39eb4484230e932bb82571bc7fd3737570d/diff:/var/lib/docker/overlay2/4c70196bbf2b5698f7c0f34c0c3719e23c3cef8487926e0e3da703afa0c5b4a9/diff:/var/lib/docker/overlay2/8e3b19d4fa22375d0cb81b6045ad39dcb409d225cb38af92f1954b9159e50b9a/diff:/var/lib/docker/overlay2/fd8bd8b5fc79505654e78029eacc4300c03f1e71d1905c93e44f585461ea11b9/diff:/var/lib/docker/overlay2/458a91be28a193f994b695d46606d1c1fd14437f88a68cedee222164d043fe21/diff:/var/lib/docker/overlay2/9d7a259786a38ff2fd1917660551b72407bef300715ba8fadf174c3e77d4336f/diff:/var/lib/docker/overlay2/8a9ea0475571a7686d535ad1c44dc03d3847e81bbdf4da7f85ae26042dfa1fed/diff", "MergedDir": "/var/lib/docker/overlay2/8f442d502f8b8b9799383115e55c72ad045aeb7f2cd4e66af6a1b472a0ef2eb4/merged", "UpperDir": "/var/lib/docker/overlay2/8f442d502f8b8b9799383115e55c72ad045aeb7f2cd4e66af6a1b472a0ef2eb4/diff", "WorkDir": "/var/lib/docker/overlay2/8f442d502f8b8b9799383115e55c72ad045aeb7f2cd4e66af6a1b472a0ef2eb4/work" }, "Name": "overlay2" }, "RootFS": { "Type": "layers", "Layers": [ "sha256:f0f039847c0897e41273775d599cc761049c809342ff8362efb4caf561186ada", "sha256:c6fe574d28cee88986e7a83cd3aa90cf971e618ce75dc5ef30fbeaaf74ab10b8", "sha256:d37582ba90d59a93322a22baf56a21e074dcf0fdf641f12c7af4ba76e156b0c6", "sha256:069dda5e673b37b18c361c6b5938bfdd9cf1f979d3a87cbe4a7bd501ca570119", "sha256:10141a24bd842d8d97b7b355fe4527294c903dc0a3340d095c40765bf521dfd5", "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef", "sha256:0b3f016125e32708ac9f979bf0e62db26b699bc5a7b76ef3e8ec7e53a8ec7aab", "sha256:2ee6958913ee79a8df0e1112adb8e999c2b85dfba3cb7bac00064124f77d3524", "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef", "sha256:8605fab1816c120ee049c7b8dd1285a2603c07a3be15c72981149595fa707517", "sha256:fc593493f49a1ed57afbea55ddc426a992563acd2795654e7d04c7e6486668d0", "sha256:2dd286073ed4454f85a80ec9c152c07a8f2f16bc294be8692e8cf39f877721bf", "sha256:099c47ecbeef18b3b250dceb1265affd4a8d2dc16eb4254fa0a0d2cf7f3326cb", "sha256:33f89fed9395d2ce9c7f0ff93cdb5fb7948f6e18c213dc70799b7b5607fa8db8", "sha256:6c51df98b12fe430778dc4de32490cb24d882b338693c54c63c997a446a500bb", "sha256:a89350848ec8982fd2a7ef9e9c2a5c06bd8163dc22924d6489d54a13403e10d7" ] }, "Metadata": { "LastTagTime": "0001-01-01T00:00:00Z" } } ] ``` </details> ## Environment - **Open WebUI Version:** v0.3.35 - **Ollama (if applicable):** n/a - **Operating System:** macOS Sonoma 14.6.1 (23G93) - **Browser (if applicable):** n/a **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [x] I am on the latest version of both Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below. ## Expected Behavior: I think Open WebUI should either: - Package executable utilities like `chromadb` with its Docker image so users can perform maintenance tasks; or - Open WebUI should perform database maintenance on its own when required (maybe there's a config setting in chromadb to support this?). ## Actual Behavior: Chromadb logs a message: ``` WARNI [chromadb.db.impl.sqlite] ⚠️ It looks like you upgraded from a version below 0.6 and could benefit from vacuuming your database. Run chromadb utils vacuum --help for more information. ``` I'm not sure what changes were made in chromadb to prompt this and unfortunately, `chromadb` isn't an executable on my `$PATH` within the distributed Docker image: ``` docker exec <open-webui container ID> /bin/bash root@cf06ca28c6a1:/app/backend# chromadb utils vacuum --help bash: chromadb: command not found root@cf06ca28c6a1:/app/backend# find / -type f -name chromadb -executable [no output -- nothing found] ``` ## Description **Bug Summary:** Changes to chromadb are recommending running `chromadb utils vacuum` but this utility isn't available in the Docker image. Additionally, I'm wondering if Open WebUI should do this on its own (through a config setting or calling applicable methods). ## Reproduction Details **Steps to Reproduce:** I believe the steps to reproduce are to run a copy of Open WebUI with an earlier release of chromadb (create some data) then upgrade to the latest version (and dependencies). Subsequent startups will result in this log message. ## Logs and Screenshots **Browser Console Logs:** n/a <details><summary>Docker Container Logs (expand to view)</summary> ``` Loading WEBUI_SECRET_KEY from file, not provided as an environment variable. Generating WEBUI_SECRET_KEY Loading WEBUI_SECRET_KEY from .webui_secret_key /app/backend/open_webui /app/backend /app Running migrations INFO [alembic.runtime.migration] Context impl SQLiteImpl. INFO [alembic.runtime.migration] Will assume non-transactional DDL. WARNI [open_webui.env] WARNING: CORS_ALLOW_ORIGIN IS SET TO '*' - NOT RECOMMENDED FOR PRODUCTION DEPLOYMENTS. INFO [open_webui.env] 'CONTENT_EXTRACTION_ENGINE' loaded from the latest database entry INFO [open_webui.env] 'TIKA_SERVER_URL' loaded from the latest database entry INFO [open_webui.env] 'RAG_TOP_K' loaded from the latest database entry INFO [open_webui.env] 'RAG_RELEVANCE_THRESHOLD' loaded from the latest database entry INFO [open_webui.env] 'ENABLE_RAG_HYBRID_SEARCH' loaded from the latest database entry INFO [open_webui.env] 'RAG_EMBEDDING_ENGINE' loaded from the latest database entry INFO [open_webui.env] 'PDF_EXTRACT_IMAGES' loaded from the latest database entry INFO [open_webui.env] 'RAG_EMBEDDING_MODEL' loaded from the latest database entry INFO [open_webui.env] Embedding model set: sentence-transformers/all-MiniLM-L6-v2 INFO [open_webui.env] 'CHUNK_SIZE' loaded from the latest database entry INFO [open_webui.env] 'CHUNK_OVERLAP' loaded from the latest database entry INFO [open_webui.env] 'RAG_TEMPLATE' loaded from the latest database entry INFO [open_webui.env] 'YOUTUBE_LOADER_LANGUAGE' loaded from the latest database entry INFO [open_webui.env] 'ENABLE_RAG_WEB_SEARCH' loaded from the latest database entry INFO [open_webui.env] 'RAG_WEB_SEARCH_ENGINE' loaded from the latest database entry INFO [open_webui.env] 'SEARXNG_QUERY_URL' loaded from the latest database entry INFO [open_webui.env] 'GOOGLE_PSE_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'GOOGLE_PSE_ENGINE_ID' loaded from the latest database entry INFO [open_webui.env] 'BRAVE_SEARCH_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'SERPSTACK_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'SERPSTACK_HTTPS' loaded from the latest database entry INFO [open_webui.env] 'SERPER_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'SERPLY_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'TAVILY_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'RAG_WEB_SEARCH_RESULT_COUNT' loaded from the latest database entry INFO [open_webui.env] 'RAG_WEB_SEARCH_CONCURRENT_REQUESTS' loaded from the latest database entry INFO [open_webui.env] 'IMAGE_GENERATION_ENGINE' loaded from the latest database entry INFO [open_webui.env] 'ENABLE_IMAGE_GENERATION' loaded from the latest database entry INFO [open_webui.env] 'IMAGES_OPENAI_API_BASE_URL' loaded from the latest database entry INFO [open_webui.env] 'IMAGES_OPENAI_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'IMAGE_SIZE' loaded from the latest database entry INFO [open_webui.env] 'IMAGE_STEPS' loaded from the latest database entry INFO [open_webui.env] 'IMAGE_GENERATION_MODEL' loaded from the latest database entry INFO [open_webui.apps.audio.main] whisper_device_type: cpu WARNI [chromadb.db.impl.sqlite] ⚠️ It looks like you upgraded from a version below 0.6 and could benefit from vacuuming your database. Run chromadb utils vacuum --help for more information. WARNI [langchain_community.utils.user_agent] USER_AGENT environment variable not set, consider setting it to identify your requests. INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit) INFO [open_webui.apps.openai.main] get_all_models() INFO [open_webui.apps.ollama.main] get_all_models() ERROR [open_webui.apps.ollama.main] Connection error: Cannot connect to host host.docker.internal:11434 ssl:default [Connect call failed ('192.168.5.2', 11434)] ___ __ __ _ _ _ ___ / _ \ _ __ ___ _ __ \ \ / /__| |__ | | | |_ _| | | | | '_ \ / _ \ '_ \ \ \ /\ / / _ \ '_ \| | | || | | |_| | |_) | __/ | | | \ V V / __/ |_) | |_| || | \___/| .__/ \___|_| |_| \_/\_/ \___|_.__/ \___/|___| |_| v0.3.35 - building the best open-source AI user interface. https://github.com/open-webui/open-webui ``` </details> **Screenshots/Screen Recordings (if applicable):** n/a ## Additional Information It looks like chromadb's provided utility just performs a `VACUUM` (see [this changeset](https://github.com/chroma-core/chroma/commit/ea3ec083231621a919c94670730379e23abac4f8#diff-7750d4d797ef6cffa62cff21e9fce1ccd1706704665e93bdc10ced236d3ff249R263-R273)).
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#2645
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?