Groq function allows openwebui to become unresposive #3009

Closed
opened 2025-11-11 15:19:35 -06:00 by GiteaMirror · 0 comments
Owner

Originally created by @will-x86 on GitHub (Dec 13, 2024).

Bug Report

Installation Method

version: '3'
services:
  openwebui:
    image: ghcr.io/open-webui/open-webui:main
    volumes:
      - open-webui:/app/backend/data
    restart: always
    environment:
      - GLOBAL_LOG_LEVEL="DEBUG" # Tried without this :) 
    network_mode: "host" # Tried without this enabled and port 3000:8080 ( I think it's 8080 ) 

volumes:
  open-webui:

Two "functions" installed:
Both of these functions have valid and topped up API keys

https://openwebui.com/f/justinrahb/anthropic - v0.2.4 
https://openwebui.com/f/olof/groq - v1.1.0

Environment

  • Open WebUI Version: [e.g., v0.3.11]
USER@HOSTNAME:~/openwebui$ docker exec -it openwebui-openwebui-1 grep -E '"name"|"version"' /app/package.json
	"name": "open-webui",
	"version": "0.4.8",
  • Ollama (if applicable): [e.g., v0.2.0, v0.1.32-rc1]

  • Disabled as I thought this might be the issue

  • Operating System: [e.g., Windows 10, macOS Big Sur, Ubuntu 20.04]

OS: Ubuntu noble 24.04 x86_64 ( Server OS, accessing on NixOS 22.05 with WayLand ? ) 
  • Browser (if applicable): [e.g., Chrome 100.0, Firefox 98.0]
❯ firefox --version
Mozilla Firefox 132.0.1

Confirmation:

  • [X ] I have read and followed all the instructions provided in the README.md.
  • [X ] I am on the latest version of both Open WebUI and Ollama.
  • [X ] I have included the browser console logs.
  • [X ] I have included the Docker container logs.
  • [X ] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.

Expected Behavior:

I send some chats and I get replies

Actual Behavior:

After a few chats ( ignoring anthropotic timing out, this happened before that and I believe it's unrelated ) the container becomes unresponsive.

The system is using 14% CPU, has 30GB of available ram, and is not IO bottlenecked ( Nvme drive etc )

Description

Bug Summary:
Container becomes unresponsive after a few messages, requires restart then continues to happen.

Reproduction Details

Steps to Reproduce:

Install two functions as above, then send some messages and it becomes unresponsive

Logs and Screenshots

Browser Console Logs:

Navigated to http://192.168.0.43:8080/
Removing unpermitted intrinsics [lockdown-install.js:1:52832](moz-extension://eada2936-e2ab-4dba-838a-48230858a511/scripts/lockdown-install.js)
Anti-anti-debug loaded! Happy debugging! [anti-anti-debug.js:2:13](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Failed to fetch moz-extension://8dc2f910-80bd-4eb0-a413-27201000c25f/inline/injected.js, Import failed 3 times. Final error: crypto.randomUUID is not a function [inject-content-scripts.js:5:897](moz-extension://8dc2f910-80bd-4eb0-a413-27201000c25f/inline/inject-content-scripts.js)
Backend config: 
Object { status: true, name: "Open WebUI", version: "0.4.8", default_locale: "", oauth: {…}, features: {…} }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
connected WVC3hY2E7m2net_UAAAB [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Password fields present on an insecure (http://) page. This is a security risk that allows user login credentials to be stolen.
[auth](http://192.168.0.43:8080/auth)
Layout was forced before the page was fully loaded. If stylesheets are not yet loaded this may cause a flash of unstyled content. [markup.js:250:53](resource://devtools/server/actors/highlighters/utils/markup.js)
GET
https://c.1password.com/richicons/images/login/120/192.168.0.43.png
[HTTP/2 404  1615ms]

Object { id: "UUID", email: "EMAIL", name: "NAME", role: "admin", profile_image_url: "data:image/BASE64 OF PFP", token: "JWT HERE ", token_type: "Bearer", expires_at: null, permissions: {…} }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
user-count 
Object { count: 1 }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
mounted [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
<empty string> [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
size 0 25 [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
[tiptap warn]: Duplicate extension names found: ['codeBlock']. This can lead to issues. [RichTextInput.CDBVcxlG.js:113:4917](http://192.168.0.43:8080/_app/immutable/chunks/RichTextInput.CDBVcxlG.js)
submitPrompt Test error ! <empty string> [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
destroy [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
<empty string> [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
saveSessionSelectedModels 
Array [ "anthropic.claude-3-5-haiku-latest" ]
 ["anthropic.claude-3-5-haiku-latest"] [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
[tiptap warn]: Duplicate extension names found: ['codeBlock']. This can lead to issues. [RichTextInput.CDBVcxlG.js:113:4917](http://192.168.0.43:8080/_app/immutable/chunks/RichTextInput.CDBVcxlG.js)
modelId anthropic.claude-3-5-haiku-latest [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-5ee81911-57b3-4f2d-b267-c9df8e06ea55", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-61a1186f-64ef-4253-9629-796cbc070a25", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-f0076e98-28b3-4401-a384-17e82cb58061", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-9e81b797-1b14-441c-a411-a696e4490e37", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-343b0663-7f3c-4ca4-8d99-4cb024b58cb2", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-d0826fab-d5dd-4eba-91d5-2a69844b9ec8", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-90135008-ea79-47f9-b3df-2f2cabf29315", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-e33e38eb-b32f-497b-9ca2-d9760b180f15", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-cfb4022c-c1bc-4fb0-aca9-0e0208dc0715", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-21333eb2-ac97-4d4e-8a30-e6efd1cdd409", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-89b64816-49a8-4abd-8acb-ef12c4277836", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-74f96c5e-4057-4612-b486-a91e95c2e06b", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-d8195ac5-fc5b-4a96-9ad0-6fd55d155ff9", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-26b756cb-0693-46fb-8dee-c731b067e60e", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-1c7f90ba-a3d6-487a-a581-8ce17450c97b", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-fc1850ee-84ce-4c33-8f6f-e6f4dcdf95fb", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-347ed4f9-16a1-4016-98a0-908370f5c94f", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-5b613a4b-8d26-4ca6-8067-18181dc1d7a6", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-58a1de6e-cdda-4a51-83c0-0ddeb56ff885", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-3d8464ee-b1ca-4518-bf26-b801e7231b77", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-3e9860a5-56a8-4e68-937f-32e5102158bb", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-0a99b3e9-a290-458d-bce8-cb71824992cf", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-73bce779-da66-4826-b3d2-a2fb65e47feb", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-3b33a9e9-e120-4e28-a207-2ea51d7fbe0f", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-89fe7fe4-b999-4e3d-ac20-b614ea81b345", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-bc0de80f-40b0-4128-ade6-1daca65c769a", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-5a478643-6be1-461f-a568-71a06b995f57", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-b941dae1-0b51-444c-a89d-0765f4417495", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-5ec7e98b-b59b-400f-b20a-9ccb2e1eb161", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-ec22f781-b013-4584-a3fa-eaf69eab7f17", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-05392d33-47ec-4c56-986a-6582fe77bd9a", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-dc8d1de8-4e66-40b7-ae4d-36f965c7149a", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-b3d5b7c1-06a6-4a62-b32e-11db046afbbd", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-5ba30451-fe6e-4d59-9113-78ba314d4afc", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-306eba73-dda3-4917-b3d7-207d4e923f22", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-8356d0ae-2c6e-49ea-8a75-8c24156d8577", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-b492e328-2fb2-421f-a5ba-ba8a25695337", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-baa7d4ca-a51f-4628-b0e3-953452f1ce65", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-35aaeacf-e392-4efc-9dc3-7ba5904215ee", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-12d209d3-6a45-446f-a227-2d10e01698fb", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-ab05a1e9-9840-467a-be50-2c185c9bb71a", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-34ec2028-986a-44de-9689-bf5adc372472", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-249e2f90-8bd2-4c90-8083-9140e0e1b1c2", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-82aabf74-6ef6-4b2a-ba4b-b32c82e9d682", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-d55e4107-0464-4fc3-a384-00aaa3692fb4", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
Object { id: "anthropic.claude-3-5-haiku-latest-18663da2-145e-4023-be51-6b8dd39e8766", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: [] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)
usage 
Object { models: (1) […] }
[anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js)

Docker Container Logs:

INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
INFO  [open_webui.env] 'ENABLE_OLLAMA_API' loaded from the latest database entry
INFO  [open_webui.env] 'OLLAMA_BASE_URLS' loaded from the latest database entry
INFO  [open_webui.env] 'OLLAMA_API_CONFIGS' loaded from the latest database entry
INFO  [open_webui.env] 'ENABLE_OPENAI_API' loaded from the latest database entry
INFO  [open_webui.env] 'OPENAI_API_KEYS' loaded from the latest database entry
INFO  [open_webui.env] 'OPENAI_API_BASE_URLS' loaded from the latest database entry
INFO  [open_webui.env] 'OPENAI_API_CONFIGS' loaded from the latest database entry
INFO  [open_webui.env] 'ENABLE_SIGNUP' loaded from the latest database entry
INFO  [open_webui.env] 'DEFAULT_LOCALE' loaded from the latest database entry
INFO  [open_webui.env] 'DEFAULT_PROMPT_SUGGESTIONS' loaded from the latest database entry
INFO  [open_webui.env] 'USER_PERMISSIONS' loaded from the latest database entry
WARNI [open_webui.env]

WARNING: CORS_ALLOW_ORIGIN IS SET TO '*' - NOT RECOMMENDED FOR PRODUCTION DEPLOYMENTS.

INFO  [open_webui.env] 'ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION' loaded from the latest database entry
INFO  [open_webui.env] 'PDF_EXTRACT_IMAGES' loaded from the latest database entry
INFO  [open_webui.env] Embedding model set: sentence-transformers/all-MiniLM-L6-v2
INFO  [open_webui.env] 'YOUTUBE_LOADER_LANGUAGE' loaded from the latest database entry
INFO  [open_webui.env] 'YOUTUBE_LOADER_PROXY_URL' loaded from the latest database entry
INFO  [open_webui.env] 'ENABLE_RAG_WEB_SEARCH' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_WEB_SEARCH_ENGINE' loaded from the latest database entry
INFO  [open_webui.env] 'SEARXNG_QUERY_URL' loaded from the latest database entry
INFO  [open_webui.env] 'GOOGLE_PSE_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'GOOGLE_PSE_ENGINE_ID' loaded from the latest database entry
INFO  [open_webui.env] 'BRAVE_SEARCH_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'MOJEEK_SEARCH_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'SERPSTACK_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'SERPSTACK_HTTPS' loaded from the latest database entry
INFO  [open_webui.env] 'SERPER_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'SERPLY_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'TAVILY_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'JINA_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'SEARCHAPI_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'BING_SEARCH_V7_ENDPOINT' loaded from the latest database entry
INFO  [open_webui.env] 'BING_SEARCH_V7_SUBSCRIPTION_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_WEB_SEARCH_RESULT_COUNT' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_WEB_SEARCH_CONCURRENT_REQUESTS' loaded from the latest database entry
INFO  [open_webui.apps.audio.main] whisper_device_type: cpu
WARNI [langchain_community.utils.user_agent] USER_AGENT environment variable not set, consider setting it to identify your requests.
Fetching 30 files: 100%|██████████| 30/30 [00:00<00:00, 10062.30it/s]
INFO:     Started server process [1]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
INFO:     Shutting down
INFO:     Waiting for application shutdown.
INFO:     Application shutdown complete.
INFO:     Finished server process [1]
INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
INFO  [open_webui.env] 'ENABLE_OLLAMA_API' loaded from the latest database entry
INFO  [open_webui.env] 'OLLAMA_BASE_URLS' loaded from the latest database entry
INFO  [open_webui.env] 'OLLAMA_API_CONFIGS' loaded from the latest database entry
INFO  [open_webui.env] 'ENABLE_OPENAI_API' loaded from the latest database entry
INFO  [open_webui.env] 'OPENAI_API_KEYS' loaded from the latest database entry
INFO  [open_webui.env] 'OPENAI_API_BASE_URLS' loaded from the latest database entry
INFO  [open_webui.env] 'OPENAI_API_CONFIGS' loaded from the latest database entry
INFO  [open_webui.env] 'ENABLE_SIGNUP' loaded from the latest database entry
INFO  [open_webui.env] 'DEFAULT_LOCALE' loaded from the latest database entry
INFO  [open_webui.env] 'DEFAULT_PROMPT_SUGGESTIONS' loaded from the latest database entry
INFO  [open_webui.env] 'USER_PERMISSIONS' loaded from the latest database entry
WARNI [open_webui.env]

WARNING: CORS_ALLOW_ORIGIN IS SET TO '*' - NOT RECOMMENDED FOR PRODUCTION DEPLOYMENTS.

INFO  [open_webui.env] 'ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION' loaded from the latest database entry
INFO  [open_webui.env] 'PDF_EXTRACT_IMAGES' loaded from the latest database entry
INFO  [open_webui.env] Embedding model set: sentence-transformers/all-MiniLM-L6-v2
INFO  [open_webui.env] 'YOUTUBE_LOADER_LANGUAGE' loaded from the latest database entry
INFO  [open_webui.env] 'YOUTUBE_LOADER_PROXY_URL' loaded from the latest database entry
INFO  [open_webui.env] 'ENABLE_RAG_WEB_SEARCH' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_WEB_SEARCH_ENGINE' loaded from the latest database entry
INFO  [open_webui.env] 'SEARXNG_QUERY_URL' loaded from the latest database entry
INFO  [open_webui.env] 'GOOGLE_PSE_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'GOOGLE_PSE_ENGINE_ID' loaded from the latest database entry
INFO  [open_webui.env] 'BRAVE_SEARCH_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'MOJEEK_SEARCH_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'SERPSTACK_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'SERPSTACK_HTTPS' loaded from the latest database entry
INFO  [open_webui.env] 'SERPER_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'SERPLY_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'TAVILY_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'JINA_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'SEARCHAPI_API_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'BING_SEARCH_V7_ENDPOINT' loaded from the latest database entry
INFO  [open_webui.env] 'BING_SEARCH_V7_SUBSCRIPTION_KEY' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_WEB_SEARCH_RESULT_COUNT' loaded from the latest database entry
INFO  [open_webui.env] 'RAG_WEB_SEARCH_CONCURRENT_REQUESTS' loaded from the latest database entry
INFO  [open_webui.apps.audio.main] whisper_device_type: cpu
WARNI [langchain_community.utils.user_agent] USER_AGENT environment variable not set, consider setting it to identify your requests.
Fetching 30 files: 100%|██████████| 30/30 [00:00<00:00, 28636.58it/s]
INFO:     Started server process [1]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
INFO:     ('192.168.0.50', 56148) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=Z07UVgpDCTLrnEqeAAAA" [accepted]
INFO:     connection open
INFO  [open_webui.apps.webui.models.auths] authenticate_user: EMAIL HERE
INFO  [open_webui.apps.webui.utils] Loaded module: function_anthropic
INFO  [open_webui.apps.webui.utils] Loaded module: function_groq

Screenshots/Screen Recordings (if applicable):
image

Additional Information

This bug appears to dissapear when disabling the "Groq" function

The groq function was working okay before and does work for 1/2 messages

Originally created by @will-x86 on GitHub (Dec 13, 2024). # Bug Report ## Installation Method ```yml version: '3' services: openwebui: image: ghcr.io/open-webui/open-webui:main volumes: - open-webui:/app/backend/data restart: always environment: - GLOBAL_LOG_LEVEL="DEBUG" # Tried without this :) network_mode: "host" # Tried without this enabled and port 3000:8080 ( I think it's 8080 ) volumes: open-webui: ``` Two "functions" installed: Both of these functions have valid and topped up API keys ``` https://openwebui.com/f/justinrahb/anthropic - v0.2.4 https://openwebui.com/f/olof/groq - v1.1.0 ``` ## Environment - **Open WebUI Version:** [e.g., v0.3.11] ``` USER@HOSTNAME:~/openwebui$ docker exec -it openwebui-openwebui-1 grep -E '"name"|"version"' /app/package.json "name": "open-webui", "version": "0.4.8", ``` - **Ollama (if applicable):** [e.g., v0.2.0, v0.1.32-rc1] - Disabled as I thought this might be the issue - **Operating System:** [e.g., Windows 10, macOS Big Sur, Ubuntu 20.04] ``` OS: Ubuntu noble 24.04 x86_64 ( Server OS, accessing on NixOS 22.05 with WayLand ? ) ``` - **Browser (if applicable):** [e.g., Chrome 100.0, Firefox 98.0] ``` ❯ firefox --version Mozilla Firefox 132.0.1 ``` **Confirmation:** - [X ] I have read and followed all the instructions provided in the README.md. - [X ] I am on the latest version of both Open WebUI and Ollama. - [X ] I have included the browser console logs. - [X ] I have included the Docker container logs. - [X ] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below. ## Expected Behavior: I send some chats and I get replies ## Actual Behavior: After a few chats ( ignoring anthropotic timing out, this happened before that and I believe it's unrelated ) the container becomes unresponsive. The system is using 14% CPU, has 30GB of available ram, and is not IO bottlenecked ( Nvme drive etc ) ## Description **Bug Summary:** Container becomes unresponsive after a few messages, requires restart then continues to happen. ## Reproduction Details **Steps to Reproduce:** Install two functions as above, then send some messages and it becomes unresponsive ## Logs and Screenshots **Browser Console Logs:** ``` Navigated to http://192.168.0.43:8080/ Removing unpermitted intrinsics [lockdown-install.js:1:52832](moz-extension://eada2936-e2ab-4dba-838a-48230858a511/scripts/lockdown-install.js) Anti-anti-debug loaded! Happy debugging! [anti-anti-debug.js:2:13](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Failed to fetch moz-extension://8dc2f910-80bd-4eb0-a413-27201000c25f/inline/injected.js, Import failed 3 times. Final error: crypto.randomUUID is not a function [inject-content-scripts.js:5:897](moz-extension://8dc2f910-80bd-4eb0-a413-27201000c25f/inline/inject-content-scripts.js) Backend config: Object { status: true, name: "Open WebUI", version: "0.4.8", default_locale: "", oauth: {…}, features: {…} } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) connected WVC3hY2E7m2net_UAAAB [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Password fields present on an insecure (http://) page. This is a security risk that allows user login credentials to be stolen. [auth](http://192.168.0.43:8080/auth) Layout was forced before the page was fully loaded. If stylesheets are not yet loaded this may cause a flash of unstyled content. [markup.js:250:53](resource://devtools/server/actors/highlighters/utils/markup.js) GET https://c.1password.com/richicons/images/login/120/192.168.0.43.png [HTTP/2 404 1615ms] Object { id: "UUID", email: "EMAIL", name: "NAME", role: "admin", profile_image_url: "data:image/BASE64 OF PFP", token: "JWT HERE ", token_type: "Bearer", expires_at: null, permissions: {…} } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) user-count Object { count: 1 } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) mounted [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) <empty string> [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) size 0 25 [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) [tiptap warn]: Duplicate extension names found: ['codeBlock']. This can lead to issues. [RichTextInput.CDBVcxlG.js:113:4917](http://192.168.0.43:8080/_app/immutable/chunks/RichTextInput.CDBVcxlG.js) submitPrompt Test error ! <empty string> [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) destroy [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) <empty string> [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) saveSessionSelectedModels Array [ "anthropic.claude-3-5-haiku-latest" ] ["anthropic.claude-3-5-haiku-latest"] [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) [tiptap warn]: Duplicate extension names found: ['codeBlock']. This can lead to issues. [RichTextInput.CDBVcxlG.js:113:4917](http://192.168.0.43:8080/_app/immutable/chunks/RichTextInput.CDBVcxlG.js) modelId anthropic.claude-3-5-haiku-latest [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-5ee81911-57b3-4f2d-b267-c9df8e06ea55", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-61a1186f-64ef-4253-9629-796cbc070a25", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-f0076e98-28b3-4401-a384-17e82cb58061", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-9e81b797-1b14-441c-a411-a696e4490e37", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-343b0663-7f3c-4ca4-8d99-4cb024b58cb2", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-d0826fab-d5dd-4eba-91d5-2a69844b9ec8", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-90135008-ea79-47f9-b3df-2f2cabf29315", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-e33e38eb-b32f-497b-9ca2-d9760b180f15", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-cfb4022c-c1bc-4fb0-aca9-0e0208dc0715", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-21333eb2-ac97-4d4e-8a30-e6efd1cdd409", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-89b64816-49a8-4abd-8acb-ef12c4277836", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-74f96c5e-4057-4612-b486-a91e95c2e06b", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-d8195ac5-fc5b-4a96-9ad0-6fd55d155ff9", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-26b756cb-0693-46fb-8dee-c731b067e60e", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-1c7f90ba-a3d6-487a-a581-8ce17450c97b", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-fc1850ee-84ce-4c33-8f6f-e6f4dcdf95fb", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-347ed4f9-16a1-4016-98a0-908370f5c94f", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-5b613a4b-8d26-4ca6-8067-18181dc1d7a6", created: 1734091384, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-58a1de6e-cdda-4a51-83c0-0ddeb56ff885", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-3d8464ee-b1ca-4518-bf26-b801e7231b77", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-3e9860a5-56a8-4e68-937f-32e5102158bb", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-0a99b3e9-a290-458d-bce8-cb71824992cf", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-73bce779-da66-4826-b3d2-a2fb65e47feb", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-3b33a9e9-e120-4e28-a207-2ea51d7fbe0f", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-89fe7fe4-b999-4e3d-ac20-b614ea81b345", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-bc0de80f-40b0-4128-ade6-1daca65c769a", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-5a478643-6be1-461f-a568-71a06b995f57", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-b941dae1-0b51-444c-a89d-0765f4417495", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-5ec7e98b-b59b-400f-b20a-9ccb2e1eb161", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-ec22f781-b013-4584-a3fa-eaf69eab7f17", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-05392d33-47ec-4c56-986a-6582fe77bd9a", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-dc8d1de8-4e66-40b7-ae4d-36f965c7149a", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-b3d5b7c1-06a6-4a62-b32e-11db046afbbd", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-5ba30451-fe6e-4d59-9113-78ba314d4afc", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-306eba73-dda3-4917-b3d7-207d4e923f22", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-8356d0ae-2c6e-49ea-8a75-8c24156d8577", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-b492e328-2fb2-421f-a5ba-ba8a25695337", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-baa7d4ca-a51f-4628-b0e3-953452f1ce65", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-35aaeacf-e392-4efc-9dc3-7ba5904215ee", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-12d209d3-6a45-446f-a227-2d10e01698fb", created: 1734091385, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-ab05a1e9-9840-467a-be50-2c185c9bb71a", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-34ec2028-986a-44de-9689-bf5adc372472", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-249e2f90-8bd2-4c90-8083-9140e0e1b1c2", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-82aabf74-6ef6-4b2a-ba4b-b32c82e9d682", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-d55e4107-0464-4fc3-a384-00aaa3692fb4", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) Object { id: "anthropic.claude-3-5-haiku-latest-18663da2-145e-4023-be51-6b8dd39e8766", created: 1734091386, model: "anthropic.claude-3-5-haiku-latest", choices: (1) […], object: "chat.completion.chunk" } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: [] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) usage Object { models: (1) […] } [anti-anti-debug.js:124:30](moz-extension://66c0cfd9-58ee-4db6-8842-661215227c6f/anti-anti-debug.js) ``` **Docker Container Logs:** ``` INFO [alembic.runtime.migration] Context impl SQLiteImpl. INFO [alembic.runtime.migration] Will assume non-transactional DDL. INFO [open_webui.env] 'ENABLE_OLLAMA_API' loaded from the latest database entry INFO [open_webui.env] 'OLLAMA_BASE_URLS' loaded from the latest database entry INFO [open_webui.env] 'OLLAMA_API_CONFIGS' loaded from the latest database entry INFO [open_webui.env] 'ENABLE_OPENAI_API' loaded from the latest database entry INFO [open_webui.env] 'OPENAI_API_KEYS' loaded from the latest database entry INFO [open_webui.env] 'OPENAI_API_BASE_URLS' loaded from the latest database entry INFO [open_webui.env] 'OPENAI_API_CONFIGS' loaded from the latest database entry INFO [open_webui.env] 'ENABLE_SIGNUP' loaded from the latest database entry INFO [open_webui.env] 'DEFAULT_LOCALE' loaded from the latest database entry INFO [open_webui.env] 'DEFAULT_PROMPT_SUGGESTIONS' loaded from the latest database entry INFO [open_webui.env] 'USER_PERMISSIONS' loaded from the latest database entry WARNI [open_webui.env] WARNING: CORS_ALLOW_ORIGIN IS SET TO '*' - NOT RECOMMENDED FOR PRODUCTION DEPLOYMENTS. INFO [open_webui.env] 'ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION' loaded from the latest database entry INFO [open_webui.env] 'PDF_EXTRACT_IMAGES' loaded from the latest database entry INFO [open_webui.env] Embedding model set: sentence-transformers/all-MiniLM-L6-v2 INFO [open_webui.env] 'YOUTUBE_LOADER_LANGUAGE' loaded from the latest database entry INFO [open_webui.env] 'YOUTUBE_LOADER_PROXY_URL' loaded from the latest database entry INFO [open_webui.env] 'ENABLE_RAG_WEB_SEARCH' loaded from the latest database entry INFO [open_webui.env] 'RAG_WEB_SEARCH_ENGINE' loaded from the latest database entry INFO [open_webui.env] 'SEARXNG_QUERY_URL' loaded from the latest database entry INFO [open_webui.env] 'GOOGLE_PSE_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'GOOGLE_PSE_ENGINE_ID' loaded from the latest database entry INFO [open_webui.env] 'BRAVE_SEARCH_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'MOJEEK_SEARCH_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'SERPSTACK_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'SERPSTACK_HTTPS' loaded from the latest database entry INFO [open_webui.env] 'SERPER_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'SERPLY_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'TAVILY_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'JINA_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'SEARCHAPI_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'BING_SEARCH_V7_ENDPOINT' loaded from the latest database entry INFO [open_webui.env] 'BING_SEARCH_V7_SUBSCRIPTION_KEY' loaded from the latest database entry INFO [open_webui.env] 'RAG_WEB_SEARCH_RESULT_COUNT' loaded from the latest database entry INFO [open_webui.env] 'RAG_WEB_SEARCH_CONCURRENT_REQUESTS' loaded from the latest database entry INFO [open_webui.apps.audio.main] whisper_device_type: cpu WARNI [langchain_community.utils.user_agent] USER_AGENT environment variable not set, consider setting it to identify your requests. Fetching 30 files: 100%|██████████| 30/30 [00:00<00:00, 10062.30it/s] INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit) INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1] INFO [alembic.runtime.migration] Context impl SQLiteImpl. INFO [alembic.runtime.migration] Will assume non-transactional DDL. INFO [open_webui.env] 'ENABLE_OLLAMA_API' loaded from the latest database entry INFO [open_webui.env] 'OLLAMA_BASE_URLS' loaded from the latest database entry INFO [open_webui.env] 'OLLAMA_API_CONFIGS' loaded from the latest database entry INFO [open_webui.env] 'ENABLE_OPENAI_API' loaded from the latest database entry INFO [open_webui.env] 'OPENAI_API_KEYS' loaded from the latest database entry INFO [open_webui.env] 'OPENAI_API_BASE_URLS' loaded from the latest database entry INFO [open_webui.env] 'OPENAI_API_CONFIGS' loaded from the latest database entry INFO [open_webui.env] 'ENABLE_SIGNUP' loaded from the latest database entry INFO [open_webui.env] 'DEFAULT_LOCALE' loaded from the latest database entry INFO [open_webui.env] 'DEFAULT_PROMPT_SUGGESTIONS' loaded from the latest database entry INFO [open_webui.env] 'USER_PERMISSIONS' loaded from the latest database entry WARNI [open_webui.env] WARNING: CORS_ALLOW_ORIGIN IS SET TO '*' - NOT RECOMMENDED FOR PRODUCTION DEPLOYMENTS. INFO [open_webui.env] 'ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION' loaded from the latest database entry INFO [open_webui.env] 'PDF_EXTRACT_IMAGES' loaded from the latest database entry INFO [open_webui.env] Embedding model set: sentence-transformers/all-MiniLM-L6-v2 INFO [open_webui.env] 'YOUTUBE_LOADER_LANGUAGE' loaded from the latest database entry INFO [open_webui.env] 'YOUTUBE_LOADER_PROXY_URL' loaded from the latest database entry INFO [open_webui.env] 'ENABLE_RAG_WEB_SEARCH' loaded from the latest database entry INFO [open_webui.env] 'RAG_WEB_SEARCH_ENGINE' loaded from the latest database entry INFO [open_webui.env] 'SEARXNG_QUERY_URL' loaded from the latest database entry INFO [open_webui.env] 'GOOGLE_PSE_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'GOOGLE_PSE_ENGINE_ID' loaded from the latest database entry INFO [open_webui.env] 'BRAVE_SEARCH_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'MOJEEK_SEARCH_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'SERPSTACK_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'SERPSTACK_HTTPS' loaded from the latest database entry INFO [open_webui.env] 'SERPER_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'SERPLY_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'TAVILY_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'JINA_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'SEARCHAPI_API_KEY' loaded from the latest database entry INFO [open_webui.env] 'BING_SEARCH_V7_ENDPOINT' loaded from the latest database entry INFO [open_webui.env] 'BING_SEARCH_V7_SUBSCRIPTION_KEY' loaded from the latest database entry INFO [open_webui.env] 'RAG_WEB_SEARCH_RESULT_COUNT' loaded from the latest database entry INFO [open_webui.env] 'RAG_WEB_SEARCH_CONCURRENT_REQUESTS' loaded from the latest database entry INFO [open_webui.apps.audio.main] whisper_device_type: cpu WARNI [langchain_community.utils.user_agent] USER_AGENT environment variable not set, consider setting it to identify your requests. Fetching 30 files: 100%|██████████| 30/30 [00:00<00:00, 28636.58it/s] INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit) INFO: ('192.168.0.50', 56148) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=Z07UVgpDCTLrnEqeAAAA" [accepted] INFO: connection open INFO [open_webui.apps.webui.models.auths] authenticate_user: EMAIL HERE INFO [open_webui.apps.webui.utils] Loaded module: function_anthropic INFO [open_webui.apps.webui.utils] Loaded module: function_groq ``` **Screenshots/Screen Recordings (if applicable):** ![image](https://github.com/user-attachments/assets/c5b71178-8a14-43ef-aebb-5852498bca5d) ## Additional Information This bug *appears* to dissapear when disabling the "Groq" function The groq function *was* working okay before and does work for 1/2 messages
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#3009