mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-16 06:03:26 -05:00
[GH-ISSUE #8973] The chat completion chunk object doesn't follow OpenAI spec #15340
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Shadowfita on GitHub (Jan 27, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/8973
Bug Report
Installation Method
Docker
Environment
Open WebUI Version: v0.5.4
Ollama (if applicable): v0.5.7
Operating System: Windows 11
Confirmation:
Expected Behavior:
When streaming LLM responses, the chat completion chunk object must always have a delta object (empty, not undefined).
OpenAI API chat completion chunk object reference
Actual Behavior:
Streamed responses have the delta object until sending the last chat completion chunk, which does not have the delta object.
Description
Bug Summary:
Does not implement the OpenAI API spec.
Reproduction Details
Steps to Reproduce:
Use any LLM tool that uses the delta object and expects it to always be present. (Elevenlabs conversational AI, for example).
Logs and Screenshots
Screenshots/Screen Recordings (if applicable):
@Shadowfita commented on GitHub (Jan 28, 2025):
Fix PR has been merged. Closing for now.