[GH-ISSUE #8973] The chat completion chunk object doesn't follow OpenAI spec #102334

Closed
opened 2026-05-17 23:42:20 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @Shadowfita on GitHub (Jan 27, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/8973

Bug Report

Installation Method

Docker

Environment

  • Open WebUI Version: v0.5.4

  • Ollama (if applicable): v0.5.7

  • Operating System: Windows 11

Confirmation:

  • I have read and followed all the instructions provided in the README.md.
  • I am on the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.

Expected Behavior:

When streaming LLM responses, the chat completion chunk object must always have a delta object (empty, not undefined).

OpenAI API chat completion chunk object reference

Actual Behavior:

Streamed responses have the delta object until sending the last chat completion chunk, which does not have the delta object.

Description

Bug Summary:
Does not implement the OpenAI API spec.

Reproduction Details

Steps to Reproduce:
Use any LLM tool that uses the delta object and expects it to always be present. (Elevenlabs conversational AI, for example).

Logs and Screenshots

Screenshots/Screen Recordings (if applicable):

Image

Originally created by @Shadowfita on GitHub (Jan 27, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/8973 # Bug Report ## Installation Method Docker ## Environment - **Open WebUI Version:** v0.5.4 - **Ollama (if applicable):** v0.5.7 - **Operating System:** Windows 11 **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [x] I am on the latest version of both Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below. ## Expected Behavior: When streaming LLM responses, the chat completion chunk object must always have a delta object (empty, not undefined). [OpenAI API chat completion chunk object reference](https://platform.openai.com/docs/api-reference/chat/streaming#chat/streaming) ## Actual Behavior: Streamed responses have the delta object until sending the last chat completion chunk, which does not have the delta object. ## Description **Bug Summary:** Does not implement the OpenAI API spec. ## Reproduction Details **Steps to Reproduce:** Use any LLM tool that uses the delta object and expects it to always be present. (Elevenlabs conversational AI, for example). ## Logs and Screenshots **Screenshots/Screen Recordings (if applicable):** ![Image](https://github.com/user-attachments/assets/d68f2727-41b1-4a89-8171-4e8e488b4e07)
Author
Owner

@Shadowfita commented on GitHub (Jan 28, 2025):

Fix PR has been merged. Closing for now.

<!-- gh-comment-id:2617722691 --> @Shadowfita commented on GitHub (Jan 28, 2025): Fix PR has been merged. Closing for now.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#102334