Code interpreter doesn't work if the upstream model streams <code_interpreter>...</code_interpreter> into a single chunk #3797

New Issue

Closed

opened 2025-11-11 15:39:58 -06:00 by GiteaMirror · 4 comments

GiteaMirror commented 2025-11-11 15:39:58 -06:00

Owner

Copy Link

Copy Source

Originally created by @xmcp on GitHub (Feb 13, 2025).

Bug Report

Installation Method

docker

Environment

• Open WebUI Version: v0.5.11

• Ollama (if applicable): N/A

• Operating System: Ubuntu 24.04

• Browser (if applicable): N/A

Confirmation:

• I have read and followed all the instructions provided in the README.md.
• I am on the latest version of both Open WebUI and Ollama.
• I have included the browser console logs.
• I have included the Docker container logs.
• I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.

Expected Behavior:

The code interpreter repeatedly fails, causing a dead loop for the model.

Actual Behavior:

The code interpreter should work.

Description

Bug Summary:

I have an OpenAI endpoint that uses fake streaming, i.e., it will put the whole output into a single text/event-stream chunk when stream=True. In this setup, when using the code interpreter feature, Open WebUI cannot end the <code_interpreter> block successfully, leading to errors when executing the code.

Reproduction Details

Steps to Reproduce:

• Have an OpenAI endpoint that uses fake streaming by putting the whole output into a single text/event-stream chunk
• Use Open WebUI to ask it print the current python version.
• See the screenshots below, where we can see that </code_interpreter> and contents after that are considered part of the code block, leading to a SyntaxError.

Logs and Screenshots

Browser Console Logs:

Docker Container Logs:

[{'type': 'code_interpreter', 'tag': 'code_interpreter', 'attributes': {'type': 'code', 'lang': 'python'}, 'content': '\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used in this environment. After running it, you\'ll see detailed output including version number and additional build details.', 'started_at': 1739447846.2873282, 'output': ''}, {'type': 'text', 'content': '<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used, along with additional build details provided by the sys.version attribute. When executed, you\'ll see information such as the version number, build date, and compiler details, which can help you verify the Python environment.'}, {'type': 'code_interpreter', 'tag': 'code_interpreter', 'attributes': {'type': 'code', 'lang': 'python'}, 'content': '\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used in this environment. After running it, you\'ll see detailed output including version number and additional build details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used, along with additional build details provided by the sys.version attribute. When executed, you\'ll see information such as the version number, build date, and compiler details, which can help you verify the Python environment.', 'started_at': 1739447909.5165014, 'output': ''}, {'type': 'text', 'content': '<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the Python version installed in the current environment. Running it will display detailed information such as the Python version number, build date, and other relevant details.'}, {'type': 'code_interpreter', 'tag': 'code_interpreter', 'attributes': {'type': 'code', 'lang': 'python'}, 'content': '\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used in this environment. After running it, you\'ll see detailed output including version number and additional build details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used, along with additional build details provided by the sys.version attribute. When executed, you\'ll see information such as the version number, build date, and compiler details, which can help you verify the Python environment.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the Python version installed in the current environment. Running it will display detailed information such as the Python version number, build date, and other relevant details.', 'started_at': 1739447972.9585047, 'output': ''}, {'type': 'text', 'content': '<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above imports the sys module and prints the current Python version installed in this environment, including detailed build information such as the version number, build date, and compiler details.'}, {'type': 'code_interpreter', 'tag': 'code_interpreter', 'attributes': {'type': 'code', 'lang': 'python'}, 'content': '\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used in this environment. After running it, you\'ll see detailed output including version number and additional build details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used, along with additional build details provided by the sys.version attribute. When executed, you\'ll see information such as the version number, build date, and compiler details, which can help you verify the Python environment.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the Python version installed in the current environment. Running it will display detailed information such as the Python version number, build date, and other relevant details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above imports the sys module and prints the current Python version installed in this environment, including detailed build information such as the version number, build date, and compiler details.', 'started_at': 1739448037.8162143, 'output': ''}, {'type': 'text', 'content': '<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThis code imports the sys module and prints the current Python version along with additional build details (such as build date and compiler information) from sys.version. When executed in the Python environment, you\'ll see the full version information displayed.'}, {'type': 'code_interpreter', 'tag': 'code_interpreter', 'attributes': {'type': 'code', 'lang': 'python'}, 'content': '\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used in this environment. After running it, you\'ll see detailed output including version number and additional build details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used, along with additional build details provided by the sys.version attribute. When executed, you\'ll see information such as the version number, build date, and compiler details, which can help you verify the Python environment.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the Python version installed in the current environment. Running it will display detailed information such as the Python version number, build date, and other relevant details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above imports the sys module and prints the current Python version installed in this environment, including detailed build information such as the version number, build date, and compiler details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThis code imports the sys module and prints the current Python version along with additional build details (such as build date and compiler information) from sys.version. When executed in the Python environment, you\'ll see the full version information displayed.', 'started_at': 1739448102.314626, 'output': ''}, {'type': 'text', 'content': ''}] <details type="code_interpreter" done="false">
<summary>Analyzing...</summary>
```python

import sys
print("Current Python version:")
print(sys.version)
</code_interpreter>

The code above prints the current Python version being used in this environment. After running it, you'll see detailed output including version number and additional build details.
```
</details>

The above log seems to be printed at middleware.py:1794.

Screenshots/Screen Recordings (if applicable):

Additional Information

I think I know the root cause of this issue, and can contribute a PR for it. I will elaborate in a separate comment below.

Originally created by @xmcp on GitHub (Feb 13, 2025). # Bug Report ## Installation Method docker ## Environment - **Open WebUI Version:** v0.5.11 - **Ollama (if applicable):** N/A - **Operating System:** Ubuntu 24.04 - **Browser (if applicable):** N/A **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [x] I am on the latest version of both Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below. ## Expected Behavior: The code interpreter repeatedly fails, causing a dead loop for the model. ## Actual Behavior: The code interpreter should work. ## Description **Bug Summary:** I have an OpenAI endpoint that uses fake streaming, i.e., it will put the whole output into a single `text/event-stream` chunk when stream=True. In this setup, when using the code interpreter feature, Open WebUI cannot end the `<code_interpreter>` block successfully, leading to errors when executing the code. ## Reproduction Details **Steps to Reproduce:** - Have an OpenAI endpoint that uses fake streaming by putting the whole output into a single `text/event-stream` chunk - Use Open WebUI to ask it `print the current python version`. - See the screenshots below, where we can see that `</code_interpreter>` and contents after that are considered part of the code block, leading to a `SyntaxError`. ## Logs and Screenshots **Browser Console Logs:**  **Docker Container Logs:** [{'type': 'code_interpreter', 'tag': 'code_interpreter', 'attributes': {'type': 'code', 'lang': 'python'}, 'content': '\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used in this environment. After running it, you\'ll see detailed output including version number and additional build details.', 'started_at': 1739447846.2873282, 'output': ''}, {'type': 'text', 'content': '<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used, along with additional build details provided by the sys.version attribute. When executed, you\'ll see information such as the version number, build date, and compiler details, which can help you verify the Python environment.'}, {'type': 'code_interpreter', 'tag': 'code_interpreter', 'attributes': {'type': 'code', 'lang': 'python'}, 'content': '\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used in this environment. After running it, you\'ll see detailed output including version number and additional build details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used, along with additional build details provided by the sys.version attribute. When executed, you\'ll see information such as the version number, build date, and compiler details, which can help you verify the Python environment.', 'started_at': 1739447909.5165014, 'output': ''}, {'type': 'text', 'content': '<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the Python version installed in the current environment. Running it will display detailed information such as the Python version number, build date, and other relevant details.'}, {'type': 'code_interpreter', 'tag': 'code_interpreter', 'attributes': {'type': 'code', 'lang': 'python'}, 'content': '\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used in this environment. After running it, you\'ll see detailed output including version number and additional build details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used, along with additional build details provided by the sys.version attribute. When executed, you\'ll see information such as the version number, build date, and compiler details, which can help you verify the Python environment.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the Python version installed in the current environment. Running it will display detailed information such as the Python version number, build date, and other relevant details.', 'started_at': 1739447972.9585047, 'output': ''}, {'type': 'text', 'content': '<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above imports the sys module and prints the current Python version installed in this environment, including detailed build information such as the version number, build date, and compiler details.'}, {'type': 'code_interpreter', 'tag': 'code_interpreter', 'attributes': {'type': 'code', 'lang': 'python'}, 'content': '\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used in this environment. After running it, you\'ll see detailed output including version number and additional build details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used, along with additional build details provided by the sys.version attribute. When executed, you\'ll see information such as the version number, build date, and compiler details, which can help you verify the Python environment.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the Python version installed in the current environment. Running it will display detailed information such as the Python version number, build date, and other relevant details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above imports the sys module and prints the current Python version installed in this environment, including detailed build information such as the version number, build date, and compiler details.', 'started_at': 1739448037.8162143, 'output': ''}, {'type': 'text', 'content': '<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThis code imports the sys module and prints the current Python version along with additional build details (such as build date and compiler information) from sys.version. When executed in the Python environment, you\'ll see the full version information displayed.'}, {'type': 'code_interpreter', 'tag': 'code_interpreter', 'attributes': {'type': 'code', 'lang': 'python'}, 'content': '\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used in this environment. After running it, you\'ll see detailed output including version number and additional build details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the current Python version being used, along with additional build details provided by the sys.version attribute. When executed, you\'ll see information such as the version number, build date, and compiler details, which can help you verify the Python environment.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above prints the Python version installed in the current environment. Running it will display detailed information such as the Python version number, build date, and other relevant details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThe code above imports the sys module and prints the current Python version installed in this environment, including detailed build information such as the version number, build date, and compiler details.<code_interpreter type="code" lang="python">\nimport sys\nprint("Current Python version:")\nprint(sys.version)\n</code_interpreter>\n\nThis code imports the sys module and prints the current Python version along with additional build details (such as build date and compiler information) from sys.version. When executed in the Python environment, you\'ll see the full version information displayed.', 'started_at': 1739448102.314626, 'output': ''}, {'type': 'text', 'content': ''}] <details type="code_interpreter" done="false"> <summary>Analyzing...</summary> ```python import sys print("Current Python version:") print(sys.version) </code_interpreter> The code above prints the current Python version being used in this environment. After running it, you'll see detailed output including version number and additional build details. ``` </details> The above log seems to be printed at [middleware.py:1794](https://github.com/open-webui/open-webui/blob/v0.5.11/backend/open_webui/utils/middleware.py#L1794). **Screenshots/Screen Recordings (if applicable):**  ## Additional Information I think I know the root cause of this issue, and can contribute a PR for it. I will elaborate in a separate comment below.

GiteaMirror closed this issue 2025-11-11 15:39:58 -06:00

GiteaMirror commented 2025-11-11 15:39:59 -06:00

Author

Owner

Copy Link

Copy Source

@xmcp commented on GitHub (Feb 13, 2025):

The root cause seems to be the tag_content_handler function in middleware.py, which looks like:

def tag_content_handler(content_type, tags, content, content_blocks):
    if content_blocks[-1]["type"] == "text":
        ... # checks for start tag, i.e., `<code_interpreter attrs>`
    elif content_blocks[-1]["type"] == content_type:
        ... # checks for end tag, i.e., `</code_interpreter>`
    return content, content_blocks, end_flag

This function will be called once for each streamed chunk. If <code_interpreter>...</code_interpreter> is returned within a single chunk, only the code path for the start tag is executed, skipping the code path for the end tag.

Therefore, the whole chunk including the content after </code_interpreter> is incorrectly considered the content in the code block.

@xmcp commented on GitHub (Feb 13, 2025): The root cause seems to be the `tag_content_handler` function in `middleware.py`, which looks like: ```python def tag_content_handler(content_type, tags, content, content_blocks): if content_blocks[-1]["type"] == "text": ... # checks for start tag, i.e., `<code_interpreter attrs>` elif content_blocks[-1]["type"] == content_type: ... # checks for end tag, i.e., `</code_interpreter>` return content, content_blocks, end_flag ``` This function will be called once for each streamed chunk. If `<code_interpreter>...</code_interpreter>` is returned within a single chunk, only the code path for the start tag is executed, skipping the code path for the end tag. Therefore, the whole chunk including the content after `</code_interpreter>` is incorrectly considered the content in the code block.

GiteaMirror commented 2025-11-11 15:39:59 -06:00

Author

Owner

Copy Link

Copy Source

@xmcp commented on GitHub (Feb 13, 2025):

FYI, the below patch solves this issue in my setup

diff --git a/backend/open_webui/utils/middleware.py b/backend/open_webui/utils/middleware.py
index fd2d0d259..fc4c4f379 100644
--- a/backend/open_webui/utils/middleware.py
+++ b/backend/open_webui/utils/middleware.py
@@ -1210,6 +1210,7 @@ async def process_chat_response(
 
                             if after_tag:
                                 content_blocks[-1]["content"] = after_tag
+                                return tag_content_handler(content_type, tags, content, content_blocks)
 
                             break
                 elif content_blocks[-1]["type"] == content_type:

@xmcp commented on GitHub (Feb 13, 2025): FYI, the below patch solves this issue in my setup ```diff diff --git a/backend/open_webui/utils/middleware.py b/backend/open_webui/utils/middleware.py index fd2d0d259..fc4c4f379 100644 --- a/backend/open_webui/utils/middleware.py +++ b/backend/open_webui/utils/middleware.py @@ -1210,6 +1210,7 @@ async def process_chat_response( if after_tag: content_blocks[-1]["content"] = after_tag + return tag_content_handler(content_type, tags, content, content_blocks) break elif content_blocks[-1]["type"] == content_type: ``` 

GiteaMirror commented 2025-11-11 15:39:59 -06:00

Author

Owner

Copy Link

Copy Source

@tjbck commented on GitHub (Feb 13, 2025):

PR Welcome!

@tjbck commented on GitHub (Feb 13, 2025): PR Welcome!

GiteaMirror commented 2025-11-11 15:39:59 -06:00

Author

Owner

Copy Link

Copy Source

@tjbck commented on GitHub (Feb 14, 2025):

I highly suspect the issue is caused from the model-end. Suggested PR does not resolve the issue entirely.

@tjbck commented on GitHub (Feb 14, 2025): I highly suspect the issue is caused from the model-end. Suggested PR does not resolve the issue entirely.

GiteaMirror referenced this issue 2026-04-19 20:08:55 -05:00

[GH-ISSUE #3797] Error during SSO-Login #13388

GiteaMirror referenced this issue 2026-04-25 03:26:10 -05:00

[GH-ISSUE #3797] Error during SSO-Login #28916

GiteaMirror referenced this issue 2026-05-05 13:15:49 -05:00

[GH-ISSUE #3797] Error during SSO-Login #52054

GiteaMirror referenced this issue 2026-05-13 00:14:00 -05:00

[GH-ISSUE #3797] Error during SSO-Login #67992

GiteaMirror referenced this issue 2026-05-15 09:07:56 -05:00

[GH-ISSUE #3797] Error during SSO-Login #84128

GiteaMirror referenced this issue 2026-05-17 22:14:32 -05:00

[GH-ISSUE #3797] Error during SSO-Login #100383

GiteaMirror referenced this issue 2026-05-20 18:29:50 -05:00

[GH-ISSUE #3797] Error during SSO-Login #116698

GiteaMirror referenced this issue 2026-05-24 22:17:54 -05:00

[GH-ISSUE #3797] Error during SSO-Login #133115

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

dev

v0.13.3

v0.13.2

v0.13.1

v0.13.0

v0.12.5

v0.12.4

v0.12.3

v0.12.2

v0.12.1

v0.12.0

v0.11.4

v0.11.3

v0.11.2

v0.11.1

v0.11.0

v0.10.2

v0.10.1

v0.10.0

v0.9.6

v0.9.5

v0.9.4

v0.9.3

v0.9.2

v0.9.1

v0.9.0

v0.8.12

v0.8.11

v0.8.10

v0.8.9

v0.8.8

v0.8.7

v0.8.6

v0.8.5

v0.8.4

v0.8.3

v0.8.2

v0.8.1

v0.8.0

v0.7.2

v0.7.1

v0.7.0

v0.6.43

v0.6.42

v0.6.41

v0.6.40

v0.6.39

v0.6.38

v0.6.37

v0.6.36

v0.6.35

v0.6.34

v0.6.33

v0.6.32

v0.6.31

v0.6.30

v0.6.29

v0.6.28

v0.6.27

v0.6.26

v0.6.25

v0.6.24

v0.6.23

v0.6.22

v0.6.21

v0.6.20

v0.6.19

v0.6.18

v0.6.17

v0.6.16

v0.6.15

v0.6.14

v0.6.13

v0.6.12

v0.6.11

v0.6.10

v0.6.9

v0.6.8

v0.6.7

v0.6.6

v0.6.5

v0.6.4

v0.6.3

v0.6.2

v0.6.1

v0.6.0

v0.5.20

v0.5.19

v0.5.18

v0.5.17

v0.5.16

v0.5.15

v0.5.14

v0.5.13

v0.5.12

v0.5.11

v0.5.10

v0.5.9

v0.5.8

v0.5.7

v0.5.6

v0.5.5

v0.5.4

v0.5.3

v0.5.2

v0.5.1

v0.5.0

v0.4.8

v0.4.7

v0.4.6

v0.4.5

v0.4.4

v0.4.3

v0.4.2

v0.4.1

v0.4.0

v0.3.35

v0.3.34

v0.3.33

v0.3.32

v0.3.31

v0.3.30

v0.3.29

v0.3.28

v0.3.27

v0.3.26

v0.3.25

v0.3.24

v0.3.23

v0.3.22

v0.3.21

v0.3.20

v0.3.19

v0.3.18

v0.3.17

v0.3.16

v0.3.15

v0.3.14

v0.3.13

v0.3.12

v0.3.11

v0.3.10

v0.3.9

v0.3.8

v0.3.7

v0.3.6

v0.3.5

v0.3.4

v0.3.3

v0.3.2

v0.3.1

v0.3.0

v0.2.5

v0.2.4

v0.2.3

v0.2.2

v0.2.1

v0.2.0

v0.1.125

v0.1.124

v0.1.123

v0.1.122

v0.1.121

v0.1.120

v0.1.119

v0.1.118

v0.1.117

v0.1.116

v0.1.115

v0.1.114

v0.1.113

v0.1.112

v0.1.111

v0.1.110

v0.1.109

v0.1.108

v0.1.107

v0.1.106

v0.1.105

v0.1.104

v0.1.103

v0.1.102

Labels

Clear labels

bug

confirmed

confirmed issue

core

documentation

enhancement

good first issue

help wanted

non-core

pull-request

Mirrored from GitHub Pull Request

python

question

testing wanted

No labels

Milestone

No items

No Milestone

Projects

Clear projects

No projects

Assignees

Clear assignees

GiteaMirror ninjasurge (Kaehlen Rog)

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#3797