API Tool arguments formatting issue #3747

New Issue

Closed

opened 2025-11-11 15:38:58 -06:00 by GiteaMirror · 4 comments

GiteaMirror commented 2025-11-11 15:38:58 -06:00

Owner

Copy Link

Copy Source

Originally created by @Seniorsimo on GitHub (Feb 10, 2025).

Bug Report

Installation Method

Docker

Environment

• Open WebUI Version: v0.5.10

• Ollama (if applicable): 0.5.7-0-ga420a45-dirty

• Operating System: Windows 11

Confirmation:

• I have read and followed all the instructions provided in the README.md.
• I am on the latest version of both Open WebUI and Ollama.
• I have included the browser console logs.
• I have included the Docker container logs.
• I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.

Expected Behavior:

When calling the Open-webUI API with tools that need arguments and an expected tool call is expected, the model answer with a tool call with arguments

Actual Behavior:

The tool call answered has the arguments not correctly serialized

Description

Bug Summary:
The JSON representazion of the arguments in the tool beign called seem a standard python representation of a dictionary and not a full serialized json.

A sample tool call returned by Open-webUI

	"tool_calls": [
		{
			"index": 0, 
			"id": "call_df2ee15e-e8ee-4709-b179-e0f2df19fa91", 
			"type": "function", 
			"function": {
				"name": "weather", 
				"arguments": "{'city': 'New York'}"
			}
		}
	]

A sample tool call returned by OpenAI

	"tool_calls":[
		{
			"index":0,
			"id":"call_Gs5yB8tdaYWth1RFMbeIEVDU",
			"type":"function",
			"function":{
				"name":"weather",
				"arguments":"{\"city\":\"New York\"}"
			}
		}
	]

In the Open-webUI the arguments is not a well-formed JSON: ' should be replaced by \".

Reproduction Details

Steps to Reproduce:

Open-webui

Request

curl -XPOST -H 'Authorization: Bearer sk-YOUR-API-KEY' -H "Content-type: application/json" -d '{
	"messages": [
		{
			"content": "You are a helpful assistant", 
			"role": "system"
		}, {
			"content": "It feels so cold today in NY.", 
			"role": "user"
		}
	], 
	"model": "pc.qwen2.5:14b", 
	"n": 1, 
	"stream": true, 
	"temperature": 0.7, 
	"tools": [
		{
			"type": "function", 
			"function": {
				"name": "weather", 
				"description": "Retrieve the weather for a city.", 
				"parameters": {
					"properties": {
						"city": {
							"description": "The city to inspect current weather", 
							"type": "string"
						}
					}, 
					"required": ["city"], 
					"type": "object"
				}
			}
		}
	]
}' 'http://localhost:8080/api/chat/completions'

Response

{
	"id": "qwen2.5:14b-92f77e7e-baa5-454a-aa84-4a8647ef3044", 
	"created": 1739210359, 
	"model": "qwen2.5:14b", 
	"choices": [
		{
			"index": 0, 
			"logprobs": null, 
			"finish_reason": null, 
			"delta": {
				"tool_calls": [
					{
						"index": 0, 
						"id": "call_df2ee15e-e8ee-4709-b179-e0f2df19fa91", 
						"type": "function", 
						"function": {
							"name": "weather", 
							"arguments": "{'city': 'New York'}"
						}
					}
				]
			}
		}
	], 
	"object": "chat.completion.chunk"
}

OpenAI

Request

curl -XPOST -H 'Authorization: Bearer sk-YOUR-API-KEY' -H "Content-type: application/json" -d '{
    "model": "gpt-3.5-turbo",
    "messages": [
		{
			"content": "You are a helpful assistant", 
			"role": "system"
		}, {
			"content": "It feels so cold today in NY.", 
			"role": "user"
		}
	],
	"stream": true, 
	"temperature": 0.7, 
	"tools": [
		{
			"type": "function", 
			"function": {
				"name": "weather", 
				"description": "Retrieve the weather for a city.", 
				"parameters": {
					"properties": {
						"city": {
							"description": "The city to inspect current weather", 
							"type": "string"
						}
					}, 
					"required": ["city"], 
					"type": "object"
				}
			}
		}
	]
}' 'https://api.openai.com/v1/chat/completions'

Response

{
	"id":"chatcmpl-AzA1wy4pXHFTtPGVjcZ4F04XUAfK0",
	"object":"chat.completion.chunk",
	"created":1739139928,
	"model":"gpt-3.5-turbo-0125",
	"service_tier":"default",
	"system_fingerprint":null,
	"choices":[
		{
			"index":0,
			"delta":{
				"role":"assistant",
				"content":null,
				"tool_calls":[
					{
						"index":0,
						"id":"call_Gs5yB8tdaYWth1RFMbeIEVDU",
						"type":"function",
						"function":{
							"name":"weather",
							"arguments":"{\"city\":\"New York\"}"
						}
					}
				]
			},
			"logprobs":null,
			"finish_reason":null
		}
	]
}

Logs and Screenshots

Browser Console Logs:
not applicable

Docker Container Logs:
INFO: 10.88.5.1:0 - "POST /api/chat/completions HTTP/1.1" 200 OK

Screenshots/Screen Recordings (if applicable):
not applicable

Additional Information

I have tried to solve this locally in a fork and seems working now.
Just replaced tis line:

	"arguments": f"{tool_call.get('function', {}).get('arguments', {})}",

with this one:

	"arguments": json.dumps(tool_call.get('function', {}).get('arguments', {})),

The related commit:
https://github.com/open-webui/open-webui/commit/2c04be429a720b6d4921c73ef944fa4067cabad1

Let me know if some other info is needed.

Great work !!!

Originally created by @Seniorsimo on GitHub (Feb 10, 2025). # Bug Report ## Installation Method Docker ## Environment - **Open WebUI Version:** v0.5.10 - **Ollama (if applicable):** 0.5.7-0-ga420a45-dirty - **Operating System:** Windows 11 **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [x] I am on the latest version of both Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below. ## Expected Behavior: When calling the Open-webUI API with tools that need arguments and an expected tool call is expected, the model answer with a tool call with arguments ## Actual Behavior: The tool call answered has the arguments not correctly serialized ## Description **Bug Summary:** The JSON representazion of the arguments in the tool beign called seem a standard python representation of a dictionary and not a full serialized json. A sample tool call returned by Open-webUI ```json "tool_calls": [ { "index": 0, "id": "call_df2ee15e-e8ee-4709-b179-e0f2df19fa91", "type": "function", "function": { "name": "weather", "arguments": "{'city': 'New York'}" } } ] ``` A sample tool call returned by OpenAI ```json "tool_calls":[ { "index":0, "id":"call_Gs5yB8tdaYWth1RFMbeIEVDU", "type":"function", "function":{ "name":"weather", "arguments":"{\"city\":\"New York\"}" } } ] ``` In the Open-webUI the arguments is not a well-formed JSON: `'` should be replaced by `\"`. ## Reproduction Details **Steps to Reproduce:** *Open-webui* Request ```bash curl -XPOST -H 'Authorization: Bearer sk-YOUR-API-KEY' -H "Content-type: application/json" -d '{ "messages": [ { "content": "You are a helpful assistant", "role": "system" }, { "content": "It feels so cold today in NY.", "role": "user" } ], "model": "pc.qwen2.5:14b", "n": 1, "stream": true, "temperature": 0.7, "tools": [ { "type": "function", "function": { "name": "weather", "description": "Retrieve the weather for a city.", "parameters": { "properties": { "city": { "description": "The city to inspect current weather", "type": "string" } }, "required": ["city"], "type": "object" } } } ] }' 'http://localhost:8080/api/chat/completions' ``` Response ```json { "id": "qwen2.5:14b-92f77e7e-baa5-454a-aa84-4a8647ef3044", "created": 1739210359, "model": "qwen2.5:14b", "choices": [ { "index": 0, "logprobs": null, "finish_reason": null, "delta": { "tool_calls": [ { "index": 0, "id": "call_df2ee15e-e8ee-4709-b179-e0f2df19fa91", "type": "function", "function": { "name": "weather", "arguments": "{'city': 'New York'}" } } ] } } ], "object": "chat.completion.chunk" } ``` *OpenAI* Request ```bash curl -XPOST -H 'Authorization: Bearer sk-YOUR-API-KEY' -H "Content-type: application/json" -d '{ "model": "gpt-3.5-turbo", "messages": [ { "content": "You are a helpful assistant", "role": "system" }, { "content": "It feels so cold today in NY.", "role": "user" } ], "stream": true, "temperature": 0.7, "tools": [ { "type": "function", "function": { "name": "weather", "description": "Retrieve the weather for a city.", "parameters": { "properties": { "city": { "description": "The city to inspect current weather", "type": "string" } }, "required": ["city"], "type": "object" } } } ] }' 'https://api.openai.com/v1/chat/completions' ``` Response ```json { "id":"chatcmpl-AzA1wy4pXHFTtPGVjcZ4F04XUAfK0", "object":"chat.completion.chunk", "created":1739139928, "model":"gpt-3.5-turbo-0125", "service_tier":"default", "system_fingerprint":null, "choices":[ { "index":0, "delta":{ "role":"assistant", "content":null, "tool_calls":[ { "index":0, "id":"call_Gs5yB8tdaYWth1RFMbeIEVDU", "type":"function", "function":{ "name":"weather", "arguments":"{\"city\":\"New York\"}" } } ] }, "logprobs":null, "finish_reason":null } ] } ``` ## Logs and Screenshots **Browser Console Logs:** not applicable **Docker Container Logs:** INFO: 10.88.5.1:0 - "POST /api/chat/completions HTTP/1.1" 200 OK **Screenshots/Screen Recordings (if applicable):** not applicable ## Additional Information I have tried to solve this locally in a fork and seems working now. Just replaced tis line: ```python "arguments": f"{tool_call.get('function', {}).get('arguments', {})}", ``` with this one: ```python "arguments": json.dumps(tool_call.get('function', {}).get('arguments', {})), ``` The related commit: https://github.com/open-webui/open-webui/commit/2c04be429a720b6d4921c73ef944fa4067cabad1 Let me know if some other info is needed. Great work !!!

GiteaMirror closed this issue 2025-11-11 15:38:58 -06:00

GiteaMirror commented 2025-11-11 15:38:59 -06:00

Author

Owner

Copy Link

Copy Source

@tjbck commented on GitHub (Feb 10, 2025):

This is model dependent and out of scope of Open WebUI.

@tjbck commented on GitHub (Feb 10, 2025): This is model dependent and out of scope of Open WebUI.

GiteaMirror commented 2025-11-11 15:38:59 -06:00

Author

Owner

Copy Link

Copy Source

@Seniorsimo commented on GitHub (Feb 10, 2025):

How could it be model-dependent? I've tried multiple models:

qwen2.5:14b (the one I posted)
llama3.2:latest
Even gpt-3.5-tbo using OpenWebUI as a proxy
In all cases, the results were identical.

From the code in my bug report, you can see that the current implementation is printing a dictionary instead of properly JSON serializing it. The method in question is called "ollama_to_openai," which suggests its purpose should be to convert Ollama responses into OpenAI-compatible standards.

If the API being exposed must be compatible with OpenAI, shouldn't I expect consistent results regardless of the model used? Additionally, even if a different model is employed, shouldn’t its response be converted to adhere to the OpenAI standard?

This fix literally 10 seconds to implement:

@Seniorsimo commented on GitHub (Feb 10, 2025): How could it be model-dependent? I've tried multiple models: qwen2.5:14b (the one I posted) llama3.2:latest Even gpt-3.5-tbo using OpenWebUI as a proxy In all cases, the results were identical. From the code in my bug report, you can see that the current implementation is printing a dictionary instead of properly JSON serializing it. The method in question is called "ollama_to_openai," which suggests its purpose should be to convert Ollama responses into OpenAI-compatible standards. If the API being exposed must be compatible with OpenAI, shouldn't I expect consistent results regardless of the model used? Additionally, even if a different model is employed, shouldn’t its response be converted to adhere to the OpenAI standard? This fix literally 10 seconds to implement:

GiteaMirror commented 2025-11-11 15:39:00 -06:00

Author

Owner

Copy Link

Copy Source

@gmammolo commented on GitHub (Feb 10, 2025):

Hi @tjbck,

I confirm that I have experienced the same bug and that the suggested fix worked for me!
It's just a "parsing" bug, not a model problem.
Using <json.dumps> instead of a simple string f“” can easily solve the bug.

Thanks @Seniorsimo for the solution.

@gmammolo commented on GitHub (Feb 10, 2025): Hi @tjbck, I confirm that I have experienced the same bug and that the suggested fix worked for me! It's just a "parsing" bug, not a model problem. Using <json.dumps> instead of a simple string f“” can easily solve the bug. Thanks @Seniorsimo for the solution.

GiteaMirror commented 2025-11-11 15:39:00 -06:00

Author

Owner

Copy Link

Copy Source

@tjbck commented on GitHub (Feb 10, 2025):

Addressed with 0f12c4d14f, Misread your issue post!

@tjbck commented on GitHub (Feb 10, 2025): Addressed with 0f12c4d14f1eef01a221c58c2506d8215b26293c, Misread your issue post!

GiteaMirror referenced this issue 2026-04-19 20:07:53 -05:00

[GH-ISSUE #3747] Postgres problem with the new 0.3.8 #13370

GiteaMirror referenced this issue 2026-04-25 03:25:20 -05:00

[GH-ISSUE #3747] Postgres problem with the new 0.3.8 #28898

GiteaMirror referenced this issue 2026-05-05 13:15:04 -05:00

[GH-ISSUE #3747] Postgres problem with the new 0.3.8 #52036

GiteaMirror referenced this issue 2026-05-13 00:10:54 -05:00

[GH-ISSUE #3747] Postgres problem with the new 0.3.8 #67974

GiteaMirror referenced this issue 2026-05-15 09:07:12 -05:00

[GH-ISSUE #3747] Postgres problem with the new 0.3.8 #84110

GiteaMirror referenced this issue 2026-05-17 22:13:34 -05:00

[GH-ISSUE #3747] Postgres problem with the new 0.3.8 #100365

GiteaMirror referenced this issue 2026-05-20 18:28:32 -05:00

[GH-ISSUE #3747] Postgres problem with the new 0.3.8 #116680

GiteaMirror referenced this issue 2026-05-24 22:14:51 -05:00

[GH-ISSUE #3747] Postgres problem with the new 0.3.8 #133097

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

dev

v0.13.3

v0.13.2

v0.13.1

v0.13.0

v0.12.5

v0.12.4

v0.12.3

v0.12.2

v0.12.1

v0.12.0

v0.11.4

v0.11.3

v0.11.2

v0.11.1

v0.11.0

v0.10.2

v0.10.1

v0.10.0

v0.9.6

v0.9.5

v0.9.4

v0.9.3

v0.9.2

v0.9.1

v0.9.0

v0.8.12

v0.8.11

v0.8.10

v0.8.9

v0.8.8

v0.8.7

v0.8.6

v0.8.5

v0.8.4

v0.8.3

v0.8.2

v0.8.1

v0.8.0

v0.7.2

v0.7.1

v0.7.0

v0.6.43

v0.6.42

v0.6.41

v0.6.40

v0.6.39

v0.6.38

v0.6.37

v0.6.36

v0.6.35

v0.6.34

v0.6.33

v0.6.32

v0.6.31

v0.6.30

v0.6.29

v0.6.28

v0.6.27

v0.6.26

v0.6.25

v0.6.24

v0.6.23

v0.6.22

v0.6.21

v0.6.20

v0.6.19

v0.6.18

v0.6.17

v0.6.16

v0.6.15

v0.6.14

v0.6.13

v0.6.12

v0.6.11

v0.6.10

v0.6.9

v0.6.8

v0.6.7

v0.6.6

v0.6.5

v0.6.4

v0.6.3

v0.6.2

v0.6.1

v0.6.0

v0.5.20

v0.5.19

v0.5.18

v0.5.17

v0.5.16

v0.5.15

v0.5.14

v0.5.13

v0.5.12

v0.5.11

v0.5.10

v0.5.9

v0.5.8

v0.5.7

v0.5.6

v0.5.5

v0.5.4

v0.5.3

v0.5.2

v0.5.1

v0.5.0

v0.4.8

v0.4.7

v0.4.6

v0.4.5

v0.4.4

v0.4.3

v0.4.2

v0.4.1

v0.4.0

v0.3.35

v0.3.34

v0.3.33

v0.3.32

v0.3.31

v0.3.30

v0.3.29

v0.3.28

v0.3.27

v0.3.26

v0.3.25

v0.3.24

v0.3.23

v0.3.22

v0.3.21

v0.3.20

v0.3.19

v0.3.18

v0.3.17

v0.3.16

v0.3.15

v0.3.14

v0.3.13

v0.3.12

v0.3.11

v0.3.10

v0.3.9

v0.3.8

v0.3.7

v0.3.6

v0.3.5

v0.3.4

v0.3.3

v0.3.2

v0.3.1

v0.3.0

v0.2.5

v0.2.4

v0.2.3

v0.2.2

v0.2.1

v0.2.0

v0.1.125

v0.1.124

v0.1.123

v0.1.122

v0.1.121

v0.1.120

v0.1.119

v0.1.118

v0.1.117

v0.1.116

v0.1.115

v0.1.114

v0.1.113

v0.1.112

v0.1.111

v0.1.110

v0.1.109

v0.1.108

v0.1.107

v0.1.106

v0.1.105

v0.1.104

v0.1.103

v0.1.102

Labels

Clear labels

bug

confirmed

confirmed issue

core

documentation

enhancement

good first issue

help wanted

non-core

pull-request

Mirrored from GitHub Pull Request

python

question

testing wanted

No labels

Milestone

No items

No Milestone

Projects

Clear projects

No projects

Assignees

Clear assignees

GiteaMirror ninjasurge (Kaehlen Rog)

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#3747