issue: Expecting value: line 1 column 1 (char 0) #6732

Closed
opened 2025-11-11 17:04:29 -06:00 by GiteaMirror · 1 comment
Owner

Originally created by @arno4000 on GitHub (Oct 22, 2025).

Check Existing Issues

  • I have searched for any existing and/or related issues.
  • I have searched for any existing and/or related discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Other

Open WebUI Version

0.6.34

Ollama Version (if applicable)

No response

Operating System

k8s v1.33.4

Browser (if applicable)

No response

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided every relevant configuration, setting, and environment variable used in my setup.
  • I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
  • I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
  • Start with the initial platform/version/OS and dependencies used,
  • Specify exact install/launch/configure commands,
  • List URLs visited, user input (incl. example values/emails/passwords if needed),
  • Describe all options and toggles enabled or changed,
  • Include any files or environmental changes,
  • Identify the expected and actual result at each stage,
  • Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

I want to use Nutanix AI with Open Web UI

Actual Behavior

I get the following error:
2025-10-22 11:23:37.811 | ERROR | open_webui.routers.openai:generate_chat_completion:961 - Expecting value: line 1 column 1 (char 0)

When i execute the request to v1/chat/completions via curl, it works. I get a valid JSON output.

curl -X POST 'http://localhost:8080/nai/v1/chat/completions' \
  -H 'Content-Type: application/json' \
  -H 'Accept: application/json' \
  -d '{"model":"test","messages":[{"role":"user","content":"hello"}],"stream":false}' -H 'Authorization: Bearer xxxxxxxxxxxxx'

{"id":"bd51df24-b616-4e5e-92b3-e57fc0f10178","object":"chat.completion","created":1761125357,"model":"test","choices":[{"index":0,"message":{"role":"assistant","content":"Hello! How can I help you today? If you have any questions or topics you'd like to discuss, feel free to ask. If you're just saying hi, then hello to you too! Have a great day! :)"},"finish_reason":"stop","content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"usage":{"prompt_tokens":5,"completion_tokens":50,"total_tokens":55,"prompt_tokens_details":null,"completion_tokens_details":null},"system_fingerprint":"3.3.4-native"}

with stream turned on:

data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"content":" your","role":"assistant"},"finish_reason":null,"content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"}

data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"content":" day","role":"assistant"},"finish_reason":null,"content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"}

data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"content":"!","role":"assistant"},"finish_reason":null,"content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"}

data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"role":"assistant"},"finish_reason":"stop","content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"}

data: [DONE]

Steps to Reproduce

  1. Install Open WebUI with Helm
  2. Try to connect Nutanix AI to Open WebUI
  3. Get the above mentioned error

Logs & Screenshots

2025-10-22 11:23:37.811 | ERROR | open_webui.routers.openai:generate_chat_completion:961 - Expecting value: line 1 column 1 (char 0)

In the Nutanix AI pod you can see that the request was successfully processed
2025-10-22T09:31:15.443638Z INFO chat_completions{parameters="GenerateParameters { best_of: None, temperature: None, repetition_penalty: None, frequency_penalty: None, top_k: None, top_p: None, typical_p: None, do_sample: true, max_new_tokens: None, return_full_text: None, stop: [], truncate: None, watermark: false, details: true, decoder_input_details: false, seed: None, top_n_tokens: None, grammar: None, adapter_id: None }" total_time="1.443721469s" validation_time="240.859µs" queue_time="60.248µs" inference_time="1.443420479s" time_per_token="21.226771ms" seed="Some(9205716254051098609)"}: text_generation_router::server: router/src/server.rs:637: Success

Additional Information

No response

Originally created by @arno4000 on GitHub (Oct 22, 2025). ### Check Existing Issues - [x] I have searched for any existing and/or related issues. - [x] I have searched for any existing and/or related discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Other ### Open WebUI Version 0.6.34 ### Ollama Version (if applicable) _No response_ ### Operating System k8s v1.33.4 ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior I want to use Nutanix AI with Open Web UI ### Actual Behavior I get the following error: `2025-10-22 11:23:37.811 | ERROR | open_webui.routers.openai:generate_chat_completion:961 - Expecting value: line 1 column 1 (char 0)` When i execute the request to v1/chat/completions via curl, it works. I get a valid JSON output. ```bash curl -X POST 'http://localhost:8080/nai/v1/chat/completions' \ -H 'Content-Type: application/json' \ -H 'Accept: application/json' \ -d '{"model":"test","messages":[{"role":"user","content":"hello"}],"stream":false}' -H 'Authorization: Bearer xxxxxxxxxxxxx' {"id":"bd51df24-b616-4e5e-92b3-e57fc0f10178","object":"chat.completion","created":1761125357,"model":"test","choices":[{"index":0,"message":{"role":"assistant","content":"Hello! How can I help you today? If you have any questions or topics you'd like to discuss, feel free to ask. If you're just saying hi, then hello to you too! Have a great day! :)"},"finish_reason":"stop","content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"usage":{"prompt_tokens":5,"completion_tokens":50,"total_tokens":55,"prompt_tokens_details":null,"completion_tokens_details":null},"system_fingerprint":"3.3.4-native"} ``` with stream turned on: ```bash data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"content":" your","role":"assistant"},"finish_reason":null,"content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"} data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"content":" day","role":"assistant"},"finish_reason":null,"content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"} data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"content":"!","role":"assistant"},"finish_reason":null,"content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"} data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"role":"assistant"},"finish_reason":"stop","content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"} data: [DONE] ``` ### Steps to Reproduce 1. Install Open WebUI with Helm 2. Try to connect Nutanix AI to Open WebUI 3. Get the above mentioned error ### Logs & Screenshots `2025-10-22 11:23:37.811 | ERROR | open_webui.routers.openai:generate_chat_completion:961 - Expecting value: line 1 column 1 (char 0)` In the Nutanix AI pod you can see that the request was successfully processed `2025-10-22T09:31:15.443638Z INFO chat_completions{parameters="GenerateParameters { best_of: None, temperature: None, repetition_penalty: None, frequency_penalty: None, top_k: None, top_p: None, typical_p: None, do_sample: true, max_new_tokens: None, return_full_text: None, stop: [], truncate: None, watermark: false, details: true, decoder_input_details: false, seed: None, top_n_tokens: None, grammar: None, adapter_id: None }" total_time="1.443721469s" validation_time="240.859µs" queue_time="60.248µs" inference_time="1.443420479s" time_per_token="21.226771ms" seed="Some(9205716254051098609)"}: text_generation_router::server: router/src/server.rs:637: Success` ### Additional Information _No response_
GiteaMirror added the bug label 2025-11-11 17:04:29 -06:00
Author
Owner

@arno4000 commented on GitHub (Oct 22, 2025):

Edit: Nutanix AI is based on TGI from Huggingface

@arno4000 commented on GitHub (Oct 22, 2025): Edit: Nutanix AI is based on TGI from Huggingface
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#6732