I have searched for any existing and/or related issues.
I have searched for any existing and/or related discussions.
I am using the latest version of Open WebUI.
Installation Method
Other
Open WebUI Version
0.6.34
Ollama Version (if applicable)
No response
Operating System
k8s v1.33.4
Browser (if applicable)
No response
Confirmation
I have read and followed all instructions in README.md.
I am using the latest version of both Open WebUI and Ollama.
I have included the browser console logs.
I have included the Docker container logs.
I have provided every relevant configuration, setting, and environment variable used in my setup.
I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
Start with the initial platform/version/OS and dependencies used,
Specify exact install/launch/configure commands,
List URLs visited, user input (incl. example values/emails/passwords if needed),
Describe all options and toggles enabled or changed,
Include any files or environmental changes,
Identify the expected and actual result at each stage,
Ensure any reasonably skilled user can follow and hit the same issue.
Expected Behavior
I want to use Nutanix AI with Open Web UI
Actual Behavior
I get the following error: 2025-10-22 11:23:37.811 | ERROR | open_webui.routers.openai:generate_chat_completion:961 - Expecting value: line 1 column 1 (char 0)
When i execute the request to v1/chat/completions via curl, it works. I get a valid JSON output.
curl -X POST 'http://localhost:8080/nai/v1/chat/completions'\
-H 'Content-Type: application/json'\
-H 'Accept: application/json'\
-d '{"model":"test","messages":[{"role":"user","content":"hello"}],"stream":false}' -H 'Authorization: Bearer xxxxxxxxxxxxx'{"id":"bd51df24-b616-4e5e-92b3-e57fc0f10178","object":"chat.completion","created":1761125357,"model":"test","choices":[{"index":0,"message":{"role":"assistant","content":"Hello! How can I help you today? If you have any questions or topics you'd like to discuss, feel free to ask. If you're just saying hi, then hello to you too! Have a great day! :)"},"finish_reason":"stop","content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"usage":{"prompt_tokens":5,"completion_tokens":50,"total_tokens":55,"prompt_tokens_details":null,"completion_tokens_details":null},"system_fingerprint":"3.3.4-native"}
In the Nutanix AI pod you can see that the request was successfully processed 2025-10-22T09:31:15.443638Z INFO chat_completions{parameters="GenerateParameters { best_of: None, temperature: None, repetition_penalty: None, frequency_penalty: None, top_k: None, top_p: None, typical_p: None, do_sample: true, max_new_tokens: None, return_full_text: None, stop: [], truncate: None, watermark: false, details: true, decoder_input_details: false, seed: None, top_n_tokens: None, grammar: None, adapter_id: None }" total_time="1.443721469s" validation_time="240.859µs" queue_time="60.248µs" inference_time="1.443420479s" time_per_token="21.226771ms" seed="Some(9205716254051098609)"}: text_generation_router::server: router/src/server.rs:637: Success
Additional Information
No response
Originally created by @arno4000 on GitHub (Oct 22, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/18512
### Check Existing Issues
- [x] I have searched for any existing and/or related issues.
- [x] I have searched for any existing and/or related discussions.
- [x] I am using the latest version of Open WebUI.
### Installation Method
Other
### Open WebUI Version
0.6.34
### Ollama Version (if applicable)
_No response_
### Operating System
k8s v1.33.4
### Browser (if applicable)
_No response_
### Confirmation
- [x] I have read and followed all instructions in `README.md`.
- [x] I am using the latest version of **both** Open WebUI and Ollama.
- [x] I have included the browser console logs.
- [x] I have included the Docker container logs.
- [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.**
- [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
- [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps:
- Start with the initial platform/version/OS and dependencies used,
- Specify exact install/launch/configure commands,
- List URLs visited, user input (incl. example values/emails/passwords if needed),
- Describe all options and toggles enabled or changed,
- Include any files or environmental changes,
- Identify the expected and actual result at each stage,
- Ensure any reasonably skilled user can follow and hit the same issue.
### Expected Behavior
I want to use Nutanix AI with Open Web UI
### Actual Behavior
I get the following error:
`2025-10-22 11:23:37.811 | ERROR | open_webui.routers.openai:generate_chat_completion:961 - Expecting value: line 1 column 1 (char 0)`
When i execute the request to v1/chat/completions via curl, it works. I get a valid JSON output.
```bash
curl -X POST 'http://localhost:8080/nai/v1/chat/completions' \
-H 'Content-Type: application/json' \
-H 'Accept: application/json' \
-d '{"model":"test","messages":[{"role":"user","content":"hello"}],"stream":false}' -H 'Authorization: Bearer xxxxxxxxxxxxx'
{"id":"bd51df24-b616-4e5e-92b3-e57fc0f10178","object":"chat.completion","created":1761125357,"model":"test","choices":[{"index":0,"message":{"role":"assistant","content":"Hello! How can I help you today? If you have any questions or topics you'd like to discuss, feel free to ask. If you're just saying hi, then hello to you too! Have a great day! :)"},"finish_reason":"stop","content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"usage":{"prompt_tokens":5,"completion_tokens":50,"total_tokens":55,"prompt_tokens_details":null,"completion_tokens_details":null},"system_fingerprint":"3.3.4-native"}
```
with stream turned on:
```bash
data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"content":" your","role":"assistant"},"finish_reason":null,"content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"}
data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"content":" day","role":"assistant"},"finish_reason":null,"content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"}
data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"content":"!","role":"assistant"},"finish_reason":null,"content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"}
data: {"id":"c24a3a23-fd67-4b36-92d4-fb0281653660","object":"chat.completion.chunk","created":1761125548,"model":"test","choices":[{"index":0,"delta":{"role":"assistant"},"finish_reason":"stop","content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false},"jailbreak":{"filtered":false,"detected":false},"profanity":{"filtered":false,"detected":false}}}],"system_fingerprint":"3.3.4-native"}
data: [DONE]
```
### Steps to Reproduce
1. Install Open WebUI with Helm
2. Try to connect Nutanix AI to Open WebUI
3. Get the above mentioned error
### Logs & Screenshots
`2025-10-22 11:23:37.811 | ERROR | open_webui.routers.openai:generate_chat_completion:961 - Expecting value: line 1 column 1 (char 0)`
In the Nutanix AI pod you can see that the request was successfully processed
`2025-10-22T09:31:15.443638Z INFO chat_completions{parameters="GenerateParameters { best_of: None, temperature: None, repetition_penalty: None, frequency_penalty: None, top_k: None, top_p: None, typical_p: None, do_sample: true, max_new_tokens: None, return_full_text: None, stop: [], truncate: None, watermark: false, details: true, decoder_input_details: false, seed: None, top_n_tokens: None, grammar: None, adapter_id: None }" total_time="1.443721469s" validation_time="240.859µs" queue_time="60.248µs" inference_time="1.443420479s" time_per_token="21.226771ms" seed="Some(9205716254051098609)"}: text_generation_router::server: router/src/server.rs:637: Success`
### Additional Information
_No response_
GiteaMirror
added the bug label 2026-05-13 05:32:28 -05:00
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @arno4000 on GitHub (Oct 22, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/18512
Check Existing Issues
Installation Method
Other
Open WebUI Version
0.6.34
Ollama Version (if applicable)
No response
Operating System
k8s v1.33.4
Browser (if applicable)
No response
Confirmation
README.md.Expected Behavior
I want to use Nutanix AI with Open Web UI
Actual Behavior
I get the following error:
2025-10-22 11:23:37.811 | ERROR | open_webui.routers.openai:generate_chat_completion:961 - Expecting value: line 1 column 1 (char 0)When i execute the request to v1/chat/completions via curl, it works. I get a valid JSON output.
with stream turned on:
Steps to Reproduce
Logs & Screenshots
2025-10-22 11:23:37.811 | ERROR | open_webui.routers.openai:generate_chat_completion:961 - Expecting value: line 1 column 1 (char 0)In the Nutanix AI pod you can see that the request was successfully processed
2025-10-22T09:31:15.443638Z INFO chat_completions{parameters="GenerateParameters { best_of: None, temperature: None, repetition_penalty: None, frequency_penalty: None, top_k: None, top_p: None, typical_p: None, do_sample: true, max_new_tokens: None, return_full_text: None, stop: [], truncate: None, watermark: false, details: true, decoder_input_details: false, seed: None, top_n_tokens: None, grammar: None, adapter_id: None }" total_time="1.443721469s" validation_time="240.859µs" queue_time="60.248µs" inference_time="1.443420479s" time_per_token="21.226771ms" seed="Some(9205716254051098609)"}: text_generation_router::server: router/src/server.rs:637: SuccessAdditional Information
No response
@arno4000 commented on GitHub (Oct 22, 2025):
Edit: Nutanix AI is based on TGI from Huggingface