I am trying to use the ollama structured output generation (ollama added it on 6.th of december), that was announced in the [0.5.0] - 2024-12-25 version:
✅ Structured Output for Ollama: Pass structured data output directly to Ollama, unlocking new possibilities for streamlined automation and precise data handling.
I did not find the exact way to get a structured response in the documentation, but after updateing OpenWebUi, there is only one setting I found that looks like what I'm searching for: it is under Settings > General > Advanced Parameters > Request Mode (all the way at the bottom). If I switch it to "JSON", I think if somewhere this hsould be the option, but after selecting this the generation fails with a 400 error like this:
400: 1 validation error for GenerateChatCompletionForm
format
Input should be a valid dictionary [type=dict_type, input_value='json', input_type=str]
For further information visit https://errors.pydantic.dev/2.9/v/dict_type
Am I missing something, or is this option missing from the user interface? If I'm wrong can someone point me to the right direction?
Thanks!
Originally created by @HunorModli on GitHub (Jan 13, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/8515
Hi,
I am trying to use the ollama structured output generation (ollama added it on 6.th of december), that was announced in the [0.5.0] - 2024-12-25 version:
> ✅ Structured Output for Ollama: Pass structured data output directly to Ollama, unlocking new possibilities for streamlined automation and precise data handling.
I did not find the exact way to get a structured response in the documentation, but after updateing OpenWebUi, there is only one setting I found that looks like what I'm searching for: it is under Settings > General > Advanced Parameters > Request Mode (all the way at the bottom). If I switch it to "JSON", I think if somewhere this hsould be the option, but after selecting this the generation fails with a 400 error like this:
> 400: 1 validation error for GenerateChatCompletionForm
> format
> Input should be a valid dictionary [type=dict_type, input_value='json', input_type=str]
> For further information visit https://errors.pydantic.dev/2.9/v/dict_type
Am I missing something, or is this option missing from the user interface? If I'm wrong can someone point me to the right direction?
Thanks!
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @HunorModli on GitHub (Jan 13, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/8515
Hi,
I am trying to use the ollama structured output generation (ollama added it on 6.th of december), that was announced in the [0.5.0] - 2024-12-25 version:
I did not find the exact way to get a structured response in the documentation, but after updateing OpenWebUi, there is only one setting I found that looks like what I'm searching for: it is under Settings > General > Advanced Parameters > Request Mode (all the way at the bottom). If I switch it to "JSON", I think if somewhere this hsould be the option, but after selecting this the generation fails with a 400 error like this:
Am I missing something, or is this option missing from the user interface? If I'm wrong can someone point me to the right direction?
Thanks!
@tjbck commented on GitHub (Mar 28, 2025):
Addressed in dev
c137d3ad17, testing wanted here.