[GH-ISSUE #5664] feat: Set stream capability per model (not global setting) #14072

Closed
opened 2026-04-19 20:33:41 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @juancarlosm on GitHub (Sep 24, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/5664

To make OpenAI o1 models to work you now you have to disable model stream globaly:

image

I think it will be better if we can set "stream" capability per model:

image

This way we can make it work and we don't loose stream capabilities for the rest of models that supports it

Originally created by @juancarlosm on GitHub (Sep 24, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/5664 To make OpenAI o1 models to work you now you have to disable model stream globaly: ![image](https://github.com/user-attachments/assets/e1f1ce0a-aa12-4bc3-9e32-55ce60c91966) I think it will be better if we can set "stream" capability per model: ![image](https://github.com/user-attachments/assets/856dfb0b-5366-4459-935b-58cbe53c34d6) This way we can make it work and we don't loose stream capabilities for the rest of models that supports it
Author
Owner

@tjbck commented on GitHub (Sep 24, 2024):

This feature has been added to 0.3.25

<!-- gh-comment-id:2371569017 --> @tjbck commented on GitHub (Sep 24, 2024): This feature has been added to 0.3.25
Author
Owner

@bgeneto commented on GitHub (Nov 3, 2024):

@tjbck How can we set stream to false programmatically via manyfold functions (even if the user set it to True)? Is there any way? I need this in order to provide image gen models...

<!-- gh-comment-id:2453511066 --> @bgeneto commented on GitHub (Nov 3, 2024): @tjbck How can we set stream to false programmatically via manyfold functions (even if the user set it to True)? Is there any way? I need this in order to provide image gen models...
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#14072