mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 02:48:13 -05:00
[GH-ISSUE #2825] feat: tools (open webui native python function calling) #13028
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#13028
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @tjbck on GitHub (Jun 4, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/2825
#798 #2175
@IIPedro commented on GitHub (Jun 10, 2024):
Regarding non-conversational tasks such as tool usage, it would be interesting to force JSON usage. Since instruct models are fine-tuned towards conversation, it's hard to get proper responses related to feature extraction and arbitrary choices by LLMs. Libraries such as Ollama provide the option for models to answer in JSON with a provided schema. These features use GBNF (refer to llama.cpp docs) in order to restrict grammar, making JSON responses very efficient, or at least more efficient than prompting the LLM to do so. I believe this will be important, especially towards tool usage, but it can also be used in query and title generation.