I have read and followed all the instructions provided in the README.md.
I am on the latest version of both Open WebUI and Ollama.
I have included the browser console logs.
I have included the Docker container logs.
I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.
Expected Behavior:
Function calling should work as expected even when using non-function calling model as an external models in Admin Panel - Settings - Interface - External Models.
Actual Behavior:
Function calling breaks when using a non-function calling model as an external model in Admin Panel - Settings - Interface - External Models.
Description
Bug Summary:
Function calling fails in Open WebUI when using external models that do not support function calling, despite the main model being capable of doing so.
The issue seems to be that the external models are being used to generate the function calling prompt AND calling the function, and if they do not support function calling, the entire process returns an error.
Reproduction Details
Steps to Reproduce:
Set up an external model in Admin Panel - Settings - Interface - External Models.
Use a non-function calling model as the external model.
Attempt to use function calling in the application.
Observe that function calling breaks and does not work as expected.
Logs and Screenshots
Screenshots/Screen Recordings (if applicable):
Originally created by @leanne3569 on GitHub (Sep 28, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/5776
# Bug Report
## Installation Method
Pip Installation
## Environment
- **Open WebUI Version:** v0.3.30
- **Operating System:** Windows 10
- **Browser (if applicable):** Firefox 130.0.1
**Confirmation:**
- [x] I have read and followed all the instructions provided in the README.md.
- [x] I am on the latest version of both Open WebUI and Ollama.
- [ ] I have included the browser console logs.
- [ ] I have included the Docker container logs.
- [x] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.
## Expected Behavior:
Function calling should work as expected even when using non-function calling model as an external models in Admin Panel - Settings - Interface - External Models.
## Actual Behavior:
Function calling breaks when using a non-function calling model as an external model in Admin Panel - Settings - Interface - External Models.
## Description
**Bug Summary:**
Function calling fails in Open WebUI when using external models that do not support function calling, despite the main model being capable of doing so.
The issue seems to be that the external models are being used to generate the function calling prompt AND calling the function, and if they do not support function calling, the entire process returns an error.
## Reproduction Details
**Steps to Reproduce:**
1. Set up an external model in Admin Panel - Settings - Interface - External Models.
2. Use a non-function calling model as the external model.
3. Attempt to use function calling in the application.
4. Observe that function calling breaks and does not work as expected.
## Logs and Screenshots
**Screenshots/Screen Recordings (if applicable):**
In retrospect, this also means that you can give function calling ability to non function calling model. Simply set up a function-calling model as an external model, and you can use a non-function-calling model as your main model. Just keep in mind that this approach has its pros and cons - but it can be a good option for some people.
<!-- gh-comment-id:2380380411 -->
@leanne3569 commented on GitHub (Sep 28, 2024):
In retrospect, this also means that you can give function calling ability to non function calling model. Simply set up a function-calling model as an external model, and you can use a non-function-calling model as your main model. Just keep in mind that this approach has its pros and cons - but it can be a good option for some people.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @leanne3569 on GitHub (Sep 28, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/5776
Bug Report
Installation Method
Pip Installation
Environment
Open WebUI Version: v0.3.30
Operating System: Windows 10
Browser (if applicable): Firefox 130.0.1
Confirmation:
Expected Behavior:
Function calling should work as expected even when using non-function calling model as an external models in Admin Panel - Settings - Interface - External Models.
Actual Behavior:
Function calling breaks when using a non-function calling model as an external model in Admin Panel - Settings - Interface - External Models.
Description
Bug Summary:
Function calling fails in Open WebUI when using external models that do not support function calling, despite the main model being capable of doing so.
The issue seems to be that the external models are being used to generate the function calling prompt AND calling the function, and if they do not support function calling, the entire process returns an error.
Reproduction Details
Steps to Reproduce:
Logs and Screenshots
Screenshots/Screen Recordings (if applicable):
@leanne3569 commented on GitHub (Sep 28, 2024):
In retrospect, this also means that you can give function calling ability to non function calling model. Simply set up a function-calling model as an external model, and you can use a non-function-calling model as your main model. Just keep in mind that this approach has its pros and cons - but it can be a good option for some people.