[GH-ISSUE #14690] issue: RAG Prompt Template and System Prompt Not Working with Local Model in Open WebUI #104330

New Issue

2026-05-18T01:59:14-05:00

GiteaMirror commented

2026-05-18 01:59:14 -05:00

Originally created by @jian0927 on GitHub (Jun 5, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/14690

Check Existing Issues

I have searched the existing issues and discussions.
I am using the latest version of Open WebUI.

Installation Method

Pip Install

Open WebUI Version

0.6.13

Ollama Version (if applicable)

0.9.0

Operating System

ubuntu 22.04

Browser (if applicable)

No response

Confirmation

I have read and followed all instructions in README.md.
I am using the latest version of both Open WebUI and Ollama.
I have included the browser console logs.
I have included the Docker container logs.
I have provided every relevant configuration, setting, and environment variable used in my setup.
I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
Start with the initial platform/version/OS and dependencies used,
Specify exact install/launch/configure commands,
List URLs visited, user input (incl. example values/emails/passwords if needed),
Describe all options and toggles enabled or changed,
Include any files or environmental changes,
Identify the expected and actual result at each stage,
Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

The RAG prompt template should not take effect when building the knowledge base model using a local model.

Actual Behavior

When using a local model to build the knowledge base, I found that both the RAG prompt template and the system prompt were not taking effect. However, when using an API-connected model to build the knowledge base, the RAG prompt template worked as expected.

Steps to Reproduce

Install Conda on a clean Ubuntu 22.04 system, install open-webui via pip, and then install Ollama.
Start open-webui and Ollama.
Build knowledge base models using both the API method and the local Ollama method, and upload documents.
Found that the knowledge base model using the API method applied the RAG prompt template, but the one built with the local Ollama model did not use the RAG prompt template, and setting the system prompt also had no effect.

Logs & Screenshots

Since it's a remote setup, it's inconvenient to locate and check the relevant logs.

Additional Information

No response

Originally created by @jian0927 on GitHub (Jun 5, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/14690 ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Pip Install ### Open WebUI Version 0.6.13 ### Ollama Version (if applicable) 0.9.0 ### Operating System ubuntu 22.04 ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior The RAG prompt template should not take effect when building the knowledge base model using a local model. ### Actual Behavior When using a local model to build the knowledge base, I found that both the RAG prompt template and the system prompt were not taking effect. However, when using an API-connected model to build the knowledge base, the RAG prompt template worked as expected. ### Steps to Reproduce 1. Install Conda on a clean Ubuntu 22.04 system, install open-webui via pip, and then install Ollama. 2. Start open-webui and Ollama. 3. Build knowledge base models using both the API method and the local Ollama method, and upload documents. 4. Found that the knowledge base model using the API method applied the RAG prompt template, but the one built with the local Ollama model did not use the RAG prompt template, and setting the system prompt also had no effect. ### Logs & Screenshots Since it's a remote setup, it's inconvenient to locate and check the relevant logs. ### Additional Information _No response_

GiteaMirror added the bug label 2026-05-18 01:59:14 -05:00

GiteaMirror closed this issue

2026-05-18 01:59:16 -05:00

GiteaMirror commented

2026-05-18 01:59:17 -05:00

@tjbck commented on GitHub (Jun 5, 2025):

Unable to understand this post, could you provide more extensive details?

@tjbck commented on GitHub (Jun 5, 2025): Unable to understand this post, could you provide more extensive details?

Sign in to join this conversation.

Branches Tags

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#104330