[GH-ISSUE #445] Talk to Document support #12060

New Issue

GiteaMirror · 2026-04-19T18:49:09-05:00

GiteaMirror commented

2026-04-19 18:49:09 -05:00

Originally created by @oliverbob on GitHub (Jan 10, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/445

Is your feature request related to a problem? Please describe.
I believe this one is similar to the create Modelfile feature.

Describe the solution you'd like
Its similar to the Add/create ModelFile feature in that we just first prepare a text file then upload it as a modelfile. Please see an alternative implementation below:

Describe alternatives you've considered

#!/bin/bash
sudo rm repo.md

# Prepend content to the repo.md file
echo "FROM dolphin-phi" >> ./repo.md
echo "PARAMETER temperature 1" >> ./repo.md
echo 'SYSTEM """' >> ./repo.md

# Concatenate all .md files into repo.md, arranged by numeric order
find ./ollama-webui -name "*.md" -print0 | sort -zV | xargs -0 cat >> ./repo.md

sed -i 's/#//g' ./repo.md

# Append content to the end of the repo.md file
echo '"""' >> ./repo.md

I then copied all contents of repo.md to the create Modelfile feature of the UI for admins. [And it works].

I have tested this on a very large text such as this KJV Markdown on little models like phi. However, Phi is disobedient to Biblical topics. It doesn't follow for some reason anything even if you add an entire Bible. I haven't tried it on other models though. But when I tried all other books or docs/md files that are non-Christian in context, it works for every model file that I create and man, its very, very accurate.

Other suggestions:

I also suggest that perhaps we can create a

UI_System_auto_suggest_prompt = "some prompt" that we can possibly integrate with the modelfile. Or even a separate file for that so it will not become a god-code.

Additional context
So, the point is, its good to see a feature that will allow admins to approve docs that users upload, while the admins themselves can upload docs.

So, since uploading documents will just mean "filter the text and append it to .md or Modelfile," when the user uploads such model, he is given four js prompts such as: Please enter 4 default prompts that you want your model to be asked about. Question/prompt 1,2,3,4 and essentially without going though Modelfiles>/Add/Create procedure.

I believe we can call it "Upload Document for inference."

What do you think?

Originally created by @oliverbob on GitHub (Jan 10, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/445 **Is your feature request related to a problem? Please describe.** I believe this one is similar to the create Modelfile feature. **Describe the solution you'd like** Its similar to the Add/create ModelFile feature in that we just first prepare a text file then upload it as a modelfile. Please see an alternative implementation below: **Describe alternatives you've considered** ``` #!/bin/bash sudo rm repo.md # Prepend content to the repo.md file echo "FROM dolphin-phi" >> ./repo.md echo "PARAMETER temperature 1" >> ./repo.md echo 'SYSTEM """' >> ./repo.md # Concatenate all .md files into repo.md, arranged by numeric order find ./ollama-webui -name "*.md" -print0 | sort -zV | xargs -0 cat >> ./repo.md sed -i 's/#//g' ./repo.md # Append content to the end of the repo.md file echo '"""' >> ./repo.md ``` I then copied all contents of repo.md to the create Modelfile feature of the UI for admins. [And it works]. I have tested this on a very large text such as this [KJV Markdown](https://github.com/arleym/kjv-markdown/blob/master/01%20-%20Genesis%20-%20KJV.md) on little models like phi. However, Phi is disobedient to Biblical topics. It doesn't follow for some reason anything even if you add an entire Bible. I haven't tried it on other models though. But when I tried all other books or docs/md files that are non-Christian in context, it works for every model file that I create and man, its very, very accurate. Other suggestions: I also suggest that perhaps we can create a UI_System_auto_suggest_prompt = "some prompt" that we can possibly integrate with the modelfile. Or even a separate file for that so it will not become a god-code. **Additional context** So, the point is, its good to see a feature that will allow admins to approve docs that users upload, while the admins themselves can upload docs. So, since uploading documents will just mean "filter the text and append it to .md or Modelfile," when the user uploads such model, he is given four js prompts such as: Please enter 4 default prompts that you want your model to be asked about. Question/prompt 1,2,3,4 and essentially without going though Modelfiles>/Add/Create procedure. I believe we can call it "Upload Document for inference." What do you think?

GiteaMirror closed this issue

2026-04-19 18:49:10 -05:00

GiteaMirror commented

2026-04-19 18:49:12 -05:00

@tjbck commented on GitHub (Jan 10, 2024):

Hi, thanks for the suggestion. I'll close this issue as not planned for now, it also seems like you're asking for multiple features in one and I'm not sure if I'm understanding everything you're suggesting. But feel free to make a demo for this feature and we'll decide whether to include it or not, Thanks!

@tjbck commented on GitHub (Jan 10, 2024): Hi, thanks for the suggestion. I'll close this issue as not planned for now, it also seems like you're asking for multiple features in one and I'm not sure if I'm understanding everything you're suggesting. But feel free to make a demo for this feature and we'll decide whether to include it or not, Thanks!

GiteaMirror referenced this issue

2026-04-19 22:22:16 -05:00

[GH-ISSUE #12060] issue: Exception in ASGI application #16456

GiteaMirror referenced this issue

2026-04-25 05:52:09 -05:00

[GH-ISSUE #12060] issue: Exception in ASGI application #31985

GiteaMirror referenced this issue

2026-05-05 17:10:22 -05:00

[GH-ISSUE #12060] issue: Exception in ASGI application #55122

Sign in to join this conversation.