[GH-ISSUE #6304] Chatting with document #14313

Closed
opened 2026-04-19 20:43:21 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @vampireprincess on GitHub (Oct 21, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/6304

Hi Open WebUI community,

I'm currently using a system with 8GB of VRAM and I'm looking for an uncensored model that is capable of chatting with documents effectively. Specifically, my goal is to:

Upload a 29-page document (created with the help of ChatGPT)
Have the model analyze the document and create a similar-length text with the same sections, but on a different topic.
ChatGPT did a perfect job with this, but due to its NSFW restrictions, it can’t handle more spicy content, which I need. I’ve tried a few models but haven’t found one that fits both my hardware limitations and use case.

Additionally, I’m planning to upgrade to a 16GB VRAM GPU soon and would like to know if that would better suit my goals. Could you kindly recommend a model that works well with both setups, or if the 16GB upgrade will significantly improve the ability to handle this task?

Originally created by @vampireprincess on GitHub (Oct 21, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/6304 Hi Open WebUI community, I'm currently using a system with 8GB of VRAM and I'm looking for an uncensored model that is capable of chatting with documents effectively. Specifically, my goal is to: Upload a 29-page document (created with the help of ChatGPT) Have the model analyze the document and create a similar-length text with the same sections, but on a different topic. ChatGPT did a perfect job with this, but due to its NSFW restrictions, it can’t handle more spicy content, which I need. I’ve tried a few models but haven’t found one that fits both my hardware limitations and use case. Additionally, I’m planning to upgrade to a 16GB VRAM GPU soon and would like to know if that would better suit my goals. Could you kindly recommend a model that works well with both setups, or if the 16GB upgrade will significantly improve the ability to handle this task?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#14313