mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-16 23:21:44 -05:00
[PR #2001] [MERGED] feat: restrict title gen output to 50 tokens #7652
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
📋 Pull Request Information
Original PR: https://github.com/open-webui/open-webui/pull/2001
Author: @cheahjs
Created: 5/6/2024
Status: ✅ Merged
Merged: 5/6/2024
Merged by: @tjbck
Base:
dev← Head:feat/limit-title-gen-tokens📝 Commits (1)
b8c97fafeat: restrict title gen output to 50 tokens📊 Changes
2 files changed (+8 additions, -2 deletions)
View changed files
📝
src/lib/apis/ollama/index.ts(+5 -1)📝
src/lib/apis/openai/index.ts(+3 -1)📄 Description
Pull Request Checklist
Description
Specify a max output tokens of 50 for both Ollama and OpenAI when generating titles, so even if the model goes off the rails and generates a large chunk of text, it doesn't cost more than 50 tokens.
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.