enh: prompt evaluation playground #1475

Open
opened 2025-11-11 14:45:57 -06:00 by GiteaMirror · 1 comment
Owner

Originally created by @tjbck on GitHub (Jul 9, 2024).

Originally assigned to: @tjbck on GitHub.

simliar to https://www.youtube.com/watch?v=KIGBsQqZcNA

Originally created by @tjbck on GitHub (Jul 9, 2024). Originally assigned to: @tjbck on GitHub. simliar to https://www.youtube.com/watch?v=KIGBsQqZcNA
Author
Owner

@jtha commented on GitHub (Oct 25, 2024):

@tjbck a bit OOT but still related with playground, would be cool if there was a way to manage prompt versions through playground as well. or better yet, integrated to something like Langfuse which already has prompt versioning/evals in it. this would solve the issue with langfuse open source not having the playground feature as it is cloud only.

but would this be something useful for the general audience? i would like to take a stab at this but not sure if many people use langfuse in the first place.

@jtha commented on GitHub (Oct 25, 2024): @tjbck a bit OOT but still related with playground, would be cool if there was a way to manage prompt versions through playground as well. or better yet, integrated to something like Langfuse which already has prompt versioning/evals in it. this would solve the issue with langfuse open source not having the playground feature as it is cloud only. but would this be something useful for the general audience? i would like to take a stab at this but not sure if many people use langfuse in the first place.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#1475