I kindly request the addition of a repeat_half_life parameter, which would detect repetitions throughout the entire context. More recent and longer repetitions would be penalized more harshly than older and shorter ones.
Originally created by @Tuxaios on GitHub (Sep 19, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/5512
I kindly request the addition of a repeat_half_life parameter, which would detect repetitions throughout the entire context. More recent and longer repetitions would be penalized more harshly than older and shorter ones.
<!-- gh-comment-id:2360052505 -->
@Tuxaios commented on GitHub (Sep 19, 2024):
I encountered the same issue as described [here](https://github.com/ggerganov/llama.cpp/issues/787).
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @Tuxaios on GitHub (Sep 19, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/5512
I kindly request the addition of a repeat_half_life parameter, which would detect repetitions throughout the entire context. More recent and longer repetitions would be penalized more harshly than older and shorter ones.
@Tuxaios commented on GitHub (Sep 19, 2024):
I encountered the same issue as described here.