Converting to GGUF doesn't always work always for safetensors. Seeing support for booth moondream and tinyllava would be really great then for this great UI, at least for vision related tasks.
Thanks.
Originally created by @oliverbob on GitHub (Feb 21, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/823
Converting to GGUF doesn't always work always for safetensors. Seeing support for booth moondream and tinyllava would be really great then for this great UI, at least for vision related tasks.
Thanks.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @oliverbob on GitHub (Feb 21, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/823
Converting to GGUF doesn't always work always for safetensors. Seeing support for booth moondream and tinyllava would be really great then for this great UI, at least for vision related tasks.
Thanks.