mirror of
https://github.com/Shubhamsaboo/awesome-llm-apps.git
synced 2026-07-15 15:03:51 -05:00
use llama.cpp instead of ollama #27
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @scalar27 on GitHub (Jan 1, 2025).
What would be involved in getting some of these apps, e.g., chat with pdf, to work with llama.cpp instead of ollama? I'm a big fan of llama.cpp (on a Mac). Thanks.
@Madhuvod commented on GitHub (Jan 1, 2025):
just a change in code of these llm provider tools, since ollama is a higher-level interface built on top of Llama.cpp, it isn't very hard - what project do you want support w llama.cpp? anything particular on your mind?
@scalar27 commented on GitHub (Jan 1, 2025):
I'd like to be able to use chat with X, and in particular, chat with PDF, using llama.cpp.