use llama.cpp instead of ollama #27

Closed
opened 2025-11-06 14:31:33 -06:00 by GiteaMirror · 2 comments
Owner

Originally created by @scalar27 on GitHub (Jan 1, 2025).

What would be involved in getting some of these apps, e.g., chat with pdf, to work with llama.cpp instead of ollama? I'm a big fan of llama.cpp (on a Mac). Thanks.

Originally created by @scalar27 on GitHub (Jan 1, 2025). What would be involved in getting some of these apps, e.g., chat with pdf, to work with llama.cpp instead of ollama? I'm a big fan of llama.cpp (on a Mac). Thanks.
Author
Owner

@Madhuvod commented on GitHub (Jan 1, 2025):

just a change in code of these llm provider tools, since ollama is a higher-level interface built on top of Llama.cpp, it isn't very hard - what project do you want support w llama.cpp? anything particular on your mind?

@Madhuvod commented on GitHub (Jan 1, 2025): just a change in code of these llm provider tools, since ollama is a higher-level interface built on top of Llama.cpp, it isn't very hard - what project do you want support w llama.cpp? anything particular on your mind?
Author
Owner

@scalar27 commented on GitHub (Jan 1, 2025):

I'd like to be able to use chat with X, and in particular, chat with PDF, using llama.cpp.

@scalar27 commented on GitHub (Jan 1, 2025): I'd like to be able to use chat with X, and in particular, chat with PDF, using llama.cpp.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/awesome-llm-apps#27