From 72469f9d7db0856edbef8cd2074712e9d92e1bbe Mon Sep 17 00:00:00 2001 From: Vinta Chen Date: Fri, 16 Oct 2026 17:25:14 +0800 Subject: [PATCH] feat: add llama-cpp-python to AI and Agents > Local LLM Inference Co-Authored-By: Claude --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 9855be08..065d7b0b 100644 --- a/README.md +++ b/README.md @@ -170,6 +170,7 @@ _Libraries for building AI applications, LLM integrations, and autonomous agents - [sentence-transformers](https://github.com/huggingface/sentence-transformers) - Compute embeddings, run retrieval, and rerank results with pretrained and fine-tuned models. - Local LLM Inference - [ollama](https://github.com/ollama/ollama-python) - Python client for Ollama, which downloads and runs open-weight LLMs locally. + - [llama-cpp-python](https://github.com/abetlen/llama-cpp-python) - Python bindings for llama.cpp, for running GGUF models locally. - [mlx-lm](https://github.com/ml-explore/mlx-lm) - Run and fine-tune large language models on Apple Silicon with MLX. - LLM Serving - [vllm](https://github.com/vllm-project/vllm) - A high-throughput and memory-efficient inference and serving engine for LLMs.