From af248d22cebc35db6b7140bf28c0c941069ea18c Mon Sep 17 00:00:00 2001 From: Vinta Chen Date: Wed, 21 Oct 2026 08:02:39 +0800 Subject: [PATCH] feat: add deepinfer to LLM Serving Co-Authored-By: Claude --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index dd45ae1d..db0ac398 100644 --- a/README.md +++ b/README.md @@ -175,6 +175,7 @@ _Libraries for building AI applications, LLM integrations, and autonomous agents - LLM Serving - [vllm](https://github.com/vllm-project/vllm) - A high-throughput and memory-efficient inference and serving engine for LLMs. - [sglang](https://github.com/sgl-project/sglang) - A high-performance serving framework for large language models and multimodal models. + - [deepinfer](https://github.com/deepseek-ai/DeepInfer) - DeepSeek's production inference engine for DeepSeek models, with MoE expert parallelism. - LLM Gateways - [litellm](https://github.com/BerriAI/litellm) - Call 100+ LLMs using OpenAI format. - Image and Video Generation