[PR #2556] Add: Truss for model serving #1874

New Issue

GiteaMirror · 2025-11-06T13:24:56-06:00

GiteaMirror commented

2025-11-06 13:24:56 -06:00

📋 Pull Request Information

Original PR: https://github.com/vinta/awesome-python/pull/2556
Author: @philipkiely-baseten
Created: 1/24/2024
Status: 🔄 Open

Base: master ← Head: master

📝 Commits (1)

2ae8f4c Add: Truss for model serving

📊 Changes

1 file changed (+1 additions, -0 deletions)

View changed files

📝 README.md (+1 -0)

📄 Description

What is this Python project?

Truss is an open source model packaging framework for specifying a model server for an ML model from generative models like Mistral to data science models using tools like XGBoost.

What's the difference between this Python project and similar ones?

Truss is agnostic toward model serving engine (VLLM, TRT-LLM, TGI, etc), model framework (transformers, diffusors, data science frameworks like XGBoost), and i/o spec, offering substantial flexibility and interoperability with other open source tools. As a pure Python tool, it does not require local Docker like most model serving frameworks.

--

Anyone who agrees with this pull request could submit an Approve review to it.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/vinta/awesome-python/pull/2556 **Author:** [@philipkiely-baseten](https://github.com/philipkiely-baseten) **Created:** 1/24/2024 **Status:** 🔄 Open **Base:** `master` ← **Head:** `master` --- ### 📝 Commits (1) - [`2ae8f4c`](https://github.com/vinta/awesome-python/commit/2ae8f4c4b91ad17a09f4aa1014fc7f0005c21a44) Add: Truss for model serving ### 📊 Changes **1 file changed** (+1 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `README.md` (+1 -0) </details> ### 📄 Description ## What is this Python project? Truss is an open source model packaging framework for specifying a model server for an ML model from generative models like Mistral to data science models using tools like XGBoost. ## What's the difference between this Python project and similar ones? Truss is agnostic toward model serving engine (VLLM, TRT-LLM, TGI, etc), model framework (transformers, diffusors, data science frameworks like XGBoost), and i/o spec, offering substantial flexibility and interoperability with other open source tools. As a pure Python tool, it does not require local Docker like most model serving frameworks. -- Anyone who agrees with this pull request could submit an *Approve* review to it. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

GiteaMirror added the pull-request label 2025-11-06 13:24:56 -06:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/awesome-python#1874