Truss is an open source model packaging framework for specifying a model server for an ML model from generative models like Mistral to data science models using tools like XGBoost.
What's the difference between this Python project and similar ones?
Truss is agnostic toward model serving engine (VLLM, TRT-LLM, TGI, etc), model framework (transformers, diffusors, data science frameworks like XGBoost), and i/o spec, offering substantial flexibility and interoperability with other open source tools. As a pure Python tool, it does not require local Docker like most model serving frameworks.
--
Anyone who agrees with this pull request could submit an Approve review to it.
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.
## 📋 Pull Request Information
**Original PR:** https://github.com/vinta/awesome-python/pull/2556
**Author:** [@philipkiely-baseten](https://github.com/philipkiely-baseten)
**Created:** 1/24/2024
**Status:** ❌ Closed
**Base:** `master` ← **Head:** `master`
---
### 📝 Commits (1)
- [`2ae8f4c`](https://github.com/vinta/awesome-python/commit/2ae8f4c4b91ad17a09f4aa1014fc7f0005c21a44) Add: Truss for model serving
### 📊 Changes
**1 file changed** (+1 additions, -0 deletions)
<details>
<summary>View changed files</summary>
📝 `README.md` (+1 -0)
</details>
### 📄 Description
## What is this Python project?
Truss is an open source model packaging framework for specifying a model server for an ML model from generative models like Mistral to data science models using tools like XGBoost.
## What's the difference between this Python project and similar ones?
Truss is agnostic toward model serving engine (VLLM, TRT-LLM, TGI, etc), model framework (transformers, diffusors, data science frameworks like XGBoost), and i/o spec, offering substantial flexibility and interoperability with other open source tools. As a pure Python tool, it does not require local Docker like most model serving frameworks.
--
Anyone who agrees with this pull request could submit an *Approve* review to it.
---
<sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
📋 Pull Request Information
Original PR: https://github.com/vinta/awesome-python/pull/2556
Author: @philipkiely-baseten
Created: 1/24/2024
Status: ❌ Closed
Base:
master← Head:master📝 Commits (1)
2ae8f4cAdd: Truss for model serving📊 Changes
1 file changed (+1 additions, -0 deletions)
View changed files
📝
README.md(+1 -0)📄 Description
What is this Python project?
Truss is an open source model packaging framework for specifying a model server for an ML model from generative models like Mistral to data science models using tools like XGBoost.
What's the difference between this Python project and similar ones?
Truss is agnostic toward model serving engine (VLLM, TRT-LLM, TGI, etc), model framework (transformers, diffusors, data science frameworks like XGBoost), and i/o spec, offering substantial flexibility and interoperability with other open source tools. As a pure Python tool, it does not require local Docker like most model serving frameworks.
--
Anyone who agrees with this pull request could submit an Approve review to it.
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.