[PR #2807] [CLOSED] Adds RamaLama #4168

New Issue

GiteaMirror · 2026-04-15T09:57:52-05:00

GiteaMirror commented

2026-04-15 09:57:52 -05:00

📋 Pull Request Information

Original PR: https://github.com/vinta/awesome-python/pull/2807
Author: @ieaves
Created: 11/24/2025
Status: ❌ Closed

Base: master ← Head: master

📝 Commits (1)

9a2e171 adds ramalama

📊 Changes

1 file changed (+1 additions, -0 deletions)

View changed files

📝 README.md (+1 -0)

📄 Description

What is this Python project?

RamaLama is an open-source CLI tool and runtime helper that simplifies running inference over AI models by leveraging container-based workflows. It treats models similarly to container images: you can pull models from various registries, run them in containers (with the correct runtime for your hardware), serve them via REST or chat interfaces, and manage them with familiar container commands.
GitHub

Key features:

Automatically detect available hardware (CPU, NVIDIA/AMD/Intel/M1 GPUs) and select the correct container image for runtime.
Support for multiple model “transports” (registry types) including Hugging Face, ModelScope, Ollama, generic OCI registries.
Commands to pull, push, list, run, serve, convert, benchmark models (e.g., ramalama run, ramalama pull, ramalama serve).
Secure defaults: run containers rootless, mount model in read-only mode, disable network by default, drop Linux capabilities.
Transparent container-engine usage: defaults to Podman (or Docker), hides much of the host configuration burden.
Enables lightweight “chatbot” or REST API serving of local models using container orchestration rather than full infrastructure.

What's the difference between this Python project and similar ones?

RamaLama differs from projects like Ollama and other local-model runners by being container-native, registry-agnostic, and runtime-agnostic. Instead of shipping a bespoke runtime, RamaLama orchestrates OCI containers that encapsulate llama.cpp, vLLM, TensorRT-LLM, or any other backend, and it auto-selects the correct image for your hardware (CPU, CUDA, ROCm, Metal, etc.). Because models are treated as OCI “transports,” it can pull from Hugging Face, ModelScope, generic registries, or Ollama itself using one interface. It also runs everything with hardened defaults (rootless, network-off, capability-dropped).

--

Anyone who agrees with this pull request could submit an Approve review to it.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/vinta/awesome-python/pull/2807 **Author:** [@ieaves](https://github.com/ieaves) **Created:** 11/24/2025 **Status:** ❌ Closed **Base:** `master` ← **Head:** `master` --- ### 📝 Commits (1) - [`9a2e171`](https://github.com/vinta/awesome-python/commit/9a2e17153217c3af60d953e111b811d969812ba6) adds ramalama ### 📊 Changes **1 file changed** (+1 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `README.md` (+1 -0) </details> ### 📄 Description ## What is this Python project? RamaLama is an open-source CLI tool and runtime helper that simplifies running inference over AI models by leveraging container-based workflows. It treats models similarly to container images: you can pull models from various registries, run them in containers (with the correct runtime for your hardware), serve them via REST or chat interfaces, and manage them with familiar container commands. [GitHub](https://github.com/containers/ramalama) **Key features:** * Automatically detect available hardware (CPU, NVIDIA/AMD/Intel/M1 GPUs) and select the correct container image for runtime. * Support for multiple model “transports” (registry types) including Hugging Face, ModelScope, Ollama, generic OCI registries. * Commands to pull, push, list, run, serve, convert, benchmark models (e.g., ramalama run, ramalama pull, ramalama serve). * Secure defaults: run containers rootless, mount model in read-only mode, disable network by default, drop Linux capabilities. * Transparent container-engine usage: defaults to Podman (or Docker), hides much of the host configuration burden. * Enables lightweight “chatbot” or REST API serving of local models using container orchestration rather than full infrastructure. ## What's the difference between this Python project and similar ones? RamaLama differs from projects like Ollama and other local-model runners by being container-native, registry-agnostic, and runtime-agnostic. Instead of shipping a bespoke runtime, RamaLama orchestrates OCI containers that encapsulate llama.cpp, vLLM, TensorRT-LLM, or any other backend, and it auto-selects the correct image for your hardware (CPU, CUDA, ROCm, Metal, etc.). Because models are treated as OCI “transports,” it can pull from Hugging Face, ModelScope, generic registries, or Ollama itself using one interface. It also runs everything with hardened defaults (rootless, network-off, capability-dropped). -- Anyone who agrees with this pull request could submit an *Approve* review to it. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

GiteaMirror added the pull-request label 2026-04-15 09:57:52 -05:00

GiteaMirror closed this issue

2026-04-15 09:57:53 -05:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/awesome-python#4168