[PR #4697] [CLOSED] [Docs]: Add doc for Monitoring (Application side) #58262

Closed
opened 2026-04-29 13:04:59 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/4697
Author: @amanagarwal042
Created: 5/29/2024
Status: Closed

Base: mainHead: main


📝 Commits (1)

📊 Changes

1 file changed (+46 additions, -0 deletions)

View changed files

docs/monitoring.md (+46 -0)

📄 Description

This PR adds doc for monitoring the Ollama based Application. This uses OpenLIT which is essentially just a wrapper around OpenTelemetry providing one-line monitoring (traces and metrics). OpenLIT works by wrapping around the chat, generate and embeddings functions in the ollama python sdk, collects the request and response metadata and generates traces and metrics based on the collected information. This is pretty useful for people trying to debug their LLM responses overtime, and understand performance metrics like Latency or Token usage.

OpenLIT SDK is completly vendor-neutral(as its based on OpenTelemetry) and allows users to visualize these traces and metrics in popular observability tools like Grafana, Datadog etc


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/4697 **Author:** [@amanagarwal042](https://github.com/amanagarwal042) **Created:** 5/29/2024 **Status:** ❌ Closed **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (1) - [`abe628d`](https://github.com/ollama/ollama/commit/abe628d8ab202a9cbfe5f2b850262362cee266f9) Create monitoring.md ### 📊 Changes **1 file changed** (+46 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `docs/monitoring.md` (+46 -0) </details> ### 📄 Description This PR adds doc for monitoring the Ollama based Application. This uses OpenLIT which is essentially just a wrapper around OpenTelemetry providing one-line monitoring (traces and metrics). OpenLIT works by wrapping around the chat, generate and embeddings functions in the ollama python sdk, collects the request and response metadata and generates traces and metrics based on the collected information. This is pretty useful for people trying to debug their LLM responses overtime, and understand performance metrics like Latency or Token usage. OpenLIT SDK is completly vendor-neutral(as its based on OpenTelemetry) and allows users to visualize these traces and metrics in popular observability tools like Grafana, Datadog etc --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-29 13:04:59 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#58262