[PR #7262] Expose GPU and basic system info #59061

Open
opened 2026-04-29 13:56:25 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/7262
Author: @dhiltgen
Created: 10/18/2024
Status: 🔄 Open

Base: mainHead: info_ux


📝 Commits (2)

📊 Changes

5 files changed (+351 additions, -0 deletions)

View changed files

📝 api/client.go (+9 -0)
📝 api/types.go (+81 -0)
📝 cmd/cmd.go (+9 -0)
cmd/info.go (+186 -0)
📝 server/routes.go (+66 -0)

📄 Description

This adds a new API and CLI UX to expose some basic information about the system.

Example CLI output:

% ollama info
Client:
 Version:       0.0.0
 Configuration: /Users/daniel/.ollama
 Connection:    http://localhost:11434

Server:
 Version: 0.3.13-13-g436602d
 Models:
  Store:           /Users/daniel/.ollama/models
  Downloaded:      41
  Filesystem Used: 475.8 GiB
  Running:         0
  VRAM Used:       0 B
 Compute:
  Available Runners: cpu, cpu_avx, cpu_avx2,
                      cuda_v11, cuda_v12, rocm
  System:
   CPU Cores:    16
   Total Memory: 62.6 GiB
   Free Memory:  60.9 GiB
   Free Swap:    7.5 GiB
  Supported GPUs:
   cuda_v12 GPU-19fc4f1e-fbcc-de33-f14a-ae21199420b6:
    Name:         NVIDIA GeForce RTX 3060
    Total Memory: 11.8 GiB
    Free Memory:  11.6 GiB
    Compute:      8.6
    Driver:       12.4

Fixes #7180
Fixes #3822


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/7262 **Author:** [@dhiltgen](https://github.com/dhiltgen) **Created:** 10/18/2024 **Status:** 🔄 Open **Base:** `main` ← **Head:** `info_ux` --- ### 📝 Commits (2) - [`b87f6f2`](https://github.com/ollama/ollama/commit/b87f6f2a37b75363ac1d4a318325f925a84e5f67) Wire up API for info UX - [`2fd7079`](https://github.com/ollama/ollama/commit/2fd7079a006d338486fd16757e0410dc18b004ea) Add CLI for info command ### 📊 Changes **5 files changed** (+351 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `api/client.go` (+9 -0) 📝 `api/types.go` (+81 -0) 📝 `cmd/cmd.go` (+9 -0) ➕ `cmd/info.go` (+186 -0) 📝 `server/routes.go` (+66 -0) </details> ### 📄 Description This adds a new API and CLI UX to expose some basic information about the system. Example CLI output: ``` % ollama info Client: Version: 0.0.0 Configuration: /Users/daniel/.ollama Connection: http://localhost:11434 Server: Version: 0.3.13-13-g436602d Models: Store: /Users/daniel/.ollama/models Downloaded: 41 Filesystem Used: 475.8 GiB Running: 0 VRAM Used: 0 B Compute: Available Runners: cpu, cpu_avx, cpu_avx2, cuda_v11, cuda_v12, rocm System: CPU Cores: 16 Total Memory: 62.6 GiB Free Memory: 60.9 GiB Free Swap: 7.5 GiB Supported GPUs: cuda_v12 GPU-19fc4f1e-fbcc-de33-f14a-ae21199420b6: Name: NVIDIA GeForce RTX 3060 Total Memory: 11.8 GiB Free Memory: 11.6 GiB Compute: 8.6 Driver: 12.4 ``` Fixes #7180 Fixes #3822 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-29 13:56:25 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#59061