[PR #4886] [CLOSED] Add basic model test rigging #11611

Closed
opened 2026-04-12 23:33:34 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/4886
Author: @dhiltgen
Created: 6/7/2024
Status: Closed

Base: mainHead: model_testing


📝 Commits (1)

  • 92c0cc4 Add basic model test rigging

📊 Changes

6 files changed (+110 additions, -22 deletions)

View changed files

📝 integration/README.md (+9 -1)
📝 integration/llm_image_test.go (+19 -15)
integration/model_test.go (+66 -0)
integration/models/.gitignore (+1 -0)
integration/models/README.md (+9 -0)
📝 integration/utils_test.go (+6 -6)

📄 Description

This will allow us to automate basic validation of models

To leverage this, populate one or more jsonl files in the directory, then

go test --tags=integration ./integration  -run TestModels -v

You can test specific models, for example:

go test --tags=integration ./integration  -run TestModels/llama3:70b -v

Consistent with the other integration tests, you can target an existing ollama instance (local or remote) with

OLLAMA_TEST_EXISTING=1 OLLAMA_HOST=myserver:11434 go test --tags=integration ./integration  -run TestModels -v

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/4886 **Author:** [@dhiltgen](https://github.com/dhiltgen) **Created:** 6/7/2024 **Status:** ❌ Closed **Base:** `main` ← **Head:** `model_testing` --- ### 📝 Commits (1) - [`92c0cc4`](https://github.com/ollama/ollama/commit/92c0cc4fb4b0bc9f4a70a2aeeab450f2bfb52b49) Add basic model test rigging ### 📊 Changes **6 files changed** (+110 additions, -22 deletions) <details> <summary>View changed files</summary> 📝 `integration/README.md` (+9 -1) 📝 `integration/llm_image_test.go` (+19 -15) ➕ `integration/model_test.go` (+66 -0) ➕ `integration/models/.gitignore` (+1 -0) ➕ `integration/models/README.md` (+9 -0) 📝 `integration/utils_test.go` (+6 -6) </details> ### 📄 Description This will allow us to automate basic validation of models To leverage this, populate one or more jsonl files in the directory, then ``` go test --tags=integration ./integration -run TestModels -v ``` You can test specific models, for example: ``` go test --tags=integration ./integration -run TestModels/llama3:70b -v ``` Consistent with the other integration tests, you can target an existing ollama instance (local or remote) with ``` OLLAMA_TEST_EXISTING=1 OLLAMA_HOST=myserver:11434 go test --tags=integration ./integration -run TestModels -v ``` --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-12 23:33:34 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#11611