[PR #7338] [MERGED] Better test and handle Unicode #12390

Closed
opened 2026-04-12 23:57:59 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/7338
Author: @jessegross
Created: 10/23/2024
Status: Merged
Merged: 10/29/2024
Merged by: @jessegross

Base: mainHead: jessegross/unicode


📝 Commits (2)

  • 81f089f runner.go: Better handle return NULL values from llama.cpp
  • 418cc23 tests: Add test for Unicode processing

📊 Changes

4 files changed (+55 additions, -14 deletions)

View changed files

📝 integration/basic_test.go (+18 -1)
📝 llama/llama.go (+20 -9)
📝 llama/runner/runner.go (+9 -2)
📝 llm/server.go (+8 -2)

📄 Description

Recent releases have hit Unicode bugs, which should be better tested. In addition, when we do have failures, we should handle them more gracefully.

This test currently fails on Windows (due to #7311) and passes on other platforms. Will hold this patch until the one fixing that is merged.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/7338 **Author:** [@jessegross](https://github.com/jessegross) **Created:** 10/23/2024 **Status:** ✅ Merged **Merged:** 10/29/2024 **Merged by:** [@jessegross](https://github.com/jessegross) **Base:** `main` ← **Head:** `jessegross/unicode` --- ### 📝 Commits (2) - [`81f089f`](https://github.com/ollama/ollama/commit/81f089f77c2374eeedfdbf1729690ad073561134) runner.go: Better handle return NULL values from llama.cpp - [`418cc23`](https://github.com/ollama/ollama/commit/418cc23e36837a39281c51603113ae4088865f8e) tests: Add test for Unicode processing ### 📊 Changes **4 files changed** (+55 additions, -14 deletions) <details> <summary>View changed files</summary> 📝 `integration/basic_test.go` (+18 -1) 📝 `llama/llama.go` (+20 -9) 📝 `llama/runner/runner.go` (+9 -2) 📝 `llm/server.go` (+8 -2) </details> ### 📄 Description Recent releases have hit Unicode bugs, which should be better tested. In addition, when we do have failures, we should handle them more gracefully. This test currently fails on Windows (due to #7311) and passes on other platforms. Will hold this patch until the one fixing that is merged. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-12 23:57:59 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#12390