[PR #3988] [MERGED] llm: dont cap context window limit to training context window #11350

Closed
opened 2026-04-12 23:28:28 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/3988
Author: @jmorganca
Created: 4/28/2024
Status: Merged
Merged: 4/29/2024
Merged by: @jmorganca

Base: mainHead: jmorganca/no-ctx-cap


📝 Commits (1)

  • 46cf555 llm: dont cap context window limit to training context window

📊 Changes

1 file changed (+1 additions, -2 deletions)

View changed files

📝 llm/server.go (+1 -2)

📄 Description

Some models such as the new Llama 3 8B context window fine tunes support larger context windows such as 128k, 256k. However, the "training" context window is still 8k. To avoid confusion, this change loosens the limit and logs a warning.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/3988 **Author:** [@jmorganca](https://github.com/jmorganca) **Created:** 4/28/2024 **Status:** ✅ Merged **Merged:** 4/29/2024 **Merged by:** [@jmorganca](https://github.com/jmorganca) **Base:** `main` ← **Head:** `jmorganca/no-ctx-cap` --- ### 📝 Commits (1) - [`46cf555`](https://github.com/ollama/ollama/commit/46cf555038364cf70941ccf4fdf9f4d177e04e65) llm: dont cap context window limit to training context window ### 📊 Changes **1 file changed** (+1 additions, -2 deletions) <details> <summary>View changed files</summary> 📝 `llm/server.go` (+1 -2) </details> ### 📄 Description Some models such as the new Llama 3 8B context window fine tunes support larger context windows such as 128k, 256k. However, the "training" context window is still 8k. To avoid confusion, this change loosens the limit and logs a warning. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-12 23:28:28 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#11350