[PR #15193] Claude/pending feature details 5 id7b #61764

Open
opened 2026-04-29 16:47:07 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/15193
Author: @DeerBear
Created: 4/1/2026
Status: 🔄 Open

Base: mainHead: claude/pending-feature-details-5Id7b


📝 Commits (10+)

  • 1187064 Update README.md
  • b1d2ca8 Merge remote-tracking branch 'upstream/main'
  • 0d65bac feat: add Geometric KAN attention with online shadow training
  • 8aad5e0 fix: numerical stability + comprehensive KAN test suite
  • dc97708 feat: replace SGD with Adam optimizer for KAN training
  • 27a4ebe feat: add Phase 2 self-evolution — KAN improves beyond softmax at inference time
  • b2e4783 fix: critical bugs in KAN attention — GGML lazy eval, heads dimension, thread safety
  • a0329e8 fix: effective scale must be relative to graduation slope, not absolute
  • 45f415c feat: comprehensive integration tests for full KAN lifecycle
  • 2bd762d feat: dynamic multi-head cooperative KAN — MoE for the activation function

📊 Changes

18 files changed (+4304 additions, -17 deletions)

View changed files

📝 .gitattributes (+1 -0)
Dockerfile.kan-demo (+79 -0)
📝 envconfig/config.go (+12 -0)
📝 kvcache/causal_test.go (+3 -2)
📝 ml/backend.go (+10 -0)
📝 ml/backend/ggml/ggml.go (+13 -0)
📝 ml/nn/attention.go (+235 -14)
ml/nn/kan/bspline.go (+162 -0)
ml/nn/kan/coefficients.go (+205 -0)
ml/nn/kan/config.go (+109 -0)
ml/nn/kan/integration_test.go (+486 -0)
ml/nn/kan/kan.go (+222 -0)
ml/nn/kan/kan_test.go (+1321 -0)
ml/nn/kan/serialize.go (+195 -0)
ml/nn/kan/shadow.go (+675 -0)
📝 runner/ollamarunner/runner.go (+57 -1)
scripts/kan-demo.sh (+356 -0)
scripts/kan-test-prompts.md (+163 -0)

📄 Description

No description provided


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/15193 **Author:** [@DeerBear](https://github.com/DeerBear) **Created:** 4/1/2026 **Status:** 🔄 Open **Base:** `main` ← **Head:** `claude/pending-feature-details-5Id7b` --- ### 📝 Commits (10+) - [`1187064`](https://github.com/ollama/ollama/commit/1187064e214d87dbc192f1a7a498a185447428da) Update README.md - [`b1d2ca8`](https://github.com/ollama/ollama/commit/b1d2ca86a2cdf29e4334c2cec36e6ccab13896a9) Merge remote-tracking branch 'upstream/main' - [`0d65bac`](https://github.com/ollama/ollama/commit/0d65bac4df1b6f61e0ef56f29dd9fd16abd771f9) feat: add Geometric KAN attention with online shadow training - [`8aad5e0`](https://github.com/ollama/ollama/commit/8aad5e038fe387053831ddade86a2bdc08fade18) fix: numerical stability + comprehensive KAN test suite - [`dc97708`](https://github.com/ollama/ollama/commit/dc97708e6adba73b1966dc8a379a8453b2b2c14c) feat: replace SGD with Adam optimizer for KAN training - [`27a4ebe`](https://github.com/ollama/ollama/commit/27a4ebefcb5fad50a0b0b6a68109138e424432ab) feat: add Phase 2 self-evolution — KAN improves beyond softmax at inference time - [`b2e4783`](https://github.com/ollama/ollama/commit/b2e47836cd1794a64479bc1563fc1f035e593d89) fix: critical bugs in KAN attention — GGML lazy eval, heads dimension, thread safety - [`a0329e8`](https://github.com/ollama/ollama/commit/a0329e86e3a943beb9a48b72bc0a946b8308f551) fix: effective scale must be relative to graduation slope, not absolute - [`45f415c`](https://github.com/ollama/ollama/commit/45f415c1e5adff76a8824fde253d396456c12fa0) feat: comprehensive integration tests for full KAN lifecycle - [`2bd762d`](https://github.com/ollama/ollama/commit/2bd762dbca5add8f0b7a3303e68958be78c2c448) feat: dynamic multi-head cooperative KAN — MoE for the activation function ### 📊 Changes **18 files changed** (+4304 additions, -17 deletions) <details> <summary>View changed files</summary> 📝 `.gitattributes` (+1 -0) ➕ `Dockerfile.kan-demo` (+79 -0) 📝 `envconfig/config.go` (+12 -0) 📝 `kvcache/causal_test.go` (+3 -2) 📝 `ml/backend.go` (+10 -0) 📝 `ml/backend/ggml/ggml.go` (+13 -0) 📝 `ml/nn/attention.go` (+235 -14) ➕ `ml/nn/kan/bspline.go` (+162 -0) ➕ `ml/nn/kan/coefficients.go` (+205 -0) ➕ `ml/nn/kan/config.go` (+109 -0) ➕ `ml/nn/kan/integration_test.go` (+486 -0) ➕ `ml/nn/kan/kan.go` (+222 -0) ➕ `ml/nn/kan/kan_test.go` (+1321 -0) ➕ `ml/nn/kan/serialize.go` (+195 -0) ➕ `ml/nn/kan/shadow.go` (+675 -0) 📝 `runner/ollamarunner/runner.go` (+57 -1) ➕ `scripts/kan-demo.sh` (+356 -0) ➕ `scripts/kan-test-prompts.md` (+163 -0) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-29 16:47:07 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#61764