[GH-ISSUE #15638] [Feature]: Support encoder models #35734

Open
opened 2026-04-22 20:25:32 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @qdrddr on GitHub (Apr 17, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/15638

Support encoders, poolers, and structured prediction Small Language Models

ColPali/ColQwen/Nemotron
ColBERT, GLiNER, ModernColBERT

Encoders on a magnitude are much more efficient on tasks they can do best than the decoder models for tasks like and are perfect for self-hosting:

Schema extraction
NER, Entity Linking
Multimodal retrieval
Embeddings
Reranking

https://github.com/ddickmann/vllm-factory

Originally created by @qdrddr on GitHub (Apr 17, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/15638 Support encoders, poolers, and structured prediction Small Language Models ColPali/ColQwen/Nemotron ColBERT, GLiNER, ModernColBERT Encoders on a magnitude are much more efficient on tasks they can do best than the decoder models for tasks like and are perfect for self-hosting: Schema extraction NER, Entity Linking Multimodal retrieval Embeddings Reranking https://github.com/ddickmann/vllm-factory
GiteaMirror added the feature request label 2026-04-22 20:25:32 -05:00
Author
Owner

@PureBlissAK commented on GitHub (Apr 18, 2026):

🤖 Automated Triage & Analysis Report

Issue: #15638
Analyzed: 2026-04-18T18:19:41.660083

Analysis

  • Type: unknown
  • Severity: medium
  • Components: unknown

Implementation Plan

  • Effort: medium
  • Steps:

This issue has been triaged and marked for implementation.

<!-- gh-comment-id:4274305332 --> @PureBlissAK commented on GitHub (Apr 18, 2026): <!-- ollama-issue-orchestrator:v1 issue:15638 --> ## 🤖 Automated Triage & Analysis Report **Issue**: #15638 **Analyzed**: 2026-04-18T18:19:41.660083 ### Analysis - **Type**: unknown - **Severity**: medium - **Components**: unknown ### Implementation Plan - **Effort**: medium - **Steps**: *This issue has been triaged and marked for implementation.*
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#35734