[GH-ISSUE #6230] Add Generate Embedding for Sparse vector #50406

Open
opened 2026-04-28 15:38:37 -05:00 by GiteaMirror · 27 comments
Owner

Originally created by @shashade2012 on GitHub (Aug 7, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6230

I find ollama already support bge-m3,
because bge-m3 can generate sparse vector. Is there any way for generate sparse embeddings?

Originally created by @shashade2012 on GitHub (Aug 7, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6230 I find ollama already support bge-m3, because bge-m3 can generate sparse vector. Is there any way for generate sparse embeddings?
GiteaMirror added the feature request label 2026-04-28 15:38:37 -05:00
Author
Owner

@dbc-2024 commented on GitHub (Aug 8, 2024):

+1

<!-- gh-comment-id:2275046617 --> @dbc-2024 commented on GitHub (Aug 8, 2024): +1
Author
Owner

@davide445 commented on GitHub (Aug 14, 2024):

+1

<!-- gh-comment-id:2289308989 --> @davide445 commented on GitHub (Aug 14, 2024): +1
Author
Owner

@roylknghv commented on GitHub (Aug 20, 2024):

+1

<!-- gh-comment-id:2298470040 --> @roylknghv commented on GitHub (Aug 20, 2024): +1
Author
Owner

@sondin commented on GitHub (Nov 14, 2024):

+1

<!-- gh-comment-id:2476696613 --> @sondin commented on GitHub (Nov 14, 2024): +1
Author
Owner

@Golden00885 commented on GitHub (Feb 10, 2025):

+1

<!-- gh-comment-id:2648552721 --> @Golden00885 commented on GitHub (Feb 10, 2025): +1
Author
Owner

@halogencookies commented on GitHub (Feb 18, 2025):

+1

<!-- gh-comment-id:2666988979 --> @halogencookies commented on GitHub (Feb 18, 2025): +1
Author
Owner

@zhengtingxue commented on GitHub (Mar 6, 2025):

+1

<!-- gh-comment-id:2703032484 --> @zhengtingxue commented on GitHub (Mar 6, 2025): +1
Author
Owner

@pawasthy commented on GitHub (Mar 18, 2025):

+1

<!-- gh-comment-id:2733677296 --> @pawasthy commented on GitHub (Mar 18, 2025): +1
Author
Owner

@AOShei commented on GitHub (Apr 4, 2025):

+1

<!-- gh-comment-id:2779095192 --> @AOShei commented on GitHub (Apr 4, 2025): +1
Author
Owner

@wangle201210 commented on GitHub (Apr 29, 2025):

+1

<!-- gh-comment-id:2837319157 --> @wangle201210 commented on GitHub (Apr 29, 2025): +1
Author
Owner

@FlorinCiobotea commented on GitHub (Jun 12, 2025):

+1

<!-- gh-comment-id:2965766123 --> @FlorinCiobotea commented on GitHub (Jun 12, 2025): +1
Author
Owner

@spencer-crook commented on GitHub (Jun 16, 2025):

+1

<!-- gh-comment-id:2977695598 --> @spencer-crook commented on GitHub (Jun 16, 2025): +1
Author
Owner

@MrDoe commented on GitHub (Jun 24, 2025):

+1

<!-- gh-comment-id:3000092549 --> @MrDoe commented on GitHub (Jun 24, 2025): +1
Author
Owner

@shanbady commented on GitHub (Jul 1, 2025):

+1

<!-- gh-comment-id:3021410632 --> @shanbady commented on GitHub (Jul 1, 2025): +1
Author
Owner

@appyhdu commented on GitHub (Aug 12, 2025):

+1

<!-- gh-comment-id:3179666233 --> @appyhdu commented on GitHub (Aug 12, 2025): +1
Author
Owner

@Haruno19 commented on GitHub (Aug 14, 2025):

+1

<!-- gh-comment-id:3187285154 --> @Haruno19 commented on GitHub (Aug 14, 2025): +1
Author
Owner

@jaredmcqueen commented on GitHub (Aug 17, 2025):

+1

<!-- gh-comment-id:3194589523 --> @jaredmcqueen commented on GitHub (Aug 17, 2025): +1
Author
Owner

@roytmana commented on GitHub (Sep 30, 2025):

any update on sparse embeddings support? it would have been an extremely useful feature!

<!-- gh-comment-id:3354073374 --> @roytmana commented on GitHub (Sep 30, 2025): any update on sparse embeddings support? it would have been an extremely useful feature!
Author
Owner

@afrianluthfan commented on GitHub (Oct 31, 2025):

+1

<!-- gh-comment-id:3471689965 --> @afrianluthfan commented on GitHub (Oct 31, 2025): +1
Author
Owner

@qu-en commented on GitHub (Nov 5, 2025):

+1

<!-- gh-comment-id:3490691925 --> @qu-en commented on GitHub (Nov 5, 2025): +1
Author
Owner

@Lords08 commented on GitHub (Dec 24, 2025):

Any update on sparse embeddings support?
I have read the BGE-M3 documentation, this model support Colbert Multi Vector Embeddings too.
It is very convenient if one api call to Ollama, can generate 3 type vectors at once (Dense, Sparse, and Colbert)!

<!-- gh-comment-id:3688591247 --> @Lords08 commented on GitHub (Dec 24, 2025): Any update on sparse embeddings support? I have read the BGE-M3 documentation, this model support Colbert Multi Vector Embeddings too. It is very convenient if one api call to Ollama, can generate 3 type vectors at once (Dense, Sparse, and Colbert)!
Author
Owner

@JakobStadlhuber commented on GitHub (Jan 2, 2026):

+1

<!-- gh-comment-id:3706407363 --> @JakobStadlhuber commented on GitHub (Jan 2, 2026): +1
Author
Owner

@thohemp commented on GitHub (Jan 9, 2026):

+1

<!-- gh-comment-id:3728255974 --> @thohemp commented on GitHub (Jan 9, 2026): +1
Author
Owner

@JayceJoyce commented on GitHub (Feb 19, 2026):

+1

<!-- gh-comment-id:3929523563 --> @JayceJoyce commented on GitHub (Feb 19, 2026): +1
Author
Owner

@byeoryjeong commented on GitHub (Feb 26, 2026):

+1

<!-- gh-comment-id:3964326101 --> @byeoryjeong commented on GitHub (Feb 26, 2026): +1
Author
Owner

@deroivano commented on GitHub (Mar 16, 2026):

+1

<!-- gh-comment-id:4064555833 --> @deroivano commented on GitHub (Mar 16, 2026): +1
Author
Owner

@21digitalweb commented on GitHub (Apr 18, 2026):

I have run into an issue with using Dense vectors only. In a test I vectorised data of groceries. When type in "Buy Yogurt" as a query and vectorize it, the results returned are things like; Yogurt (Expected) and then Butter and Honey.

Both are used in cooking, but does not satisfy the query. There are many other Yogurt results that didn't feature and should have given the key word comparison when using SparseVector.

Now I end up either using vLLM instead of Ollama OR I need to sidecar some code. Dissapointing since the LLM can produce the vector and does.

<!-- gh-comment-id:4273531963 --> @21digitalweb commented on GitHub (Apr 18, 2026): I have run into an issue with using Dense vectors only. In a test I vectorised data of groceries. When type in "Buy Yogurt" as a query and vectorize it, the results returned are things like; Yogurt (Expected) and then Butter and Honey. Both are used in cooking, but does not satisfy the query. There are many other Yogurt results that didn't feature and should have given the key word comparison when using SparseVector. Now I end up either using vLLM instead of Ollama OR I need to sidecar some code. Dissapointing since the LLM can produce the vector and does.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#50406