[GH-ISSUE #3689] Aya by Cohere - mt5-xxl arch #2272

Open
opened 2026-04-12 12:32:29 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @oliviermills on GitHub (Apr 17, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3689

What model would you like?

https://huggingface.co/CohereForAI/aya-101

See discussion re t5 and gguf attempts here: https://huggingface.co/CohereForAI/aya-101/discussions/12
trial: https://huggingface.co/kcoopermiller/aya-101-GGUF (using candle)

Originally created by @oliviermills on GitHub (Apr 17, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3689 ### What model would you like? https://huggingface.co/CohereForAI/aya-101 See discussion re t5 and gguf attempts here: https://huggingface.co/CohereForAI/aya-101/discussions/12 trial: https://huggingface.co/kcoopermiller/aya-101-GGUF (using candle)
GiteaMirror added the model label 2026-04-12 12:32:29 -05:00
Author
Owner

@barrelltech commented on GitHub (Apr 24, 2024):

Would also love to see this!

<!-- gh-comment-id:2074487385 --> @barrelltech commented on GitHub (Apr 24, 2024): Would also love to see this!
Author
Owner

@gtlYashParmar commented on GitHub (May 24, 2024):

Would love to see Aya-101

<!-- gh-comment-id:2129283285 --> @gtlYashParmar commented on GitHub (May 24, 2024): Would love to see Aya-101
Author
Owner

@misutoneko commented on GitHub (Aug 31, 2024):

aya-101 works in llama.cpp now, but I guess this tritiumoxide's note about porting llama.cpp stuff to ollama applies.
Not a ollama user myself, just a PSA in case anyone wants to give it a try :)

<!-- gh-comment-id:2322828950 --> @misutoneko commented on GitHub (Aug 31, 2024): aya-101 [works](https://github.com/ggerganov/llama.cpp/discussions/8300) in llama.cpp now, but I guess [this tritiumoxide's note](https://github.com/ollama/ollama/issues/2802#issuecomment-2227096278) about porting llama.cpp stuff to ollama applies. Not a ollama user myself, just a PSA in case anyone wants to give it a try :)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#2272