[GH-ISSUE #7343] Aya-Expanse 32B & 8B #4666

Closed
opened 2026-04-12 15:35:09 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @vYLQs6 on GitHub (Oct 24, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/7343

Originally assigned to: @BruceMacD on GitHub.

These models should be very easy to support since people are already uploading ggufs to HF, so it should be already supported by ollama, just need to be ggufed and uploaded

https://huggingface.co/CohereForAI/aya-expanse-32b

https://huggingface.co/CohereForAI/aya-expanse-8b

Originally created by @vYLQs6 on GitHub (Oct 24, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/7343 Originally assigned to: @BruceMacD on GitHub. These models should be very easy to support since people are already uploading ggufs to HF, so it should be already supported by ollama, just need to be ggufed and uploaded https://huggingface.co/CohereForAI/aya-expanse-32b https://huggingface.co/CohereForAI/aya-expanse-8b ![](https://huggingface.co/CohereForAI/aya-expanse-32b/resolve/main/winrates_marenahard.png) ![](https://huggingface.co/CohereForAI/aya-expanse-8b/resolve/main/winrates_marenahard.png)
GiteaMirror added the model label 2026-04-12 15:35:09 -05:00
Author
Owner

@fxmbsw7 commented on GitHub (Oct 25, 2024):

search for aya gguf on hf

ollama run hf.co/bartowski/aya-expanse-8b-GGUF:f16
or :Q8_0
or no :*

<!-- gh-comment-id:2436560586 --> @fxmbsw7 commented on GitHub (Oct 25, 2024): search for aya gguf on hf ollama run hf.co/bartowski/aya-expanse-8b-GGUF:f16 or :Q8_0 or no :*
Author
Owner

@BruceMacD commented on GitHub (Oct 25, 2024):

Thanks for taking the time to open this issue.

I've added aya-expanse to our model library.
https://ollama.com/library/aya-expanse

ollama run aya-expanse
<!-- gh-comment-id:2436565502 --> @BruceMacD commented on GitHub (Oct 25, 2024): Thanks for taking the time to open this issue. I've added `aya-expanse` to our model library. https://ollama.com/library/aya-expanse ```bash ollama run aya-expanse ```
Author
Owner

@jackbravo commented on GitHub (Oct 27, 2024):

Nice @BruceMacD!

Hmmm, the context length for the 32b seems to be 8192 like for the 8b. Is this correct? Shouldn't it be 128k?

<!-- gh-comment-id:2440141722 --> @jackbravo commented on GitHub (Oct 27, 2024): Nice @BruceMacD! Hmmm, the context length for the 32b seems to be 8192 like for the 8b. Is this correct? Shouldn't it be 128k?
Author
Owner

@fxmbsw7 commented on GitHub (Oct 27, 2024):

8k is the default
/set smth then urself to more
and /save to.own modelname file to.save new size

On Sun, Oct 27, 2024, 20:13 Joaquin Bravo Contreras <
@.***> wrote:

Nice @BruceMacD https://github.com/BruceMacD!

Hmmm, the context length for the 32b seems to be 8192 like for the 8b. Is
this correct? Shouldn't it be 128k?


Reply to this email directly, view it on GitHub
https://github.com/ollama/ollama/issues/7343#issuecomment-2440141722,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AJMLP3I6SE5OVDYGD7THSNTZ5U3OPAVCNFSM6AAAAABQRHXXS2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINBQGE2DCNZSGI
.
You are receiving this because you commented.Message ID:
@.***>

<!-- gh-comment-id:2440160233 --> @fxmbsw7 commented on GitHub (Oct 27, 2024): 8k is the default /set smth then urself to more and /save to.own modelname file to.save new size On Sun, Oct 27, 2024, 20:13 Joaquin Bravo Contreras < ***@***.***> wrote: > Nice @BruceMacD <https://github.com/BruceMacD>! > > Hmmm, the context length for the 32b seems to be 8192 like for the 8b. Is > this correct? Shouldn't it be 128k? > > — > Reply to this email directly, view it on GitHub > <https://github.com/ollama/ollama/issues/7343#issuecomment-2440141722>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AJMLP3I6SE5OVDYGD7THSNTZ5U3OPAVCNFSM6AAAAABQRHXXS2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINBQGE2DCNZSGI> > . > You are receiving this because you commented.Message ID: > ***@***.***> >
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#4666