[GH-ISSUE #4406] Would it be possible to add the Bloom model and other multilanguage/multilingual models? #49267

Closed
opened 2026-04-28 11:04:06 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @asterbini on GitHub (May 13, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4406

It would be nice, for us non-English people, to have access to the some good multilanguage/multilingual LLMs.
Bloom comes to mind, but other would be very useful.

https://huggingface.co/blog/bloom

Originally created by @asterbini on GitHub (May 13, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4406 It would be nice, for us non-English people, to have access to the some good multilanguage/multilingual LLMs. Bloom comes to mind, but other would be very useful. https://huggingface.co/blog/bloom
GiteaMirror added the model label 2026-04-28 11:04:06 -05:00
Author
Owner

@thinkverse commented on GitHub (May 13, 2024):

Yes, Bloom's BloomForCausalLM architecture is supported by llama.cpp. There are 2 1B Bloom models on Ollama already which were added by a community member:

You can convert models yourself by using the import guide, make sure you use convert-hf-to-gguf.py and not convert.py during the convert the model step, and don't use Python 3.12 or later that's not supported yet. I've had success converting models using Python 3.11.

<!-- gh-comment-id:2108892283 --> @thinkverse commented on GitHub (May 13, 2024): Yes, Bloom's `BloomForCausalLM` architecture is supported by llama.cpp. There are 2 1B Bloom models on Ollama already which were added by a community member: - https://ollama.com/gouranshitera/bloom-1b1 - https://ollama.com/gouranshitera/bloomz-1b7 You can convert models yourself by using the [import guide](https://github.com/ollama/ollama/blob/main/docs/import.md), make sure you use [convert-hf-to-gguf.py](https://github.com/ggerganov/llama.cpp/blob/master/convert-hf-to-gguf.py#L667) and not `convert.py` during the [convert the model](https://github.com/ollama/ollama/blob/main/docs/import.md#convert-the-model) step, and don't use Python 3.12 or later that's not supported yet. I've had success converting models using Python 3.11.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#49267