github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 00:22:43 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #3410] Qwen1.5-MoE #2101

New Issue
Closed
opened 2026-04-12 12:20:37 -05:00 by GiteaMirror · 2 comments
GiteaMirror commented 2026-04-12 12:20:37 -05:00
Owner
Copy Link

Originally created by @wuming123 on GitHub (Mar 30, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3410

What model would you like?

The code of Qwen1.5-MoE has been in the latest Hugging face transformers and we advise you to build from source with command , or you might encounter the following error:pip install git+https://github.com/huggingface/transformers

Originally created by @wuming123 on GitHub (Mar 30, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3410 ### What model would you like? The code of Qwen1.5-MoE has been in the latest Hugging face transformers and we advise you to build from source with command , or you might encounter the following error:pip install git+https://github.com/huggingface/transformers
GiteaMirror added the model label 2026-04-12 12:20:37 -05:00
GiteaMirror commented 2026-04-12 12:20:39 -05:00
Author
Owner
Copy Link

@easp commented on GitHub (Mar 30, 2024):

Ollama doesn't use transformers. Support for Qwen MoE will have to come after llama.cpp supports it. There is a PR, but it looks like there is work to do before it can be merged.
https://github.com/ggerganov/llama.cpp/pull/6074

<!-- gh-comment-id:2028445554 --> @easp commented on GitHub (Mar 30, 2024): Ollama doesn't use transformers. Support for Qwen MoE will have to come after llama.cpp supports it. There is a PR, but it looks like there is work to do before it can be merged. https://github.com/ggerganov/llama.cpp/pull/6074
GiteaMirror commented 2026-04-12 12:20:39 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jan 30, 2026):

hf download --local-dir . Qwen/Qwen1.5-MoE-A2.7B-Chat
convert_hf_to_gguf.py . --outtype f16 --outfile Qwen1.5-MoE-A2.7B-Chat.gguf
echo FROM Qwen1.5-MoE-A2.7B-Chat.gguf > Modelfile
ollama create qwen1.5:7b-a2b-fp16

$ ollama run qwen1.5:7b-a2b-fp16
>>> hello
Hello! How can I assist you today?

>>> why is the sky blue?
The sky appears blue to us because of a phenomenon called Rayleigh 
scattering. Sunlight, which consists of a spectrum of colors, enters Earth's 
atmosphere and encounters tiny molecules like nitrogen and oxygen atoms. As 
light travels through the atmosphere, these molecules scatter (or break up) 
the shorter wavelength colors (blue and violet) more than the longer 
wavelength colors (red, orange, yellow).

During sunset or sunrise, when the sun is closer to the horizon, the light 
has to travel through more of Earth's atmosphere to reach our eyes. This 
increased distance allows for more scattering, causing the blue and violet 
colors in sunlight to scatter in all directions. As a result, we see mostly 
red, orange, and yellow hues during these times because they are less 
scattered. The blue color is scattered in all directions but not as 
efficiently as the other colors, leading to the sky appearing bluer overall.

Moreover, at sunrise and sunset, the Earth's atmosphere becomes thinner, and 
light has to travel through more air molecules before reaching our eyes, 
which increases the amount of scattering. This increased scattering makes the 
blue color even more apparent in the sky during these times.

In summary, the sky appears blue because of Rayleigh scattering caused by the 
interaction of sunlight with Earth's atmosphere, where shorter wavelengths 
(blue and violet) are scattered more than longer wavelengths (red, orange, 
yellow).
<!-- gh-comment-id:3821159781 --> @rick-github commented on GitHub (Jan 30, 2026): ``` hf download --local-dir . Qwen/Qwen1.5-MoE-A2.7B-Chat convert_hf_to_gguf.py . --outtype f16 --outfile Qwen1.5-MoE-A2.7B-Chat.gguf echo FROM Qwen1.5-MoE-A2.7B-Chat.gguf > Modelfile ollama create qwen1.5:7b-a2b-fp16 ``` ```console $ ollama run qwen1.5:7b-a2b-fp16 >>> hello Hello! How can I assist you today? >>> why is the sky blue? The sky appears blue to us because of a phenomenon called Rayleigh scattering. Sunlight, which consists of a spectrum of colors, enters Earth's atmosphere and encounters tiny molecules like nitrogen and oxygen atoms. As light travels through the atmosphere, these molecules scatter (or break up) the shorter wavelength colors (blue and violet) more than the longer wavelength colors (red, orange, yellow). During sunset or sunrise, when the sun is closer to the horizon, the light has to travel through more of Earth's atmosphere to reach our eyes. This increased distance allows for more scattering, causing the blue and violet colors in sunlight to scatter in all directions. As a result, we see mostly red, orange, and yellow hues during these times because they are less scattered. The blue color is scattered in all directions but not as efficiently as the other colors, leading to the sky appearing bluer overall. Moreover, at sunrise and sunset, the Earth's atmosphere becomes thinner, and light has to travel through more air molecules before reaching our eyes, which increases the amount of scattering. This increased scattering makes the blue color even more apparent in the sky during these times. In summary, the sky appears blue because of Rayleigh scattering caused by the interaction of sunlight with Earth's atmosphere, where shorter wavelengths (blue and violet) are scattered more than longer wavelengths (red, orange, yellow). ```
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label model
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#2101
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?