[GH-ISSUE #2419] Running Qwen #1410

Closed
opened 2026-04-12 11:16:59 -05:00 by GiteaMirror · 12 comments
Owner

Originally created by @PrashantDixit0 on GitHub (Feb 9, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2419

I tried running Qwen with Langchain but didn't get any output. It is stuck.
Has anyone else got stuck at the same place?

Originally created by @PrashantDixit0 on GitHub (Feb 9, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2419 I tried running Qwen with Langchain but didn't get any output. It is stuck. Has anyone else got stuck at the same place?
Author
Owner

@svilupp commented on GitHub (Feb 9, 2024):

There are several different issues with Qwen already:

Unfortunately, I have seen any solutions or workarounds yet 😞

<!-- gh-comment-id:1935585906 --> @svilupp commented on GitHub (Feb 9, 2024): There are several different issues with Qwen already: - https://github.com/ollama/ollama/issues/2405 - https://github.com/ollama/ollama/issues/2385 - https://github.com/ollama/ollama/issues/2379 Unfortunately, I have seen any solutions or workarounds yet 😞
Author
Owner

@PrashantDixit0 commented on GitHub (Feb 9, 2024):

Same here, I have been trying different models of Qwen but none of them worked for me.

@svilupp Have to tried any other way to run Qwen that would have worked for you like hugging face or any other framework?

<!-- gh-comment-id:1935619340 --> @PrashantDixit0 commented on GitHub (Feb 9, 2024): Same here, I have been trying different models of Qwen but none of them worked for me. @svilupp Have to tried any other way to run Qwen that would have worked for you like hugging face or any other framework?
Author
Owner

@svilupp commented on GitHub (Feb 9, 2024):

No, gave up. I'm waiting for the GGUF to be re-uploaded.

In general, I'm having so many issues with Ollama this week, that I'll need to explore other alternatives 😢

<!-- gh-comment-id:1935644696 --> @svilupp commented on GitHub (Feb 9, 2024): No, gave up. I'm waiting for the GGUF to be re-uploaded. In general, I'm having so many issues with Ollama this week, that I'll need to explore other alternatives 😢
Author
Owner

@deependhulla commented on GitHub (Feb 9, 2024):

Downloaded today latest version of ollama ..and Qwen models , it worked for me on macOS - Intel MacBookPro.

<!-- gh-comment-id:1935899765 --> @deependhulla commented on GitHub (Feb 9, 2024): Downloaded today latest version of ollama ..and Qwen models , it worked for me on macOS - Intel MacBookPro.
Author
Owner

@PrashantDixit0 commented on GitHub (Feb 9, 2024):

Thank you @deependhulla for sharing

<!-- gh-comment-id:1935926024 --> @PrashantDixit0 commented on GitHub (Feb 9, 2024): Thank you @deependhulla for sharing
Author
Owner

@PrashantDixit0 commented on GitHub (Feb 9, 2024):

I tried running Qwen on Ubuntu 22.04 after a fresh installation of Ollama, working for me 👍

<!-- gh-comment-id:1936208613 --> @PrashantDixit0 commented on GitHub (Feb 9, 2024): I tried running Qwen on Ubuntu 22.04 after a fresh installation of Ollama, working for me :+1:
Author
Owner

@cognitivetech commented on GitHub (Feb 9, 2024):

i downloaded the latest release and tried to run qwen on ubuntu 20.. still no luck, here. and requires restart ollama service...

Feb 09 14:15:26 scrap ollama[1726]: error loading model: unknown model architecture: 'qwen2'

https://github.com/ggerganov/llama.cpp/pull/5037

This was added 3 weeks ago... should be no problem. I will try again on my end

<!-- gh-comment-id:1936563959 --> @cognitivetech commented on GitHub (Feb 9, 2024): i downloaded the latest release and tried to run qwen on ubuntu 20.. still no luck, here. and requires restart ollama service... `Feb 09 14:15:26 scrap ollama[1726]: error loading model: unknown model architecture: 'qwen2'` https://github.com/ggerganov/llama.cpp/pull/5037 This was added 3 weeks ago... should be no problem. I will try again on my end
Author
Owner

@cognitivetech commented on GitHub (Feb 9, 2024):

ok, working. done

<!-- gh-comment-id:1936579835 --> @cognitivetech commented on GitHub (Feb 9, 2024): ok, working. done
Author
Owner

@PrashantDixit0 commented on GitHub (Feb 9, 2024):

Great 😃

<!-- gh-comment-id:1936583119 --> @PrashantDixit0 commented on GitHub (Feb 9, 2024): Great 😃
Author
Owner

@samzong commented on GitHub (Feb 18, 2024):

It's seem good news for run Qwen with ollama.

I'll check again.

<!-- gh-comment-id:1950606842 --> @samzong commented on GitHub (Feb 18, 2024): It's seem good news for run Qwen with ollama. I'll check again.
Author
Owner

@svilupp commented on GitHub (Feb 18, 2024):

I believe the fixed GGUF haven’t been re-uploaded yet. So you would have to download them from elsewhere (the ones in Ollama library are broken).

<!-- gh-comment-id:1950981481 --> @svilupp commented on GitHub (Feb 18, 2024): I believe the fixed GGUF haven’t been re-uploaded yet. So you would have to download them from elsewhere (the ones in Ollama library are broken).
Author
Owner

@bmizerany commented on GitHub (Mar 11, 2024):

I tried running Qwen on Ubuntu 22.04 after a fresh installation of Ollama, working for me 👍

Great to hear!

I'm closing this issue. Please reopen if you have further issues.

<!-- gh-comment-id:1989246483 --> @bmizerany commented on GitHub (Mar 11, 2024): > I tried running Qwen on Ubuntu 22.04 after a fresh installation of Ollama, working for me 👍 Great to hear! I'm closing this issue. Please reopen if you have further issues.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#1410