github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-07-16 13:19:40 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #5120] deepseek-code-v2 #28990

New Issue
Closed
opened 2026-04-22 07:34:46 -05:00 by GiteaMirror · 5 comments
GiteaMirror commented 2026-04-22 07:34:46 -05:00
Owner
Copy Link

Originally created by @tinycrops on GitHub (Jun 18, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/5120

Originally assigned to: @dhiltgen on GitHub.

What is the issue?

I don't have a problem running codestral so the problem isn't with the model size, right?

ollama run deepseek-coder-v2
pulling manifest 
pulling 5ff0abeeac1d... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏ 8.9 GB                         
pulling 732caedf08d1... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏  112 B                         
pulling 4bb71764481f... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏  13 KB                         
pulling 1c8f573e830c... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏ 1.1 KB                         
pulling 19f2fb9e8bc6... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏   32 B                         
pulling c17ee51fe152... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏  568 B                         
verifying sha256 digest 
writing manifest 
removing any unused layers 
success 
Error: llama runner process has terminated: signal: aborted (core dumped) error:failed to create context with model '/usr/share/ollama/.ollama/models/blobs/sha256-5ff0abeeac1d2dbdd5455c0b49ba3b29a9ce3c1fb181b2eef2e948689d55d046'

Same issue with deepseek-v2

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.1.44

Originally created by @tinycrops on GitHub (Jun 18, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/5120 Originally assigned to: @dhiltgen on GitHub. ### What is the issue? I don't have a problem running codestral so the problem isn't with the model size, right? ```bash ollama run deepseek-coder-v2 pulling manifest pulling 5ff0abeeac1d... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏ 8.9 GB pulling 732caedf08d1... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏ 112 B pulling 4bb71764481f... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏ 13 KB pulling 1c8f573e830c... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏ 1.1 KB pulling 19f2fb9e8bc6... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏ 32 B pulling c17ee51fe152... 100% ▕██████████████████████████████████████████████████████████████████████████████████▏ 568 B verifying sha256 digest writing manifest removing any unused layers success Error: llama runner process has terminated: signal: aborted (core dumped) error:failed to create context with model '/usr/share/ollama/.ollama/models/blobs/sha256-5ff0abeeac1d2dbdd5455c0b49ba3b29a9ce3c1fb181b2eef2e948689d55d046' ``` Same issue with deepseek-v2 ```bash ``` ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.1.44
GiteaMirror added the bug label 2026-04-22 07:34:46 -05:00
GiteaMirror commented 2026-04-22 07:34:47 -05:00
Author
Owner
Copy Link

@bunnyfu commented on GitHub (Jun 18, 2024):

This should be fixed in the build of llama.cpp from 4 days ago (which Ollama has not implemented yet).

https://github.com/ggerganov/llama.cpp/issues/7652
https://github.com/ggerganov/llama.cpp/pull/7935

<!-- gh-comment-id:2176855643 --> @bunnyfu commented on GitHub (Jun 18, 2024): This should be fixed in the build of llama.cpp from 4 days ago (which Ollama has not implemented yet). https://github.com/ggerganov/llama.cpp/issues/7652 https://github.com/ggerganov/llama.cpp/pull/7935
GiteaMirror commented 2026-04-22 07:34:48 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (Jun 18, 2024):

Can you share your server log? If the crash is OOM related, #5121 may resolve it.

The next release 0.1.45 also has a llama.cpp update so it should pick up those fixes.

<!-- gh-comment-id:2177159267 --> @dhiltgen commented on GitHub (Jun 18, 2024): Can you share your server log? If the crash is OOM related, #5121 may resolve it. The next release 0.1.45 also has a llama.cpp update so it should pick up those fixes.
GiteaMirror commented 2026-04-22 07:34:49 -05:00
Author
Owner
Copy Link

@Speedway1 commented on GitHub (Jun 18, 2024):

Thanks to this issue I became aware that deepseek-coder-v2 is available on Ollama. Wishing the OP well in solving the issue, sorry that we aren't able to help.

<!-- gh-comment-id:2177211668 --> @Speedway1 commented on GitHub (Jun 18, 2024): Thanks to this issue I became aware that deepseek-coder-v2 is available on Ollama. Wishing the OP well in solving the issue, sorry that we aren't able to help.
GiteaMirror commented 2026-04-22 07:34:50 -05:00
Author
Owner
Copy Link

@fatualux commented on GitHub (Jun 23, 2024):

Hi,
I have found an issue with deepseek-coder-v2.
I successfully pulled the model, but cannot run it.

SYSTEM INFORMATION:
Linux
6.9.5-arch1-1 x86_64

UPTIME:
0 days, 0 hours, 2 minutes, 35 seconds

[fz@fzpc ~]$ ollama run deepseek-coder-v2
Error: Post "http://127.0.0.1:11434/api/chat": EOF

Here is what I have got in the shell where I ran ollama serve

 Device 0: NVIDIA GeForce RTX 2060, compute capability 7.5, VMM: yes
SIGSEGV: segmentation violation
PC=0x7ede02f7e1dd m=4 sigcode=1
signal arrived during cgo execution

[...]

rax    0x0
rbx    0x7eddbabff490
rcx    0x67
rdx    0x0
rdi    0x0
rsi    0x0
rbp    0x7eddbabff2e0
rsp    0x7eddbabff2b8
r8     0x7edda80008e0
r9     0x7
r10    0x7edca50ea590
r11    0xaa086e978dc30d79
r12    0x7edd9b528ca8
r13    0x0
r14    0x7edda8202388
r15    0x0
rip    0x7ede02f7e1dd
rflags 0x10283
cs     0x33
fs     0x0
gs     0x0

Any suggestions?
Thanks in advance

<!-- gh-comment-id:2185334874 --> @fatualux commented on GitHub (Jun 23, 2024): Hi, I have found an issue with deepseek-coder-v2. I successfully pulled the model, but cannot run it. ``` SYSTEM INFORMATION: Linux 6.9.5-arch1-1 x86_64 UPTIME: 0 days, 0 hours, 2 minutes, 35 seconds [fz@fzpc ~]$ ollama run deepseek-coder-v2 Error: Post "http://127.0.0.1:11434/api/chat": EOF ``` Here is what I have got in the shell where I ran ```ollama serve``` ``` Device 0: NVIDIA GeForce RTX 2060, compute capability 7.5, VMM: yes SIGSEGV: segmentation violation PC=0x7ede02f7e1dd m=4 sigcode=1 signal arrived during cgo execution [...] rax 0x0 rbx 0x7eddbabff490 rcx 0x67 rdx 0x0 rdi 0x0 rsi 0x0 rbp 0x7eddbabff2e0 rsp 0x7eddbabff2b8 r8 0x7edda80008e0 r9 0x7 r10 0x7edca50ea590 r11 0xaa086e978dc30d79 r12 0x7edd9b528ca8 r13 0x0 r14 0x7edda8202388 r15 0x0 rip 0x7ede02f7e1dd rflags 0x10283 cs 0x33 fs 0x0 gs 0x0 ``` Any suggestions? Thanks in advance
GiteaMirror commented 2026-04-22 07:34:50 -05:00
Author
Owner
Copy Link

@M3tu20222 commented on GitHub (Jun 24, 2024):

i am using llama3 llava or else models, but deep seek code v2 is too smal, it couldnt answer about 2 mins, other models are working. why is this so slow

<!-- gh-comment-id:2187469574 --> @M3tu20222 commented on GitHub (Jun 24, 2024): i am using llama3 llava or else models, but deep seek code v2 is too smal, it couldnt answer about 2 mins, other models are working. why is this so slow
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#28990
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?