[GH-ISSUE #4892] aya:35b-23-f16 erro #3088

Closed
opened 2026-04-12 13:31:42 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @lymanzhao on GitHub (Jun 7, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4892

What is the issue?

ollama run aya:35b-23-f16

Error: llama runner process has terminated: signal: aborted (core dumped) error:failed to create context with model '/home/ais/.ollama/models/blobs/sha256-6f800f35270cacdcbdd43e2b96991c7974907b859ab0efa0a91b1523724b7e43'

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.1.38 and 0.1.41

Originally created by @lymanzhao on GitHub (Jun 7, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4892 ### What is the issue? ollama run aya:35b-23-f16 Error: llama runner process has terminated: signal: aborted (core dumped) error:failed to create context with model '/home/ais/.ollama/models/blobs/sha256-6f800f35270cacdcbdd43e2b96991c7974907b859ab0efa0a91b1523724b7e43' ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.1.38 and 0.1.41
GiteaMirror added the bug label 2026-04-12 13:31:42 -05:00
Author
Owner

@jmorganca commented on GitHub (Jun 9, 2024):

Hi @lymanzhao that's a really big model to run at f16 precision (70GB+ of VRAM required) - do you know if you have that much memory between your GPU and system memory? Sorry about the error. I'll merge this with https://github.com/ollama/ollama/issues/4955

<!-- gh-comment-id:2156709146 --> @jmorganca commented on GitHub (Jun 9, 2024): Hi @lymanzhao that's a really big model to run at f16 precision (70GB+ of VRAM required) - do you know if you have that much memory between your GPU and system memory? Sorry about the error. I'll merge this with https://github.com/ollama/ollama/issues/4955
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#3088