[GH-ISSUE #6747] ERROR: llama runner process has terminated: error loading modelvocabulary: _Map_base::at #50763

Closed
opened 2026-04-28 17:02:17 -05:00 by GiteaMirror · 5 comments
Owner

Originally created by @CjhHa1 on GitHub (Sep 11, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6747

What is the issue?

I tried the octopus v4 model using ollama, I have constrcted the model using Modelfile, but it can not work when I try to run it.

transferring model data 100% 
using existing layer sha256:08fc24194c1805114ed7aefcc8e5cedf7fe1e23b587f1655502afb294263b948 
using existing layer sha256:e49180b1ca46f2ea2a9d652ab44a1ab5dbd5d3f9ed3fd8e985a1122883d580d3 
using existing layer sha256:90bf36950b9123ecc20aa969070a7b3d51bbb782100f0e47b2a2c5f3cf6a24da 
writing manifest 
success 
(base) [root@ip-172-31-81-66 ollama_files]# ollama ls
NAME                            ID              SIZE    MODIFIED       
octopus-v4-Q4_K_M:latest        099ce87bccef    2.4 GB  14 seconds ago

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

ollama version is 0.3.6

Originally created by @CjhHa1 on GitHub (Sep 11, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6747 ### What is the issue? I tried the octopus v4 model using ollama, I have constrcted the model using Modelfile, but it can not work when I try to run it. ``` transferring model data 100% using existing layer sha256:08fc24194c1805114ed7aefcc8e5cedf7fe1e23b587f1655502afb294263b948 using existing layer sha256:e49180b1ca46f2ea2a9d652ab44a1ab5dbd5d3f9ed3fd8e985a1122883d580d3 using existing layer sha256:90bf36950b9123ecc20aa969070a7b3d51bbb782100f0e47b2a2c5f3cf6a24da writing manifest success (base) [root@ip-172-31-81-66 ollama_files]# ollama ls NAME ID SIZE MODIFIED octopus-v4-Q4_K_M:latest 099ce87bccef 2.4 GB 14 seconds ago ``` ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version ollama version is 0.3.6
GiteaMirror added the bug label 2026-04-28 17:02:17 -05:00
Author
Owner

@igorschlum commented on GitHub (Sep 11, 2024):

Hi @CjhHa1 Can you share you modelfile script? Could you also upgrade Ollama to version 0.3.10 and retry to create and use your new LLM?

<!-- gh-comment-id:2344263590 --> @igorschlum commented on GitHub (Sep 11, 2024): Hi @CjhHa1 Can you share you modelfile script? Could you also upgrade Ollama to version 0.3.10 and retry to create and use your new LLM?
Author
Owner

@pdevine commented on GitHub (Sep 11, 2024):

Dupe of #6111

<!-- gh-comment-id:2344407231 --> @pdevine commented on GitHub (Sep 11, 2024): Dupe of #6111
Author
Owner

@CjhHa1 commented on GitHub (Sep 12, 2024):

Hi @CjhHa1 Can you share you modelfile script? Could you also upgrade Ollama to version 0.3.10 and retry to create and use your new LLM?

FROM ./octopus-v4-Q4_K_M.gguf
PARAMETER temperature 0
PARAMETER num_ctx 1024
PARAMETER stop <nexa_end>

Just exactly as they mentioned in repo

<!-- gh-comment-id:2345566565 --> @CjhHa1 commented on GitHub (Sep 12, 2024): > Hi @CjhHa1 Can you share you modelfile script? Could you also upgrade Ollama to version 0.3.10 and retry to create and use your new LLM? ``` FROM ./octopus-v4-Q4_K_M.gguf PARAMETER temperature 0 PARAMETER num_ctx 1024 PARAMETER stop <nexa_end> ``` Just exactly as they mentioned in repo
Author
Owner

@igorschlum commented on GitHub (Sep 12, 2024):

Thanks, I will take a look. All is explained here: https://huggingface.co/NexaAIDev/octopus-v4-gguf

<!-- gh-comment-id:2345715722 --> @igorschlum commented on GitHub (Sep 12, 2024): Thanks, I will take a look. All is explained here: https://huggingface.co/NexaAIDev/octopus-v4-gguf
Author
Owner

@CjhHa1 commented on GitHub (Jan 8, 2025):

glad to hear that!

<!-- gh-comment-id:2578052640 --> @CjhHa1 commented on GitHub (Jan 8, 2025): glad to hear that!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#50763