[GH-ISSUE #3057] run Mixtal 8x7b ERROR #63918

Closed
opened 2026-05-03 15:26:02 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @digicr on GitHub (Mar 11, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3057

I ran Mixtal 8x7b and was able to load it onto the GPU successfully. However, after raising a question,
the system gave random answers and often repeated the same content over and over with no end in sight.

NAME ID SIZE MODIFIED
dolphin-mixtral:8x7b-v2.7-q2_K 3705eacb022d 15 GB 6 days ago
mixtral:8x7b-text-v0.1-q2_K c657cacc0023 15 GB 5 days ago

Originally created by @digicr on GitHub (Mar 11, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3057 I ran Mixtal 8x7b and was able to load it onto the GPU successfully. However, after raising a question, the system gave random answers and often repeated the same content over and over with no end in sight. NAME ID SIZE MODIFIED dolphin-mixtral:8x7b-v2.7-q2_K 3705eacb022d 15 GB 6 days ago mixtral:8x7b-text-v0.1-q2_K c657cacc0023 15 GB 5 days ago
GiteaMirror added the bug label 2026-05-03 15:26:02 -05:00
Author
Owner

@jmorganca commented on GitHub (Mar 11, 2024):

Merging with https://github.com/ollama/ollama/issues/1454

<!-- gh-comment-id:1989351847 --> @jmorganca commented on GitHub (Mar 11, 2024): Merging with https://github.com/ollama/ollama/issues/1454
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#63918