[GH-ISSUE #3632] StableLM-2 12B #27999

Closed
opened 2026-04-22 05:42:55 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @coder543 on GitHub (Apr 13, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3632

What model would you like?

This model looks promising: https://stability.ai/news/introducing-stable-lm-2-12b

Originally created by @coder543 on GitHub (Apr 13, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3632 ### What model would you like? This model looks promising: https://stability.ai/news/introducing-stable-lm-2-12b
GiteaMirror added the model label 2026-04-22 05:42:55 -05:00
Author
Owner

@mann1x commented on GitHub (Apr 15, 2024):

will quantize it for sure but it's only 4k context for now, they will release later a new version
if you see it on HF and I miss it, ping me here please

<!-- gh-comment-id:2057466655 --> @mann1x commented on GitHub (Apr 15, 2024): will quantize it for sure but it's only 4k context for now, they will release later a new version if you see it on HF and I miss it, ping me here please
Author
Owner

@MoonRide303 commented on GitHub (Apr 18, 2024):

Converted and quantized to Q6_K using convert-hf-to-gguf.py and quantize from llama.cpp b2690 - but when trying to run using ollama run (0.1.32) I get:

Error: llama runner process no longer running: 3221226505

The same GGUF file can be launched using llama.cpp.

<!-- gh-comment-id:2063259642 --> @MoonRide303 commented on GitHub (Apr 18, 2024): Converted and quantized to Q6_K using convert-hf-to-gguf.py and quantize from llama.cpp b2690 - but when trying to run using ollama run (0.1.32) I get: ``` Error: llama runner process no longer running: 3221226505 ``` The same GGUF file can be launched using llama.cpp.
Author
Owner

@jmorganca commented on GitHub (Sep 6, 2024):

Available here: https://ollama.com/library/stablelm2:12b

Thanks for the issue!

<!-- gh-comment-id:2334440446 --> @jmorganca commented on GitHub (Sep 6, 2024): Available here: https://ollama.com/library/stablelm2:12b Thanks for the issue!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#27999