[GH-ISSUE #6491] Jamba 1.5 Model #4085

Open
opened 2026-04-12 14:59:28 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @sanjibnarzary on GitHub (Aug 24, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6491

Jamba 1.5 Open Model Family: The Most Powerful and Efficient Long Context Models.

Features

Long context handling: With a 256K effective context window, the longest in the market, Jamba 1.5 models can improve the quality of key enterprise applications, such as lengthy document summarization and analysis, as well as agentic and RAG workflows

Speed: Up to 2.5X faster on long contexts and fastest across all context lengths in their size class

Quality: Jamba 1.5 Mini is the strongest open model in its size class with a score of 46.1 on the Arena Hard benchmark, surpassing larger models like Mixtral 8x22B and Command-R+. Jamba 1.5 Large, with a score of 65.4, outpaces both Llama 3.1 70B and 405B

Multilingual: In addition to English, the models support Spanish, French, Portuguese, Italian, Dutch, German, Arabic and Hebrew
Developer ready: Jamba natively supports structured JSON output, function calling, digesting document objects, and generating citations

Open for builders: Both models are available for immediate download on Hugging Face (and coming soon to leading frameworks LangChain and LlamaIndex)

Deploy anywhere: In addition to AI21 Studio, the models are available on cloud partners Google Cloud Vertex AI, Microsoft Azure, and NVIDIA NIM and coming soon to Amazon Bedrock, Databricks Marketplace, Snowflake Cortex, Together.AI as well as for private on-prem and VPC deployment

Originally created by @sanjibnarzary on GitHub (Aug 24, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6491 Jamba 1.5 Open Model Family: The Most Powerful and Efficient Long Context Models. **Features** **Long context handling**: With a 256K effective context window, the longest in the market, Jamba 1.5 models can improve the quality of key enterprise applications, such as lengthy document summarization and analysis, as well as agentic and RAG workflows **Speed:** Up to 2.5X faster on long contexts and fastest across all context lengths in their size class **Quality:** Jamba 1.5 Mini is the strongest open model in its size class with a score of 46.1 on the Arena Hard benchmark, surpassing larger models like Mixtral 8x22B and Command-R+. Jamba 1.5 Large, with a score of 65.4, outpaces both Llama 3.1 70B and 405B **Multilingual:** In addition to English, the models support Spanish, French, Portuguese, Italian, Dutch, German, Arabic and Hebrew Developer ready: Jamba natively supports structured JSON output, function calling, digesting document objects, and generating citations **Open for builders**: Both models are available for immediate download on Hugging Face (and coming soon to leading frameworks LangChain and LlamaIndex) **Deploy anywhere**: In addition to AI21 Studio, the models are available on cloud partners Google Cloud Vertex AI, Microsoft Azure, and NVIDIA NIM and coming soon to Amazon Bedrock, Databricks Marketplace, Snowflake Cortex, Together.AI as well as for private on-prem and VPC deployment
GiteaMirror added the model label 2026-04-12 14:59:28 -05:00
Author
Owner

@amitayat commented on GitHub (Aug 25, 2024):

Please deploy on Ollama - Jamba 1.5

<!-- gh-comment-id:2308969303 --> @amitayat commented on GitHub (Aug 25, 2024): Please deploy on Ollama - Jamba 1.5
Author
Owner

@rick-github commented on GitHub (Aug 26, 2024):

Pending support in llama.cpp: https://github.com/ggerganov/llama.cpp/issues/6372

Matthew Berman tested jamba-1.5-large in AI21's Studio playground and it wasn't impressive.

<!-- gh-comment-id:2310998809 --> @rick-github commented on GitHub (Aug 26, 2024): Pending support in llama.cpp: https://github.com/ggerganov/llama.cpp/issues/6372 Matthew Berman tested jamba-1.5-large in AI21's Studio playground and it wasn't impressive.
Author
Owner

@hg0428 commented on GitHub (Oct 1, 2024):

Any updates on this?

<!-- gh-comment-id:2384673237 --> @hg0428 commented on GitHub (Oct 1, 2024): Any updates on this?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#4085