Jamba v0.1
ai21labs/Jamba-v0.1
Open Source · chat · open-weights
Open
Alert me on changes
Context
—
Max output
—
Weights
Open
API $/1M
—
Modalities
text
Released
28 Mar 2024
License: apache-2.0 · ai21labs/Jamba-v0.1
AI summary
● machine-written
Jamba v0.1: Hybrid SSM-Transformer open-weights language model
Jamba v0.1 is an open-weights hybrid SSM-Transformer language model released by AI21 Labs under the Apache 2.0 license. It combines State Space Models (Mamba) with Transformer attention mechanisms for text generation. The model is available on Hugging Face and supports deployment via multiple inference frameworks including Transformers, vLLM, and SGLang.
What's new
- Hybrid SSM-Transformer architecture combining Mamba with Transformer attention
- Available as open-weights model under Apache 2.0 license
- Compatible with Transformers, vLLM, and SGLang inference libraries
- Tagged with Mixture of Experts architecture
Best for
Text generation tasksLong-context processingDeployment in open-source environmentsResearch and fine-tuning applications