Stable LM 2 logo

Stable LM 2

Paid

Compact multilingual small language model for developers

4.7
Inputs: textOutputs: text
Type
Saas
Company
Stability AI

About Stable LM 2

Stable LM 2 1.6B is a state-of-the-art small language model developed by Stability AI, featuring 1.6 billion parameters and trained on approximately 2 trillion tokens across multilingual data in English, Spanish, German, Italian, French, Portuguese, and Dutch. It offers both a pre-trained base model and an instruction-tuned version, along with the final pre-training checkpoint and optimizer states to facilitate fine-tuning and experimentation. The model outperforms many models under 2B parameters on standard benchmarks (ARC Challenge, HellaSwag, TruthfulQA, MMLU, LAMBADA) and matches larger models in MT Bench evaluations, while maintaining a compact size suitable for developers with moderate resources. Stability AI also highlights common limitations of small models, such as high hallucination rates and potential toxic language, encouraging responsible use.

Key Features

1.6 billion parameter small language model
Multilingual support: English, Spanish, German, Italian, French, Portuguese, Dutch
Pre-trained and instruction-tuned versions available
Includes final pre-training checkpoint with optimizer states for fine-tuning
Trained on ~2 trillion tokens for two epochs
Outperforms models under 2B parameters on Open LLM Leaderboard benchmarks
Competitive performance with larger models on MT Bench
Commercially and non-commercially usable via Stability AI Membership
Testable on Hugging Face

Pros & Cons

Pros
  • Compact size lowers hardware barriers for developers
  • Outperforms most models under 2B parameters on standard benchmarks
  • Multilingual training across seven languages
  • Release of optimizer states enables easier fine-tuning and continued pre-training
  • Available for both commercial and non-commercial use with a Stability AI Membership
Cons
  • Small capacity leads to high hallucination rates
  • May exhibit potential toxic language
  • Limited to 1.6B parameters, may not match performance of larger models on complex tasks
  • Membership required for commercial use (free tier unclear)

Best For

Rapid experimentation and iteration in language model developmentFine-tuning for domain-specific applicationsMultilingual text generation and understandingEducational research and open-source model reproductionBuilding lightweight AI applications with limited compute resources

Alternatives to Stable LM 2

FAQ

Is Stable LM 2 1.6B available for commercial use?
Yes, Stable LM 2 1.6B can be used commercially with a Stability AI Membership. Non-commercial use is also permitted under the membership.
What languages does Stable LM 2 1.6B support?
It supports multilingual data in English, Spanish, German, Italian, French, Portuguese, and Dutch.
Can I fine-tune Stable LM 2 1.6B?
Yes, Stability AI provides the final pre-training checkpoint including optimizer states to facilitate fine-tuning and continued pre-training by developers.
Where can I test Stable LM 2 1.6B?
The model can be tested on Hugging Face.