Qwen2.5-Math-1.5B|7B|72B
FreeWorld's leading open-sourced mathematical LLMs
About Qwen2.5-Math-1.5B|7B|72B
Qwen2.5-Math is a series of open-sourced large language models specialized for mathematical reasoning, released by the Qwen Team on September 19, 2024. The series includes base models (1.5B, 7B, 72B parameters), instruction-tuned versions (Instruct), and a mathematical reward model (RM-72B). It supports both Chain-of-Thought (CoT) and Tool-integrated Reasoning (TIR) to solve math problems in English and Chinese. Trained on the Qwen Math Corpus v2 (over 1 trillion tokens), Qwen2.5-Math achieves significant performance gains over its predecessor Qwen2-Math on benchmarks such as GSM8K, MATH, and Chinese exam datasets (CMATH, Gaokao Math). The models are available under open-source licenses on GitHub, Hugging Face, and ModelScope.
Key Features
Pros & Cons
- Open-source with multiple model sizes suitable for different resource constraints
- State-of-the-art performance on major math benchmarks among open models
- Supports both CoT and TIR for flexible reasoning strategies
- Bilingual (English and Chinese) math problem solving
- Includes a dedicated reward model for improved instruction tuning
- Primarily designed for math problems; not recommended for general-purpose tasks
- Larger models (72B) require significant computational resources
- Limited to English and Chinese; no support for other languages in math reasoning
- May still struggle with complex multi-step problems without TIR