Neura Intelligence Index
Category Comparison
Benchmark-by-Benchmark
language
| Benchmark | Mistral Large 2 | QvQ-72B-Preview |
|---|---|---|
| HellaSwag | 93.6 | — |
general
| Benchmark | Mistral Large 2 | QvQ-72B-Preview |
|---|---|---|
| MMLU-Pro | 69.4 | — |
| IFEval | 82.8 | — |
| Chatbot Arena Elo | 1250 | — |
reasoning
| Benchmark | Mistral Large 2 | QvQ-72B-Preview |
|---|---|---|
| ARC-Challenge | 94 | — |
| GPQA Diamond | 48.2 | — |
safety
| Benchmark | Mistral Large 2 | QvQ-72B-Preview |
|---|---|---|
| TruthfulQA | 60.5 | — |
coding
| Benchmark | Mistral Large 2 | QvQ-72B-Preview |
|---|---|---|
| HumanEval | 92 | — |
multimodal
| Benchmark | Mistral Large 2 | QvQ-72B-Preview |
|---|---|---|
| MMMU | — | 70.3 |
Category Winners
coding
80.3
math
46.2
reasoning
35.6
general
55.9
language
66.8
multimodal
Q
QvQ-72B-Preview56.3
safety
29.8