Neura Intelligence Index
Category Comparison
Benchmark-by-Benchmark
general
| Benchmark | Claude 3.5 Haiku | Command A+ |
|---|---|---|
| IFEval | 78.4 | — |
| MMLU-Pro | 65 | — |
| Chatbot Arena Elo | 1200 | — |
reasoning
| Benchmark | Claude 3.5 Haiku | Command A+ |
|---|---|---|
| GPQA Diamond | 41.6 | — |
| ARC-Challenge | 91.8 | — |
safety
| Benchmark | Claude 3.5 Haiku | Command A+ |
|---|---|---|
| TruthfulQA | 63.5 | — |
multimodal
| Benchmark | Claude 3.5 Haiku | Command A+ |
|---|---|---|
| MMMU | — | 75.1 |
| MMMU-Pro | — | 63 |
| CharXiv Reasoning | — | 52.7 |
Category Winners
coding
65.6
math
69.8
reasoning
20.8
general
30.1
multimodal
38.1
safety
48.3