Neura Intelligence Index
Category Comparison
Benchmark-by-Benchmark
general
| Benchmark | Claude 3.5 Haiku | ERNIE 4.5 |
|---|---|---|
| IFEval | 78.4 | — |
| MMLU-Pro | 65 | — |
| Chatbot Arena Elo | 1200 | — |
| SimpleQA | — | 1.8 |
reasoning
| Benchmark | Claude 3.5 Haiku | ERNIE 4.5 |
|---|---|---|
| GPQA Diamond | 41.6 | 74 |
| ARC-Challenge | 91.8 | — |
coding
| Benchmark | Claude 3.5 Haiku | ERNIE 4.5 |
|---|---|---|
| HumanEval | 88.1 | — |
safety
| Benchmark | Claude 3.5 Haiku | ERNIE 4.5 |
|---|---|---|
| TruthfulQA | 63.5 | — |
Category Winners
coding
65.6
math
42.6
reasoning
64.3
general
30.1
safety
48.3