Neura Intelligence Index
Category Comparison
Benchmark-by-Benchmark
reasoning
| Benchmark | DeepSeek R1 Distill Qwen 7B | Mixtral 8x22B |
|---|---|---|
| GPQA Diamond | 49.1 | — |
| ARC-Challenge | — | 91.3 |
safety
| Benchmark | DeepSeek R1 Distill Qwen 7B | Mixtral 8x22B |
|---|---|---|
| TruthfulQA | — | 55.2 |
coding
| Benchmark | DeepSeek R1 Distill Qwen 7B | Mixtral 8x22B |
|---|---|---|
| HumanEval | — | 79.3 |
language
| Benchmark | DeepSeek R1 Distill Qwen 7B | Mixtral 8x22B |
|---|---|---|
| WinoGrande | — | 82.1 |
| HellaSwag | — | 88.5 |
general
| Benchmark | DeepSeek R1 Distill Qwen 7B | Mixtral 8x22B |
|---|---|---|
| MMLU-Pro | — | 56.8 |
| IFEval | — | 72.4 |
| Chatbot Arena Elo | — | 1146 |
Category Winners
coding
26.8
math
16.4
reasoning
26.2
general
8.0
language
22.6
safety
8.2