Neura Intelligence Index
Category Comparison
Benchmark-by-Benchmark
reasoning
| Benchmark | Claude 3.5 Sonnet | DiffusionGemma 26B-A4B |
|---|---|---|
| GPQA Diamond | 59.4 | 73.2 |
| Humanity's Last Exam | — | 11.9 |
multimodal
| Benchmark | Claude 3.5 Sonnet | DiffusionGemma 26B-A4B |
|---|---|---|
| MMMU-Pro | — | 54.3 |
general
| Benchmark | Claude 3.5 Sonnet | DiffusionGemma 26B-A4B |
|---|---|---|
| MMMLU | — | 81.5 |
Category Winners
reasoning
37.2
general
42.7
multimodal
16.6