Neura Intelligence Index
Category Comparison
Benchmark-by-Benchmark
coding
| Benchmark | Devstral Small 1.1 | Gemini 1.5 Flash |
|---|---|---|
| SWE-bench Verified | 53.6 | — |
reasoning
| Benchmark | Devstral Small 1.1 | Gemini 1.5 Flash |
|---|---|---|
| GPQA Diamond | — | 51 |
multimodal
| Benchmark | Devstral Small 1.1 | Gemini 1.5 Flash |
|---|---|---|
| MMMU | — | 62.3 |
Category Winners
coding
23.5
reasoning
20.2
multimodal
35.2