Neura Intelligence Index
| Benchmark | Gemini Diffusion | Llama 3.1 8B |
|---|---|---|
| GPQA Diamond | 40.4 | — |
| ARC-Challenge | — | 83.4 |
| Benchmark | Gemini Diffusion | Llama 3.1 8B |
|---|---|---|
| SWE-bench Verified | 22.9 | — |
| HumanEval | — | 72.6 |
| Benchmark | Gemini Diffusion | Llama 3.1 8B |
|---|---|---|
| Chatbot Arena Elo | — | 1141 |
| MMLU-Pro | — | 48.3 |
| IFEval | — | 73.1 |
| Benchmark | Gemini Diffusion | Llama 3.1 8B |
|---|---|---|
| HellaSwag | — | 82 |
| WinoGrande | — | 78.9 |
| Benchmark | Gemini Diffusion | Llama 3.1 8B |
|---|---|---|
| TruthfulQA | — | 52.4 |