Neura Intelligence Index
| Benchmark | Gemma 3 1B | Llama 3.1 8B |
|---|---|---|
| GPQA Diamond | 19.2 | — |
| ARC-Challenge | — | 83.4 |
| Benchmark | Gemma 3 1B | Llama 3.1 8B |
|---|---|---|
| SimpleQA | 2.2 | — |
| MMLU-Pro | — | 48.3 |
| Chatbot Arena Elo | — | 1141 |
| IFEval | — | 73.1 |
| Benchmark | Gemma 3 1B | Llama 3.1 8B |
|---|---|---|
| HumanEval | — | 72.6 |
| Benchmark | Gemma 3 1B | Llama 3.1 8B |
|---|---|---|
| WinoGrande | — | 78.9 |
| HellaSwag | — | 82 |
| Benchmark | Gemma 3 1B | Llama 3.1 8B |
|---|---|---|
| TruthfulQA | — | 52.4 |