Neura Intelligence Index
Category Comparison
Benchmark-by-Benchmark
reasoning
| Benchmark | Claude 3.5 Haiku | Qwen2.5-Omni-7B |
|---|---|---|
| GPQA Diamond | 41.6 | 30.8 |
coding
| Benchmark | Claude 3.5 Haiku | Qwen2.5-Omni-7B |
|---|---|---|
| SWE-bench Verified | 40.6 | — |
agent
| Benchmark | Claude 3.5 Haiku | Qwen2.5-Omni-7B |
|---|---|---|
| TAU-Bench Retail | 51 | — |
Category Winners
coding
6.5
reasoning
9.6
multimodal
Q
Qwen2.5-Omni-7B14.3
agent
10.1