Neura Intelligence Index

AI Model Benchmarks

Gemini 2.0 Flash Thinking vs Llama 3.1 405B — Benchmark Comparison | Neura Market

Back to Leaderboard

Gemini 2.0 Flash Thinking vs Llama 3.1 405B

Gemini 2.0 Flash Thinking

Google 🇺🇸

66.7

#88—

Meta 🇺🇸

66.3

#91—

Category Comparison

Benchmark-by-Benchmark

reasoning

Benchmark	Gemini 2.0 Flash Thinking	Llama 3.1 405B
GPQA Diamond	74.2	51.1
ARC-Challenge	—	96.9
BigBench-Hard	—	85.4

multimodal

Benchmark	Gemini 2.0 Flash Thinking	Llama 3.1 405B
MMMU	75.4	—

general

Benchmark	Gemini 2.0 Flash Thinking	Llama 3.1 405B
Chatbot Arena Elo	—	1244
MMLU-Pro	—	73.3
IFEval	—	86.4

math

Benchmark	Gemini 2.0 Flash Thinking	Llama 3.1 405B
GSM8K	—	96.8
MATH	—	73.8

coding

Benchmark	Gemini 2.0 Flash Thinking	Llama 3.1 405B
HumanEval	—	89

language

Benchmark	Gemini 2.0 Flash Thinking	Llama 3.1 405B
HellaSwag	—	96
WinoGrande	—	87.6

safety

Benchmark	Gemini 2.0 Flash Thinking	Llama 3.1 405B
TruthfulQA	—	65.3

Category Winners

coding

Llama 3.1 405B

69.3

math

Llama 3.1 405B

72.0

reasoning

Gemini 2.0 Flash Thinking

64.4

general

Llama 3.1 405B

67.9

language

Llama 3.1 405B

87.7

multimodal

Gemini 2.0 Flash Thinking

71.1

safety

Llama 3.1 405B

59.8