All Comparisons

Gemini 2.0 Flash vs GPT-4o

Gemini 2.0 Flash
Google 🇺🇸
44.9
#204—
low
GPT-4o
OpenAI 🇺🇸
58.1
#150—
high
$2.50/M in · $10.00/M out
128K context
Most Affordable
GPT-4o
$2.50/M input
Largest Context
GPT-4o
128K tokens
Best Benchmark Score
GPT-4o
58.1/100

Model Specifications

SpecGemini 2.0 FlashGPT-4o
ProviderGoogleOpenAI
Release DateDec 2024May 2024
Knowledge Cutoff2024-08-01Oct 2023
ParametersUndisclosedunknown
Context Window—128K
Max Output——
Open SourceNoNo
Licenseproprietaryproprietary
Tokenizer——
Modality——
Reasoning ModelNoNo
ModeratedNoNo

Pricing Comparison

Price (per 1M tokens)Gemini 2.0 FlashGPT-4o
Input—$2.50
Output—$10.00

API Provider Pricing

Capabilities

FeatureGemini 2.0 FlashGPT-4o
Text Input
Image Input (Vision)
Audio Input
Video Input
File Input
Image Output
Audio Output
Tool Use
Structured Output (JSON)
Streaming
Reasoning Tokens
Web Search
Temperature Control
Top-P Sampling
Stop Sequences
Seed (Reproducibility)
Log Probabilities

Category Comparison

Benchmark-by-Benchmark

reasoning

BenchmarkGemini 2.0 FlashGPT-4o
GPQA Diamond
62.1
53.6
ARC-Challenge—
96.4
BigBench-Hard—
87.3

multimodal

BenchmarkGemini 2.0 FlashGPT-4o
MMMU
70.7
69.1

general

BenchmarkGemini 2.0 FlashGPT-4o
MMLU-Pro—
74.5
IFEval—
83.6
Chatbot Arena Elo—
1285

coding

BenchmarkGemini 2.0 FlashGPT-4o
HumanEval—
90.2
SWE-bench Verified—
33.2

math

BenchmarkGemini 2.0 FlashGPT-4o
AIME 2024—
13.4
GSM8K—
95.8
MATH—
76.6

language

BenchmarkGemini 2.0 FlashGPT-4o
HellaSwag—
96.4
WinoGrande—
85.7

safety

BenchmarkGemini 2.0 FlashGPT-4o
TruthfulQA—
73.5

Category Winners

coding
GPT-4o
38.2
math
GPT-4o
54.5
reasoning
GPT-4o
54.2
general
GPT-4o
70.5
language
GPT-4o
79.9
multimodal
Gemini 2.0 Flash
57.4
safety
GPT-4o
94.3

Compare More Models

Frequently Asked Questions