All Comparisons

Gemini 2.0 Flash vs GPT-4o

Gemini 2.0 Flash
Google 🇺🇸
45.8
#180
low
GPT-4o
OpenAI 🇺🇸
58.3
#136
high
$2.50/M in · $10.00/M out
128K context
Most Affordable
GPT-4o
$2.50/M input
Largest Context
GPT-4o
128K tokens
Best Benchmark Score
GPT-4o
58.3/100

Model Specifications

SpecGemini 2.0 FlashGPT-4o
ProviderGoogleOpenAI
Release DateDec 2024May 2024
Knowledge Cutoff2024-08-01Oct 2023
ParametersUndisclosedunknown
Context Window128K
Max Output
Open SourceNoNo
Licenseproprietaryproprietary
Tokenizer
Modality
Reasoning ModelNoNo
ModeratedNoNo

Pricing Comparison

Price (per 1M tokens)Gemini 2.0 FlashGPT-4o
Input$2.50
Output$10.00

API Provider Pricing

Capabilities

FeatureGemini 2.0 FlashGPT-4o
Text Input
Image Input (Vision)
Audio Input
Video Input
File Input
Image Output
Audio Output
Tool Use
Structured Output (JSON)
Streaming
Reasoning Tokens
Web Search
Temperature Control
Top-P Sampling
Stop Sequences
Seed (Reproducibility)
Log Probabilities

Category Comparison

Benchmark-by-Benchmark

image_quality

BenchmarkGemini 2.0 FlashGPT-4o
Image Arena Elo
1260

reasoning

BenchmarkGemini 2.0 FlashGPT-4o
GPQA Diamond
62.1
53.6
BigBench-Hard
87.3
ARC-Challenge
96.4

multimodal

BenchmarkGemini 2.0 FlashGPT-4o
MMMU
70.7
69.1

general

BenchmarkGemini 2.0 FlashGPT-4o
MMLU-Pro
74.5
IFEval
83.6
Chatbot Arena Elo
1285

coding

BenchmarkGemini 2.0 FlashGPT-4o
SWE-bench Verified
33.2
HumanEval
90.2

math

BenchmarkGemini 2.0 FlashGPT-4o
AIME 2024
13.4
MATH
76.6
GSM8K
95.8

language

BenchmarkGemini 2.0 FlashGPT-4o
HellaSwag
96.4
WinoGrande
85.7

safety

BenchmarkGemini 2.0 FlashGPT-4o
TruthfulQA
73.5

Category Winners

coding
GPT-4o
38.2
math
GPT-4o
54.5
reasoning
GPT-4o
54.4
general
GPT-4o
70.5
language
GPT-4o
79.9
multimodal
Gemini 2.0 Flash
58.5
safety
GPT-4o
94.3

Compare More Models

Frequently Asked Questions