All Comparisons

Gemini 2.5 Pro vs GPT-4.1

Gemini 2.5 Pro
Google πŸ‡ΊπŸ‡Έ
53.6
#156β€”
medium
$1.25/M in Β· $10.00/M out
1.0M context
GPT-4.1
OpenAI πŸ‡ΊπŸ‡Έ
32.8
#238β€”
high
$2.00/M in Β· $8.00/M out
1.0M context
Most Affordable
Gemini 2.5 Pro
$1.25/M input
Largest Context
Gemini 2.5 Pro
1.0M tokens
Best Benchmark Score
Gemini 2.5 Pro
53.6/100

Model Specifications

SpecGemini 2.5 ProGPT-4.1
ProviderGoogleOpenAI
Release DateMay 2025Apr 2025
Knowledge Cutoff2025-01-312024-06-01
ParametersUndisclosedUndisclosed
Context Window1.0M1.0M
Max Outputβ€”β€”
Open SourceNoNo
Licenseproprietaryproprietary
Tokenizerβ€”β€”
Modalityβ€”β€”
Reasoning ModelNoNo
ModeratedNoNo

Pricing Comparison

Price (per 1M tokens)Gemini 2.5 ProGPT-4.1
Input$1.25$2.00
Output$10.00$8.00

API Provider Pricing

Capabilities

FeatureGemini 2.5 ProGPT-4.1
Text Input
Image Input (Vision)
Audio Input
Video Input
File Input
Image Output
Audio Output
Tool Use
Structured Output (JSON)
Streaming
Reasoning Tokens
Web Search
Temperature Control
Top-P Sampling
Stop Sequences
Seed (Reproducibility)
Log Probabilities

Category Comparison

Benchmark-by-Benchmark

general

BenchmarkGemini 2.5 ProGPT-4.1
SimpleQA
50.8
β€”
MMMLUβ€”
87.3

coding

BenchmarkGemini 2.5 ProGPT-4.1
SWE-bench Verified
63.2
54.6

math

BenchmarkGemini 2.5 ProGPT-4.1
AIME 2025
83
46.4

reasoning

BenchmarkGemini 2.5 ProGPT-4.1
GPQA Diamond
83
66.3
Humanity's Last Exam
17.8
5.4
ARC-AGI v2
4.9
β€”

multimodal

BenchmarkGemini 2.5 ProGPT-4.1
MMMU
79.6
74.8
CharXiv Reasoningβ€”
56.7

agent

BenchmarkGemini 2.5 ProGPT-4.1
TAU-Bench Retailβ€”
68

Category Winners

coding
Gemini 2.5 Pro
44.1
math
Gemini 2.5 Pro
57.6
reasoning
Gemini 2.5 Pro
35.3
general
Gemini 2.5 Pro
69.1
multimodal
Gemini 2.5 Pro
80.0
agent
GPT-4.1
50.7

Compare More Models

Frequently Asked Questions