Compare AI models

Specifications
Context window
2M—
Benchmarks
MATH
86.5%73%
MMLU-Pro
75.8%72%
MMMU
65.9%63.2%
Overview
CompanyGoogleSpaceXSI
Release dateSep 24 2024Aug 13 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Gemini 1.5 Pro-002 leads Grok‑2 mini on 3 of the 3 benchmarks they both report (MATH, MMLU-Pro, MMMU). Grok‑2 mini shipped 42 days before Gemini 1.5 Pro-002, so benchmark comparisons should account for the intervening progress.

Published specifications for these two models are limited — see each model page for the latest details.

On MATH, Gemini 1.5 Pro-002 leads at 86.5% vs Grok‑2 mini at 73%. On MMLU-Pro, Gemini 1.5 Pro-002 leads at 75.8% vs Grok‑2 mini at 72%. On MMMU, Gemini 1.5 Pro-002 leads at 65.9% vs Grok‑2 mini at 63.2%.