Compare AI models

Specifications
Context window
1M—
Benchmarks
MATH
77.9%73%
MMLU-Pro
67.3%72%
MMMU
62.3%63.2%
Overview
CompanyGoogleSpaceXSI
Release dateSep 24 2024Aug 13 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 mini leads Gemini 1.5 Flash-002 on 2 of the 3 benchmarks they both report (MATH, MMLU-Pro, MMMU). Grok‑2 mini shipped 42 days before Gemini 1.5 Flash-002, so benchmark comparisons should account for the intervening progress.

Published specifications for these two models are limited — see each model page for the latest details.

On MATH, Gemini 1.5 Flash-002 leads at 77.9% vs Grok‑2 mini at 73%. On MMLU-Pro, Grok‑2 mini leads at 72% vs Gemini 1.5 Flash-002 at 67.3%. On MMMU, Grok‑2 mini leads at 63.2% vs Gemini 1.5 Flash-002 at 62.3%.