Compare AI models

Specifications
Context window
200k—
Benchmarks
HumanEval
97.3%85.7%
MMLU
90%86.2%
Overview
CompanyOpenAISpaceXSI
Release dateApr 16 2025Aug 13 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

o4-mini leads Grok‑2 mini on 2 of the 2 benchmarks they both report (HumanEval, MMLU). Grok‑2 mini shipped 246 days before o4-mini, so benchmark comparisons should account for the intervening progress.

Published specifications for these two models are limited — see each model page for the latest details.

On HumanEval, o4-mini leads at 97.3% vs Grok‑2 mini at 85.7%. On MMLU, o4-mini leads at 90% vs Grok‑2 mini at 86.2%.