Compare AI models

Specifications
Context window
128k—
Benchmarks
HumanEval
83.7%85.7%
MATH
64.3%73%
MMLU
84.7%86.2%
Overview
CompanyOpenAISpaceXSI
Release dateNov 6 2023Aug 13 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 mini leads GPT-4 Turbo on 3 of the 3 benchmarks they both report (HumanEval, MATH, MMLU). GPT-4 Turbo shipped 281 days before Grok‑2 mini, so benchmark comparisons should account for the intervening progress.

Published specifications for these two models are limited — see each model page for the latest details.

On HumanEval, Grok‑2 mini leads at 85.7% vs GPT-4 Turbo at 83.7%. On MATH, Grok‑2 mini leads at 73% vs GPT-4 Turbo at 64.3%. On MMLU, Grok‑2 mini leads at 86.2% vs GPT-4 Turbo at 84.7%.