Compare AI models

Specifications
Context window
8k—
API pricing
Cheapest input
$30.00Azure—
Cheapest output
$60.00Azure—
$9,000Azure—
Benchmarks
HumanEval
67%85.7%
MMLU
86.4%86.2%
Overview
CompanyOpenAISpaceXSI
Release dateMar 14 2023Aug 13 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

GPT-4 and Grok‑2 mini are evenly matched across the 2 benchmarks they both report (HumanEval, MMLU). GPT-4 shipped 518 days before Grok‑2 mini, so benchmark comparisons should account for the intervening progress.

Published specifications for these two models are limited — see each model page for the latest details.

On HumanEval, Grok‑2 mini leads at 85.7% vs GPT-4 at 67%. On MMLU, GPT-4 leads at 86.4% vs Grok‑2 mini at 86.2%.