Compare AI models

Specifications
Context window
128k—
API pricing
Cheapest input
$0.40Mistral—
Cheapest output
$2.00Mistral—
$180Mistral · zdr—
Benchmarks
HumanEval
92.1%85.7%
MMLU-Pro
77.2%72%
MMMU
66.1%63.2%
Overview
CompanyMistralSpaceXSI
Release dateMay 7 2025Aug 13 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Mistral Medium 3 leads Grok‑2 mini on 3 of the 3 benchmarks they both report (HumanEval, MMLU-Pro, MMMU). Grok‑2 mini shipped 267 days before Mistral Medium 3, so benchmark comparisons should account for the intervening progress.

Published specifications for these two models are limited — see each model page for the latest details.

On HumanEval, Mistral Medium 3 leads at 92.1% vs Grok‑2 mini at 85.7%. On MMLU-Pro, Mistral Medium 3 leads at 77.2% vs Grok‑2 mini at 72%. On MMMU, Mistral Medium 3 leads at 66.1% vs Grok‑2 mini at 63.2%.