Compare AI models

Specifications
Parameters
24B—
Context window
128k—
API pricing
Cheapest input
$0.351Cloudflare—
Cheapest output
$0.555Cloudflare—
$97.95Cloudflare—
Benchmarks
HumanEval
88.41%85.7%
MMLU
80.62%86.2%
MMMU
64%63.2%
Overview
CompanyMistralSpaceXSI
Release dateMar 17 2025Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Mistral Small 3.1 leads Grok‑2 mini on 2 of the 3 benchmarks they both report (HumanEval, MMLU, MMMU). Grok‑2 mini shipped 216 days before Mistral Small 3.1, so benchmark comparisons should account for the intervening progress.

Mistral Small 3.1 is open weight, while Grok‑2 mini is closed.

On HumanEval, Mistral Small 3.1 leads at 88.41% vs Grok‑2 mini at 85.7%. On MMLU, Grok‑2 mini leads at 86.2% vs Mistral Small 3.1 at 80.62%. On MMMU, Mistral Small 3.1 leads at 64% vs Grok‑2 mini at 63.2%.