Compare AI models

Specifications
Parameters
1B/4B/12B/27B—
Context window
—128k
API pricing
Cheapest input
$0.04DeepInfra—
Cheapest output
$0.08DeepInfra—
$15.00DeepInfra · bf16—
Benchmarks
GPQA Diamond
42.4%65.7%
MMLU-Pro
67.5%76.8%
Overview
CompanyGoogleMistral
Release dateMar 12 2025Aug 12 2025
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Mistral Medium 3.1 leads Gemma 3 on 2 of the 2 benchmarks they both report (GPQA Diamond, MMLU-Pro). Gemma 3 shipped 153 days before Mistral Medium 3.1, so benchmark comparisons should account for the intervening progress.

Gemma 3 is open weight, while Mistral Medium 3.1 is closed.

On GPQA Diamond, Mistral Medium 3.1 leads at 65.7% vs Gemma 3 at 42.4%. On MMLU-Pro, Mistral Medium 3.1 leads at 76.8% vs Gemma 3 at 67.5%.