Compare AI models

Specifications
Parameters
5.1B/8B/26B/31B24B
Context window
—40k
API pricing
Cheapest input
$0.04Darkbloom—
Cheapest output
$0.10Modal—
$15.50Darkbloom—
Benchmarks
LiveCodeBench
80%59.17%
GPQA Diamond
84.3%65.78%
Overview
CompanyGoogleMistral
Release dateApr 2 2026Jul 24 2025
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Gemma 4 leads Magistral Small 1.1 on 2 of the 2 benchmarks they both report (LiveCodeBench, GPQA Diamond). Magistral Small 1.1 shipped 252 days before Gemma 4, so benchmark comparisons should account for the intervening progress.

Gemma 4 has 5.1B/8B/26B/31B parameters, while Magistral Small 1.1 has 24B.

On LiveCodeBench, Gemma 4 leads at 80% vs Magistral Small 1.1 at 59.17%. On GPQA Diamond, Gemma 4 leads at 84.3% vs Magistral Small 1.1 at 65.78%.