Compare AI models

Specifications
Parameters
—24B
Context window
200k128k
Benchmarks
GPQA Diamond
75.4%70.07%
Overview
CompanyAnthropicMistral
Release dateMay 22 2025Sep 17 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Claude Sonnet 4 leads Magistral Small 1.2 on 1 of the 1 benchmark they both report (GPQA Diamond). Claude Sonnet 4 shipped 118 days before Magistral Small 1.2, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude Sonnet 4) vs 128k (Magistral Small 1.2). Claude Sonnet 4 is closed, while Magistral Small 1.2 is open weight.

On GPQA Diamond, Claude Sonnet 4 leads at 75.4% vs Magistral Small 1.2 at 70.07%.