Compare AI models

Specifications
Parameters
—24B
Context window
200k40k
Benchmarks
GPQA Diamond
33.3%65.78%
Overview
CompanyAnthropicMistral
Release dateMar 4 2024Jul 24 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Magistral Small 1.1 leads Claude 3 Haiku on 1 of the 1 benchmark they both report (GPQA Diamond). Claude 3 Haiku shipped 507 days before Magistral Small 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3 Haiku) vs 40k (Magistral Small 1.1). Claude 3 Haiku is closed, while Magistral Small 1.1 is open weight.

On GPQA Diamond, Magistral Small 1.1 leads at 65.78% vs Claude 3 Haiku at 33.3%.