Compare AI models

Specifications
Parameters
—24B
Context window
200k40k
Benchmarks
GPQA Diamond
41.6%65.78%
Overview
CompanyAnthropicMistral
Release dateOct 22 2024Jul 24 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Magistral Small 1.1 leads Claude 3.5 Haiku on 1 of the 1 benchmark they both report (GPQA Diamond). Claude 3.5 Haiku shipped 275 days before Magistral Small 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.5 Haiku) vs 40k (Magistral Small 1.1). Claude 3.5 Haiku is closed, while Magistral Small 1.1 is open weight.

On GPQA Diamond, Magistral Small 1.1 leads at 65.78% vs Claude 3.5 Haiku at 41.6%.