Compare AI models

Specifications
Parameters
—24B
Context window
200k40k
Benchmarks
GPQA Diamond
59.4%65.78%
Overview
CompanyAnthropicMistral
Release dateJun 20 2024Jul 24 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Magistral Small 1.1 leads Claude 3.5 Sonnet on 1 of the 1 benchmark they both report (GPQA Diamond). Claude 3.5 Sonnet shipped 399 days before Magistral Small 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.5 Sonnet) vs 40k (Magistral Small 1.1). Claude 3.5 Sonnet is closed, while Magistral Small 1.1 is open weight.

On GPQA Diamond, Magistral Small 1.1 leads at 65.78% vs Claude 3.5 Sonnet at 59.4%.