Compare AI models

Specifications
Context window
200k40k
Benchmarks
GPQA Diamond
41.6%71.46%
Overview
CompanyAnthropicMistral
Release dateOct 22 2024Jul 24 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Magistral Medium 1.1 leads Claude 3.5 Haiku on 1 of the 1 benchmark they both report (GPQA Diamond). Claude 3.5 Haiku shipped 275 days before Magistral Medium 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.5 Haiku) vs 40k (Magistral Medium 1.1).

On GPQA Diamond, Magistral Medium 1.1 leads at 71.46% vs Claude 3.5 Haiku at 41.6%.