Compare AI models

Specifications
Context window
200k40k
Benchmarks
GPQA Diamond
65%71.46%
Overview
CompanyAnthropicMistral
Release dateOct 22 2024Jul 24 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Magistral Medium 1.1 leads Claude 3.5 Sonnet (upgraded) on 1 of the 1 benchmark they both report (GPQA Diamond). Claude 3.5 Sonnet (upgraded) shipped 275 days before Magistral Medium 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.5 Sonnet (upgraded)) vs 40k (Magistral Medium 1.1).

On GPQA Diamond, Magistral Medium 1.1 leads at 71.46% vs Claude 3.5 Sonnet (upgraded) at 65%.