Compare AI models

Specifications
Context window
200k40k
Benchmarks
GPQA Diamond
78.2%71.46%
Overview
CompanyAnthropicMistral
Release dateFeb 24 2025Jul 24 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Claude 3.7 Sonnet leads Magistral Medium 1.1 on 1 of the 1 benchmark they both report (GPQA Diamond). Claude 3.7 Sonnet shipped 150 days before Magistral Medium 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.7 Sonnet) vs 40k (Magistral Medium 1.1).

On GPQA Diamond, Claude 3.7 Sonnet leads at 78.2% vs Magistral Medium 1.1 at 71.46%.