Compare AI models

Specifications
Context window
200k128k
Benchmarks
GPQA Diamond
75.4%65.7%
Overview
CompanyAnthropicMistral
Release dateMay 22 2025Aug 12 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Claude Sonnet 4 leads Mistral Medium 3.1 on 1 of the 1 benchmark they both report (GPQA Diamond). Claude Sonnet 4 shipped 82 days before Mistral Medium 3.1, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude Sonnet 4) vs 128k (Mistral Medium 3.1).

On GPQA Diamond, Claude Sonnet 4 leads at 75.4% vs Mistral Medium 3.1 at 65.7%.