Compare AI models

Specifications
Context window
200k128k
Benchmarks
SWE-Bench Verified
62.3%61.6%
Overview
CompanyAnthropicMistral
Release dateFeb 24 2025Jul 10 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Claude 3.7 Sonnet leads Devstral Medium on 1 of the 1 benchmark they both report (SWE-Bench Verified). Claude 3.7 Sonnet shipped 136 days before Devstral Medium, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.7 Sonnet) vs 128k (Devstral Medium).

On SWE-Bench Verified, Claude 3.7 Sonnet leads at 62.3% vs Devstral Medium at 61.6%.