Compare AI models

Specifications
Parameters
—24B
Context window
200k128k
Benchmarks
SWE-Bench Verified
72.7%53.6%
Overview
CompanyAnthropicMistral
Release dateMay 22 2025Jul 10 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Claude Sonnet 4 leads Devstral Small 1.1 on 1 of the 1 benchmark they both report (SWE-Bench Verified). Claude Sonnet 4 shipped 49 days before Devstral Small 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude Sonnet 4) vs 128k (Devstral Small 1.1). Claude Sonnet 4 is closed, while Devstral Small 1.1 is open weight.

On SWE-Bench Verified, Claude Sonnet 4 leads at 72.7% vs Devstral Small 1.1 at 53.6%.