Compare AI models

Specifications
Parameters
24B—
Context window
128k200k
Benchmarks
SWE-Bench Verified
53.6%49.3%
Overview
CompanyMistralOpenAI
Release dateJul 10 2025Jan 31 2025
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Devstral Small 1.1 leads o3-mini-high on 1 of the 1 benchmark they both report (SWE-Bench Verified). o3-mini-high shipped 160 days before Devstral Small 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 128k (Devstral Small 1.1) vs 200k (o3-mini-high). Devstral Small 1.1 is open weight, while o3-mini-high is closed.

On SWE-Bench Verified, Devstral Small 1.1 leads at 53.6% vs o3-mini-high at 49.3%.