Compare AI models

Specifications
Parameters
24B—
Context window
128k—
Benchmarks
SWE-Bench Verified
53.6%40.9%
Overview
CompanyMistralOpenAI
Release dateJul 10 2025Dec 5 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Devstral Small 1.1 leads o1 on 1 of the 1 benchmark they both report (SWE-Bench Verified). o1 shipped 217 days before Devstral Small 1.1, so benchmark comparisons should account for the intervening progress.

Devstral Small 1.1 is open weight, while o1 is closed.

On SWE-Bench Verified, Devstral Small 1.1 leads at 53.6% vs o1 at 40.9%.