Compare AI models

Specifications
Context window
128k—
Benchmarks
SWE-Bench Verified
61.6%40.9%
Overview
CompanyMistralOpenAI
Release dateJul 10 2025Dec 5 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Devstral Medium leads o1 on 1 of the 1 benchmark they both report (SWE-Bench Verified). o1 shipped 217 days before Devstral Medium, so benchmark comparisons should account for the intervening progress.

Published specifications for these two models are limited — see each model page for the latest details.

On SWE-Bench Verified, Devstral Medium leads at 61.6% vs o1 at 40.9%.