Compare AI models

Specifications
Context window
1M128k
Benchmarks
SWE-Bench Verified
21.4%61.6%
Overview
CompanyGoogleMistral
Release dateDec 11 2024Jul 10 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Devstral Medium leads Gemini 2.0 Flash on 1 of the 1 benchmark they both report (SWE-Bench Verified). Gemini 2.0 Flash shipped 211 days before Devstral Medium, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 2.0 Flash) vs 128k (Devstral Medium).

On SWE-Bench Verified, Devstral Medium leads at 61.6% vs Gemini 2.0 Flash at 21.4%.