Compare AI models

Specifications
Context window
1M128k
Benchmarks
SWE-Bench Verified
12.5%61.6%
Overview
CompanyGoogleMistral
Release dateFeb 5 2025Jul 10 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Devstral Medium leads Gemini 2.0 Flash-Lite on 1 of the 1 benchmark they both report (SWE-Bench Verified). Gemini 2.0 Flash-Lite shipped 155 days before Devstral Medium, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 2.0 Flash-Lite) vs 128k (Devstral Medium).

On SWE-Bench Verified, Devstral Medium leads at 61.6% vs Gemini 2.0 Flash-Lite at 12.5%.