Compare AI models

Specifications
Parameters
—24B
Context window
1M128k
Benchmarks
SWE-Bench Verified
12.5%53.6%
Overview
CompanyGoogleMistral
Release dateFeb 5 2025Jul 10 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Devstral Small 1.1 leads Gemini 2.0 Flash-Lite on 1 of the 1 benchmark they both report (SWE-Bench Verified). Gemini 2.0 Flash-Lite shipped 155 days before Devstral Small 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 2.0 Flash-Lite) vs 128k (Devstral Small 1.1). Gemini 2.0 Flash-Lite is closed, while Devstral Small 1.1 is open weight.

On SWE-Bench Verified, Devstral Small 1.1 leads at 53.6% vs Gemini 2.0 Flash-Lite at 12.5%.