Compare AI models

Specifications
Context window
1M128k
Benchmarks
GPQA Diamond
51.5%65.7%
MMLU-Pro
71.6%76.8%
Overview
CompanyGoogleMistral
Release dateFeb 5 2025Aug 12 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Mistral Medium 3.1 leads Gemini 2.0 Flash-Lite on 2 of the 2 benchmarks they both report (GPQA Diamond, MMLU-Pro). Gemini 2.0 Flash-Lite shipped 188 days before Mistral Medium 3.1, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 2.0 Flash-Lite) vs 128k (Mistral Medium 3.1).

On GPQA Diamond, Mistral Medium 3.1 leads at 65.7% vs Gemini 2.0 Flash-Lite at 51.5%. On MMLU-Pro, Mistral Medium 3.1 leads at 76.8% vs Gemini 2.0 Flash-Lite at 71.6%.