Compare AI models

Specifications
Context window
1M128k
Benchmarks
GPQA Diamond
51%65.7%
MMLU-Pro
67.3%76.8%
Overview
CompanyGoogleMistral
Release dateSep 24 2024Aug 12 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Mistral Medium 3.1 leads Gemini 1.5 Flash-002 on 2 of the 2 benchmarks they both report (GPQA Diamond, MMLU-Pro). Gemini 1.5 Flash-002 shipped 322 days before Mistral Medium 3.1, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 1.5 Flash-002) vs 128k (Mistral Medium 3.1).

On GPQA Diamond, Mistral Medium 3.1 leads at 65.7% vs Gemini 1.5 Flash-002 at 51%. On MMLU-Pro, Mistral Medium 3.1 leads at 76.8% vs Gemini 1.5 Flash-002 at 67.3%.