Compare AI models

Specifications
Context window
1M40k
Benchmarks
LiveCodeBench
30%59.35%
GPQA Diamond
51%71.46%
Overview
CompanyGoogleMistral
Release dateSep 24 2024Jul 24 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Magistral Medium 1.1 leads Gemini 1.5 Flash-002 on 2 of the 2 benchmarks they both report (LiveCodeBench, GPQA Diamond). Gemini 1.5 Flash-002 shipped 303 days before Magistral Medium 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 1.5 Flash-002) vs 40k (Magistral Medium 1.1).

On LiveCodeBench, Magistral Medium 1.1 leads at 59.35% vs Gemini 1.5 Flash-002 at 30%. On GPQA Diamond, Magistral Medium 1.1 leads at 71.46% vs Gemini 1.5 Flash-002 at 51%.