Compare AI models

Specifications
Context window
2M40k
Benchmarks
LiveCodeBench
34.3%59.35%
GPQA Diamond
59.1%71.46%
Overview
CompanyGoogleMistral
Release dateSep 24 2024Jul 24 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Magistral Medium 1.1 leads Gemini 1.5 Pro-002 on 2 of the 2 benchmarks they both report (LiveCodeBench, GPQA Diamond). Gemini 1.5 Pro-002 shipped 303 days before Magistral Medium 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 2M (Gemini 1.5 Pro-002) vs 40k (Magistral Medium 1.1).

On LiveCodeBench, Magistral Medium 1.1 leads at 59.35% vs Gemini 1.5 Pro-002 at 34.3%. On GPQA Diamond, Magistral Medium 1.1 leads at 71.46% vs Gemini 1.5 Pro-002 at 59.1%.