Compare AI models

Specifications
Context window
40k256k
Benchmarks
LiveCodeBench
59.35%79%
AIME 2025
60.99%91.7%
GPQA Diamond
71.46%87.5%
Overview
CompanyMistralSpaceXSI
Release dateJul 24 2025Jul 9 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Grok 4 leads Magistral Medium 1.1 on 3 of the 3 benchmarks they both report (LiveCodeBench, AIME 2025, GPQA Diamond). Grok 4 shipped 15 days before Magistral Medium 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 40k (Magistral Medium 1.1) vs 256k (Grok 4).

On LiveCodeBench, Grok 4 leads at 79% vs Magistral Medium 1.1 at 59.35%. On AIME 2025, Grok 4 leads at 91.7% vs Magistral Medium 1.1 at 60.99%. On GPQA Diamond, Grok 4 leads at 87.5% vs Magistral Medium 1.1 at 71.46%.