Compare AI models

Specifications
Parameters
24B—
Context window
40k256k
Benchmarks
LiveCodeBench
59.17%79%
AIME 2025
62.03%91.7%
GPQA Diamond
65.78%87.5%
Overview
CompanyMistralSpaceXSI
Release dateJul 24 2025Jul 9 2025
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok 4 leads Magistral Small 1.1 on 3 of the 3 benchmarks they both report (LiveCodeBench, AIME 2025, GPQA Diamond). Grok 4 shipped 15 days before Magistral Small 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 40k (Magistral Small 1.1) vs 256k (Grok 4). Magistral Small 1.1 is open weight, while Grok 4 is closed.

On LiveCodeBench, Grok 4 leads at 79% vs Magistral Small 1.1 at 59.17%. On AIME 2025, Grok 4 leads at 91.7% vs Magistral Small 1.1 at 62.03%. On GPQA Diamond, Grok 4 leads at 87.5% vs Magistral Small 1.1 at 65.78%.