Compare AI models

Specifications
Parameters
24B—
Context window
40k128k
Benchmarks
AIME 2024
70.52%44.6%
GPQA Diamond
65.78%73.3%
Overview
CompanyMistralOpenAI
Release dateJul 24 2025Sep 12 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Magistral Small 1.1 and o1-preview are evenly matched across the 2 benchmarks they both report (AIME 2024, GPQA Diamond). o1-preview shipped 315 days before Magistral Small 1.1, so benchmark comparisons should account for the intervening progress.

Context windows are 40k (Magistral Small 1.1) vs 128k (o1-preview). Magistral Small 1.1 is open weight, while o1-preview is closed.

On AIME 2024, Magistral Small 1.1 leads at 70.52% vs o1-preview at 44.6%. On GPQA Diamond, o1-preview leads at 73.3% vs Magistral Small 1.1 at 65.78%.