Compare AI models

Specifications
Parameters
24B—
Context window
128k128k
Benchmarks
AIME 2024
86.14%44.6%
GPQA Diamond
70.07%73.3%
Overview
CompanyMistralOpenAI
Release dateSep 17 2025Sep 12 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Magistral Small 1.2 and o1-preview are evenly matched across the 2 benchmarks they both report (AIME 2024, GPQA Diamond). o1-preview shipped 370 days before Magistral Small 1.2, so benchmark comparisons should account for the intervening progress.

Context windows are 128k (Magistral Small 1.2) vs 128k (o1-preview). Magistral Small 1.2 is open weight, while o1-preview is closed.

On AIME 2024, Magistral Small 1.2 leads at 86.14% vs o1-preview at 44.6%. On GPQA Diamond, o1-preview leads at 73.3% vs Magistral Small 1.2 at 70.07%.