Compare AI models
| Specifications | ||
ParametersThe learned values that shape how a model responds. B means billion and T means trillion. For mixture-of-experts models, the total count is larger than the number active for each token. Parameter count alone does not measure quality. | 24B | — |
Context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider. | 40k | 1.05M |
| API pricingUSD per 1M tokens · lower wins · base tier | ||
Input priceWhat you pay for everything you send the model — your question, plus any documents or earlier conversation you include with it. | — | $8.00 |
Output priceWhat you pay for the text the model writes back. It is normally the dearer half: producing an answer costs more than reading one. | — | $40.00 |
Cached input priceA reduced rate for text you send over and over. If every request starts with the same instructions or the same document, the provider keeps a copy ready and charges less to read it again. | — | $0.40 |
| — | $3,600OpenAI list price | |
| Benchmarks | ||
GPQA DiamondScience — Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better. | 68.18% | 97% |
Blocker Deception (OpenAI) · without Codex promptBlocker disclosure — share of coding trials where the model omitted or misrepresented an obstacle without the Codex developer prompt | — | 22.28% |
Blocker Deception (OpenAI) · with Codex promptBlocker disclosure — share of coding trials where the model omitted or misrepresented an obstacle with the Codex developer prompt | — | 8.04% |
Simulated Workplace Tasks (OpenAI)High-severity improper actions — share of scored simulated workplace tasks with a high-severity improper action | — | 0.64% |
FrontierCode 2.0Agentic coding — whether a model’s code changes to open-source repositories would be merged by their maintainers (version 2.0); separate from FrontierCode v1.1 scores | — | 44.2% |
BenchCAD 2.1 CoreCAD programming — partial-credit score for modeling hardware designs in the held-out Core evaluation | — | 82.5% |
SecureSWESecure code generation — OpenAI’s internal evaluation of writing code that is both functional and secure | — | 65.7% |
PatchBenchSecurity patching — security patches that fix vulnerabilities while preserving intended behavior | — | 79.7% |
LiveCodeBenchCompetitive coding — Coding problems published so recently the AI can't have seen them in training — a contamination-free test of raw programming skill. Higher is better. | 55.84% | — |
Terminal-Bench-Science 0.1Agentic scientific computing — The same command-line setup as Terminal-Bench, pointed at scientific work: the AI has to drive research tooling and computational workflows through to a result, rather than administer a machine. Version 0.1 is the first release of the task set, and scores run lower than on the general board. Higher is better. | — | 77.1% |
AIME 2024Reasoning — single-answer accuracy on the 2024 invitational mathematics exam without tools | 70.68% | — |
AIME 2025Reasoning — single-answer accuracy on the 2025 invitational mathematics exam without tools | 62.76% | — |
Vals Science Index v1Scientific reasoning — Vals AI’s composite accuracy across three scientific reasoning evaluations | — | 68.4% |
Agents’ Last Exam v1.1Agentic computer use — averaged rubric score on the 122-task v1.1 suite of long-horizon professional workflows | — | 78.3% |
AutomationBench 1.0.6Business workflows — end-to-end business workflow automation on the version 1.0.6 task set | — | 52.4% |
LifeValEveryday tasks — OpenAI’s rubric score for completing practical everyday tasks tailored to a person’s needs | — | 86.1% |
AA-AnalystAgent (pass^5)Financial research — share of quantitative questions about real spreadsheets and reports answered correctly on all five independent attempts | — | 62.5% |
Harvey LAB-AA v1.1Agentic legal work — full-credit rate on legal assignments, requiring every grading criterion to be met without material hallucinations | — | 15% |
HealthBench Professional · OpenAI grading, rawHealth — unadjusted physician-rubric score using the official OpenAI grading procedure | — | 66% |
HealthBench Professional · OpenAI grading, length-adjustedHealth — official OpenAI grading with the response-length penalty applied | — | 66.3% |
MentalHealthBenchMental health — overall clinician-rubric score on mental health conversations | — | 53.3% |
AA Intelligence Index v5.0.1Overall intelligence — Artificial Analysis’s version 5.0.1 composite across nine evaluations of knowledge work, coding, science, and general knowledge | — | 62.1 |
GDPval v2 (OpenAI Internal)Knowledge work — OpenAI’s internal score on multistep professional assignments drawn from consulting, finance, and design projects | — | 50.4% |
AA-3DCommunity preference (interactive 3D) — blind human preferences between paired interactive 3D experiences built from the same prompt | — | 1318 |
| Overview | ||
| Company | Mistral | OpenAI |
| Release date | Jun 10 2025 | Nov 17 2026 |
| Access | Open Weight | Closed |
| Model details | View model | View model |
Other comparisons
Magistral SmallvsClaude Fable 5.2GPT-6.2 AstravsClaude Fable 5.2Magistral SmallvsGemini 4 HydrogenGPT-6.2 AstravsGemini 4 HydrogenMagistral SmallvsMuse EmberGPT-6.2 AstravsMuse EmberMagistral SmallvsGrok 4.7GPT-6.2 AstravsGrok 4.7Magistral SmallvsDeepSeek-V4.1-Flash-1017GPT-6.2 AstravsDeepSeek-V4.1-Flash-1017Magistral SmallvsKimi K3.1 ProGPT-6.2 AstravsKimi K3.1 ProFrequently asked questions
GPT-6.2 Astra leads Magistral Small on 1 of the 1 benchmark they both report (GPQA Diamond). Only GPT-6.2 Astra has a verified first-party price for an available API: $8.00 per million input tokens and $40.00 per million output tokens. No currently available pay-as-you-go API rate is tracked for Magistral Small. Magistral Small shipped 525 days before GPT-6.2 Astra, so benchmark comparisons should account for the intervening progress.
Context windows are 40k (Magistral Small) vs 1.05M (GPT-6.2 Astra). Magistral Small is open weight, while GPT-6.2 Astra is closed.
On GPQA Diamond, GPT-6.2 Astra leads at 97% vs Magistral Small at 68.18%.