Compare AI models

Specifications
Context window
200k—
API pricing
Input price
$2.00—
Output price
$8.00—
Cached input price
$0.50—
Cheapest input
$2.00OpenAI—
Cheapest output
$8.00OpenAI—
$800OpenAI list price—
Benchmarks
HumanEval
87.4%85.7%
MMLU
92.9%86.2%
Overview
CompanyOpenAISpaceXSI
Release dateApr 16 2025Aug 13 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

o3 leads Grok‑2 mini on 2 of the 2 benchmarks they both report (HumanEval, MMLU). Only o3 has a verified first-party price for an available API: $2.00 per million input tokens and $8.00 per million output tokens. No currently available pay-as-you-go API rate is tracked for Grok‑2 mini. Grok‑2 mini shipped 246 days before o3, so benchmark comparisons should account for the intervening progress.

Published specifications for these two models are limited — see each model page for the latest details.

On HumanEval, o3 leads at 87.4% vs Grok‑2 mini at 85.7%. On MMLU, o3 leads at 92.9% vs Grok‑2 mini at 86.2%.