Compare AI models
| Specifications | ||
Context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider. | 1M | 1.05M |
| API pricingUSD per 1M tokens · lower wins · base tier | ||
Input priceWhat you pay for everything you send the model — your question, plus any documents or earlier conversation you include with it. | $0.30 | $2.00 |
Output priceWhat you pay for the text the model writes back. It is normally the dearer half: producing an answer costs more than reading one. | $2.50 | $10.00 |
Cached input priceA reduced rate for text you send over and over. If every request starts with the same instructions or the same document, the provider keeps a copy ready and charges less to read it again. | $0.03 | $0.10 |
Cheapest inputLowest input rate across every provider on OpenRouter, the lab included. The cheapest endpoint may run a quantised build or a shorter context — see "Available from" on the model page. | $0.15Google | — |
Cheapest outputLowest output rate across every provider on OpenRouter, the lab included. May come from a different provider than the cheapest input. | $1.25Google | — |
| $185Google list price | $900OpenAI list price | |
| These models have no shared benchmark scores. | ||
BullshitBench v2Nonsense detection — Given a confidently-worded but nonsensical prompt, does the AI spot that it makes no sense and push back — instead of playing along and inventing an answer? The score is how often it clearly called out the nonsense. Higher is better. | 66% | — |
Blocker Deception (OpenAI) · without Codex promptBlocker disclosure — share of coding trials where the model omitted or misrepresented an obstacle without the Codex developer prompt | — | 24.08% |
Blocker Deception (OpenAI) · with Codex promptBlocker disclosure — share of coding trials where the model omitted or misrepresented an obstacle with the Codex developer prompt | — | 8.88% |
Simulated Workplace Tasks (OpenAI)High-severity improper actions — share of scored simulated workplace tasks with a high-severity improper action | — | 0.71% |
SWE-Bench ProAgentic coding — Can the AI fix real bugs in real software? It's handed actual problems from open-source projects and has to write code that genuinely solves them. Higher is better. | 54.2% | — |
FrontierCode 2.0Agentic coding — whether a model’s code changes to open-source repositories would be merged by their maintainers (version 2.0); separate from FrontierCode v1.1 scores | — | 43.8% |
MLE-BenchML engineering — Can the AI do the work of a machine-learning engineer? It competes in real Kaggle competitions — building, training, and tuning models end to end — and the score reflects how well it places. Higher is better. | 39.2% | — |
BenchCAD 2.1 CoreCAD programming — partial-credit score for modeling hardware designs in the held-out Core evaluation | — | 73.1% |
SecureSWESecure code generation — OpenAI’s internal evaluation of writing code that is both functional and secure | — | 55.6% |
PatchBenchSecurity patching — security patches that fix vulnerabilities while preserving intended behavior | — | 75.6% |
Terminal-Bench 2.1Agentic terminal coding — Can the AI work in a command-line terminal — running commands and finishing technical setup tasks the way a developer would? Higher is better. | 54% | — |
Terminal-Bench-Science 0.1Agentic scientific computing — The same command-line setup as Terminal-Bench, pointed at scientific work: the AI has to drive research tooling and computational workflows through to a result, rather than administer a machine. Version 0.1 is the first release of the task set, and scores run lower than on the general board. Higher is better. | — | 68% |
BU BenchBrowser agent — Can the AI drive a real web browser to finish tasks — clicking, filling forms, and navigating sites the way a person would? Run by Browser Use on their BU Bench task set. Higher is better. | 49% | — |
GPQA DiamondScience — Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better. | — | 96% |
Vals Science Index v1Scientific reasoning — Vals AI’s composite accuracy across three scientific reasoning evaluations | — | 58.5% |
Agents’ Last Exam v1.1Agentic computer use — averaged rubric score on the 122-task v1.1 suite of long-horizon professional workflows | — | 73% |
OSWorld-VerifiedAgentic computer use — Can the AI actually operate a computer — clicking, typing, and using real apps — to finish tasks on its own? Higher is better. | 74% | — |
AutomationBench 1.0.6Business workflows — end-to-end business workflow automation on the version 1.0.6 task set | — | 41.1% |
LifeValEveryday tasks — OpenAI’s rubric score for completing practical everyday tasks tailored to a person’s needs | — | 83.8% |
Harvey LAB-AA v1.1Agentic legal work — full-credit rate on legal assignments, requiring every grading criterion to be met without material hallucinations | — | 11.1% |
HealthBench Professional · OpenAI grading, rawHealth — unadjusted physician-rubric score using the official OpenAI grading procedure | — | 65.5% |
HealthBench Professional · OpenAI grading, length-adjustedHealth — official OpenAI grading with the response-length penalty applied | — | 65.9% |
MentalHealthBenchMental health — overall clinician-rubric score on mental health conversations | — | 50.9% |
AA Intelligence Index v5.0.1Overall intelligence — Artificial Analysis’s version 5.0.1 composite across nine evaluations of knowledge work, coding, science, and general knowledge | — | 57.3 |
GDPval-AA v2Knowledge work — economically valuable knowledge work (v2, re-based Elo) | 1140 | — |
GDPval v2 (OpenAI Internal)Knowledge work — OpenAI’s internal score on multistep professional assignments drawn from consulting, finance, and design projects | — | 46.9% |
CharXiv ReasoningChart reasoning — Can the AI read and reason about complex charts and figures, not just text? Higher is better. | 74.5% | — |
CharXiv Reasoning · with toolsChart reasoning — The same chart-and-figure reasoning test, run with the AI allowed to use tools — writing code to inspect the image, for instance — rather than reading the chart unaided. Scores run higher than the unaided version, so read the two as separate tests. Higher is better. | 76.5% | — |
MRCR v2 (8-needle) · 128k averageLong context — Tests whether the AI can find specific details buried inside a very long document (around 128k tokens — roughly a long book). Higher is better. | 72.2% | — |
MRCR v2 (8-needle) · 1M pointwiseLong context — Tests whether the AI can find specific details buried inside an enormous document (around 1 million tokens — many books). Higher is better. | 21.3% | — |
AA-3DCommunity preference (interactive 3D) — blind human preferences between paired interactive 3D experiences built from the same prompt | — | 1259 |
| Overview | ||
| Company | OpenAI | |
| Release date | Jul 21 2026 | Nov 17 2026 |
| Access | Closed | Closed |
| Model details | View model | View model |
Other comparisons
Gemini 3.5 Flash-LitevsClaude Fable 5.2GPT-6.2 SolvsClaude Fable 5.2Gemini 3.5 Flash-LitevsMuse EmberGPT-6.2 SolvsMuse EmberGemini 3.5 Flash-LitevsGrok 4.7GPT-6.2 SolvsGrok 4.7Gemini 3.5 Flash-LitevsDeepSeek-V4.1-Flash-1017GPT-6.2 SolvsDeepSeek-V4.1-Flash-1017Gemini 3.5 Flash-LitevsMistral Large 4GPT-6.2 SolvsMistral Large 4Gemini 3.5 Flash-LitevsKimi K3.1 ProGPT-6.2 SolvsKimi K3.1 ProFrequently asked questions
Gemini 3.5 Flash-Lite and GPT-6.2 Sol don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Gemini 3.5 Flash-Lite is cheaper on both input and output: $0.30 vs $2.00 per million input tokens, and $2.50 vs $10.00 per million output tokens. Figures are base-tier rates. Gemini 3.5 Flash-Lite shipped 119 days before GPT-6.2 Sol, so benchmark comparisons should account for the intervening progress.
Context windows are 1M (Gemini 3.5 Flash-Lite) vs 1.05M (GPT-6.2 Sol).
Direct benchmark comparisons are unavailable — Gemini 3.5 Flash-Lite and GPT-6.2 Sol don't publish scores on any of the same benchmarks.