Compare AI models
| Specifications | ||
Context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider. | 200k | 1.05M |
| API pricingUSD per 1M tokens · lower wins · base tier | ||
Input priceWhat you pay for everything you send the model — your question, plus any documents or earlier conversation you include with it. | — | $8.00 |
Output priceWhat you pay for the text the model writes back. It is normally the dearer half: producing an answer costs more than reading one. | — | $40.00 |
Cached input priceA reduced rate for text you send over and over. If every request starts with the same instructions or the same document, the provider keeps a copy ready and charges less to read it again. | — | $0.40 |
| — | $3,600OpenAI list price | |
| Benchmarks | ||
GPQA DiamondScience — Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better. | 75.4% | 97% |
BullshitBench v2Nonsense detection — Given a confidently-worded but nonsensical prompt, does the AI spot that it makes no sense and push back — instead of playing along and inventing an answer? The score is how often it clearly called out the nonsense. Higher is better. | 30% | — |
Blocker Deception (OpenAI) · without Codex promptBlocker disclosure — share of coding trials where the model omitted or misrepresented an obstacle without the Codex developer prompt | — | 22.28% |
Blocker Deception (OpenAI) · with Codex promptBlocker disclosure — share of coding trials where the model omitted or misrepresented an obstacle with the Codex developer prompt | — | 8.04% |
Simulated Workplace Tasks (OpenAI)High-severity improper actions — share of scored simulated workplace tasks with a high-severity improper action | — | 0.64% |
SWE-Bench VerifiedCoding — Real coding tasks pulled from open-source projects — the AI has to find and fix actual bugs. A human-checked version of the original SWE-Bench. Higher is better. | 72.7% | — |
FrontierCode 2.0Agentic coding — whether a model’s code changes to open-source repositories would be merged by their maintainers (version 2.0); separate from FrontierCode v1.1 scores | — | 44.2% |
BenchCAD 2.1 CoreCAD programming — partial-credit score for modeling hardware designs in the held-out Core evaluation | — | 82.5% |
SecureSWESecure code generation — OpenAI’s internal evaluation of writing code that is both functional and secure | — | 65.7% |
PatchBenchSecurity patching — security patches that fix vulnerabilities while preserving intended behavior | — | 79.7% |
Terminal-Bench-Science 0.1Agentic scientific computing — The same command-line setup as Terminal-Bench, pointed at scientific work: the AI has to drive research tooling and computational workflows through to a result, rather than administer a machine. Version 0.1 is the first release of the task set, and scores run lower than on the general board. Higher is better. | — | 77.1% |
Vals Science Index v1Scientific reasoning — Vals AI’s composite accuracy across three scientific reasoning evaluations | — | 68.4% |
Agents’ Last Exam v1.1Agentic computer use — averaged rubric score on the 122-task v1.1 suite of long-horizon professional workflows | — | 78.3% |
AutomationBench 1.0.6Business workflows — end-to-end business workflow automation on the version 1.0.6 task set | — | 52.4% |
LifeValEveryday tasks — OpenAI’s rubric score for completing practical everyday tasks tailored to a person’s needs | — | 86.1% |
AA-AnalystAgent (pass^5)Financial research — share of quantitative questions about real spreadsheets and reports answered correctly on all five independent attempts | — | 62.5% |
Harvey LAB-AA v1.1Agentic legal work — full-credit rate on legal assignments, requiring every grading criterion to be met without material hallucinations | — | 15% |
HealthBench Professional · OpenAI grading, rawHealth — unadjusted physician-rubric score using the official OpenAI grading procedure | — | 66% |
HealthBench Professional · OpenAI grading, length-adjustedHealth — official OpenAI grading with the response-length penalty applied | — | 66.3% |
MentalHealthBenchMental health — overall clinician-rubric score on mental health conversations | — | 53.3% |
AA Intelligence Index v5.0.1Overall intelligence — Artificial Analysis’s version 5.0.1 composite across nine evaluations of knowledge work, coding, science, and general knowledge | — | 62.1 |
GDPval v2 (OpenAI Internal)Knowledge work — OpenAI’s internal score on multistep professional assignments drawn from consulting, finance, and design projects | — | 50.4% |
MMMUMultimodal — Tests the AI on understanding images and text together across many college subjects. Higher is better. | 74.4% | — |
AA-3DCommunity preference (interactive 3D) — blind human preferences between paired interactive 3D experiences built from the same prompt | — | 1318 |
| Overview | ||
| Company | Anthropic | OpenAI |
| Release date | May 22 2025 | Nov 17 2026 |
| Access | Closed | Closed |
| Model details | View model | View model |
Other comparisons
Claude Sonnet 4vsGemini 4 HydrogenGPT-6.2 AstravsGemini 4 HydrogenClaude Sonnet 4vsMuse EmberGPT-6.2 AstravsMuse EmberClaude Sonnet 4vsGrok 4.7GPT-6.2 AstravsGrok 4.7Claude Sonnet 4vsDeepSeek-V4.1-Flash-1017GPT-6.2 AstravsDeepSeek-V4.1-Flash-1017Claude Sonnet 4vsMistral Large 4GPT-6.2 AstravsMistral Large 4Claude Sonnet 4vsKimi K3.1 ProGPT-6.2 AstravsKimi K3.1 ProFrequently asked questions
GPT-6.2 Astra leads Claude Sonnet 4 on 1 of the 1 benchmark they both report (GPQA Diamond). Only GPT-6.2 Astra has a verified first-party price for an available API: $8.00 per million input tokens and $40.00 per million output tokens. No currently available pay-as-you-go API rate is tracked for Claude Sonnet 4. Claude Sonnet 4 shipped 544 days before GPT-6.2 Astra, so benchmark comparisons should account for the intervening progress.
Context windows are 200k (Claude Sonnet 4) vs 1.05M (GPT-6.2 Astra).
On GPQA Diamond, GPT-6.2 Astra leads at 97% vs Claude Sonnet 4 at 75.4%.