Compare AI models

Specifications
Context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider.
200k200k
Benchmarks
GPQA DiamondScience — Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better.
40.4%78.2%
MMMUMultimodal — Tests the AI on understanding images and text together across many college subjects. Higher is better.
53.1%75%
Overview
CompanyAnthropicAnthropic
Release dateMar 4 2024Feb 24 2025
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Claude 3.7 Sonnet leads Claude 3 Sonnet on 2 of the 2 benchmarks they both report (GPQA Diamond, MMMU). Claude 3 Sonnet shipped 357 days before Claude 3.7 Sonnet, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3 Sonnet) vs 200k (Claude 3.7 Sonnet).

On GPQA Diamond, Claude 3.7 Sonnet leads at 78.2% vs Claude 3 Sonnet at 40.4%. On MMMU, Claude 3.7 Sonnet leads at 75% vs Claude 3 Sonnet at 53.1%.