AI Model Release Tracker

Claude 3.5 Sonnet

Released

Claude 3.5 Sonnet is an AI model released by Anthropic on Thursday, Jun 20 2024, 108 days after Claude 3 Opus. Benchmark results (shown below) cover BullshitBench v2, SWE-Bench Verified, and GPQA Diamond.

Benchmarks

Coding

SWE-Bench VerifiedCoding — Real coding tasks pulled from open-source projects — the AI has to find and fix actual bugs. A human-checked version of the original SWE-Bench. Higher is better.
33.4%
#57 of 59

Reasoning & science

GPQA DiamondScience — Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better.
59.4%
#54 of 61

Robustness

BullshitBench v2Nonsense detection — Given a confidently-worded but nonsensical prompt, does the AI spot that it makes no sense and push back — instead of playing along and inventing an answer? The score is how often it clearly called out the nonsense. Higher is better.
46%
#46 of 97

Compare Claude 3.5 Sonnet with

Claude 3.5 Sonnet

Suggested comparisons

Claude 3.5 SonnetvsClaude Haiku 5.5Claude 3.5 SonnetvsGPT-6.1 SolClaude 3.5 SonnetvsGemini 4 ArgonClaude 3.5 SonnetvsMuse Spark OpenClaude 3.5 SonnetvsGrok 4.7Claude 3.5 SonnetvsDeepSeek-V4.1-Flash-1017Claude 3.5 SonnetvsMistral Large 4Claude 3.5 SonnetvsKimi K3Claude 3.5 SonnetvsGLM-5.3-FlashClaude 3.5 SonnetvsQwen3.8-Max-0902Claude 3.5 SonnetvsNemotron 3.5 Super VL

About

Claude 3.5 Sonnet, released June 20, 2024, was the model that made Claude a default choice for developers. Despite being a mid-tier model, it outperformed the larger Claude 3 Opus while running roughly twice as fast at a fraction of the cost, and its coding and vision abilities set a new bar for the price point. It launched together with Artifacts in the Claude app, which turned chat output into live, editable documents and code.

On benchmarks it jumped to 59.4% on GPQA Diamond — nine points over Opus — and it became the base of one of the most-used model lines in AI-assisted programming. An upgraded version followed on October 22, 2024, lifting SWE-Bench Verified to 49.0% and introducing computer use, before Claude 3.7 Sonnet succeeded the line in February 2025.

Frequently asked questions

Claude 3.5 Sonnet was released by Anthropic on Thursday, Jun 20 2024.

All Anthropic releases

30 tracked