# Claude 3.5 Sonnet

Claude 3.5 Sonnet is an AI model released by Anthropic on Jun 20 2024. At release it scored 45% on BullshitBench v2, 59.4% on GPQA Diamond and 33.4% on SWE-Bench Verified.

## Facts

| Field | Value |
| --- | --- |
| Model | Claude 3.5 Sonnet |
| Developer | Anthropic |
| Release date | Thursday, Jun 20 2024 |
| Licensing | Proprietary |

## Benchmark scores published at release

| Benchmark | Score | Source | What it measures |
| --- | --- | --- | --- |
| BullshitBench v2 | 45% | Lab | Given a confidently-worded but nonsensical prompt, does the AI spot that it makes no sense and push back — instead of playing along and inventing an answer? The score is how often it clearly called out the nonsense. Higher is better. |
| SWE-Bench Verified | 33.4% | Lab | Real coding tasks pulled from open-source projects — the AI has to find and fix actual bugs. A human-checked version of the original SWE-Bench. Higher is better. |
| GPQA Diamond | 59.4% | Lab | Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better. |

## About Claude 3.5 Sonnet

Claude 3.5 Sonnet, released June 20, 2024, was the model that made Claude a default choice for developers. Despite being a mid-tier model, it outperformed the larger Claude 3 Opus while running roughly twice as fast at a fraction of the cost, and its coding and vision abilities set a new bar for the price point. It launched together with Artifacts in the Claude app, which turned chat output into live, editable documents and code.

On benchmarks it jumped to 59.4% on GPQA Diamond — nine points over Opus — and it became the base of one of the most-used model lines in AI-assisted programming. An upgraded version followed on October 22, 2024, lifting SWE-Bench Verified to 49.0% and introducing computer use, before Claude 3.7 Sonnet succeeded the line in February 2025.

## Questions and answers

### When was Claude 3.5 Sonnet released?

Claude 3.5 Sonnet was released by Anthropic on Thursday, Jun 20 2024.

### Who made Claude 3.5 Sonnet?

Claude 3.5 Sonnet was built by Anthropic. AI safety company building the Claude family of models. Founded in 2021 by former OpenAI researchers.

### What benchmark scores did Claude 3.5 Sonnet get?

Claude 3.5 Sonnet reports 3 tracked benchmark scores — BullshitBench v2: 45%; SWE-Bench Verified: 33.4%; GPQA Diamond: 59.4%. Scores are the figures published at release by Anthropic.

### Is Claude 3.5 Sonnet open source?

No. Claude 3.5 Sonnet is a proprietary model. The weights are not published — it is available only through the provider's own API, apps, or partner platforms.

### What came before and after Claude 3.5 Sonnet?

Anthropic's previous tracked release was Claude 3 Opus on Mar 4 2024, 108 days earlier. It was followed by Claude 3.5 Haiku on Oct 22 2024.


---

Canonical page: https://aireleasetracker.com/model/anthropic/claude-3.5-sonnet
Full dataset: https://aireleasetracker.com/llms-full.txt · JSON: https://aireleasetracker.com/models.json
Source: AI Release Tracker (https://aireleasetracker.com). Benchmark scores are the figures published by the releasing lab at launch.