# Claude 3.5 Haiku

Claude 3.5 Haiku is an AI model released by Anthropic on Oct 22 2024. At release it scored 50% on BullshitBench v2, 41.6% on GPQA Diamond and 40.6% on SWE-Bench Verified.

## Facts

| Field | Value |
| --- | --- |
| Model | Claude 3.5 Haiku |
| Developer | Anthropic |
| Release date | Tuesday, Oct 22 2024 |
| Licensing | Proprietary |

## Benchmark scores published at release

| Benchmark | Score | Source | What it measures |
| --- | --- | --- | --- |
| BullshitBench v2 | 50% | Lab | Given a confidently-worded but nonsensical prompt, does the AI spot that it makes no sense and push back — instead of playing along and inventing an answer? The score is how often it clearly called out the nonsense. Higher is better. |
| SWE-Bench Verified | 40.6% | Lab | Real coding tasks pulled from open-source projects — the AI has to find and fix actual bugs. A human-checked version of the original SWE-Bench. Higher is better. |
| GPQA Diamond | 41.6% | Lab | Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better. |

## Questions and answers

### When was Claude 3.5 Haiku released?

Claude 3.5 Haiku was released by Anthropic on Tuesday, Oct 22 2024.

### Who made Claude 3.5 Haiku?

Claude 3.5 Haiku was built by Anthropic. AI safety company building the Claude family of models. Founded in 2021 by former OpenAI researchers.

### What benchmark scores did Claude 3.5 Haiku get?

Claude 3.5 Haiku reports 3 tracked benchmark scores — BullshitBench v2: 50%; SWE-Bench Verified: 40.6%; GPQA Diamond: 41.6%. Scores are the figures published at release by Anthropic.

### Is Claude 3.5 Haiku open source?

No. Claude 3.5 Haiku is a proprietary model. The weights are not published — it is available only through the provider's own API, apps, or partner platforms.

### What came before and after Claude 3.5 Haiku?

Anthropic's previous tracked release was Claude 3.5 Sonnet on Jun 20 2024, 124 days earlier. It was followed by Claude 3.5 Sonnet (upgraded) on Oct 22 2024.


---

Canonical page: https://aireleasetracker.com/model/anthropic/claude-3.5-haiku
Full dataset: https://aireleasetracker.com/llms-full.txt · JSON: https://aireleasetracker.com/models.json
Source: AI Release Tracker (https://aireleasetracker.com). Benchmark scores are the figures published by the releasing lab at launch.