Claude 3.5 Haiku

Released

Claude 3.5 Haiku is an AI model released by Anthropic on Tuesday, Oct 22 2024, 124 days after Claude 3.5 Sonnet. Benchmark results (shown below) cover BullshitBench v2, SWE-Bench Verified, and GPQA Diamond.

Benchmarks

Coding

SWE-Bench Verified
40.6%
#54 of 57

Reasoning & science

GPQA Diamond
41.6%
#55 of 58

Robustness

BullshitBench v2
50%
#24 of 74

Compare Claude 3.5 Haiku with

Claude 3.5 Haiku

Suggested comparisons

Frequently asked questions

Claude 3.5 Haiku was released by Anthropic on Tuesday, Oct 22 2024.

Claude 3.5 Haiku was built by Anthropic. AI safety company building the Claude family of models. Founded in 2021 by former OpenAI researchers.

Claude 3.5 Haiku reports 3 tracked benchmark scores — BullshitBench v2: 50%; SWE-Bench Verified: 40.6%; GPQA Diamond: 41.6%. Scores are the figures published at release by Anthropic.

No. Claude 3.5 Haiku is a proprietary model. The weights are not published — it is available only through the provider's own API, apps, or partner platforms.

Anthropic's previous tracked release was Claude 3.5 Sonnet on Jun 20 2024, 124 days earlier. It was followed by Claude 3.5 Sonnet (upgraded) on Oct 22 2024.

All Anthropic releases

27 tracked