Compare AI models

Specifications
Parameters
—671B
Context window
200k128k
API pricing
Cheapest input
—$0.256DeepInfra
Cheapest output
—$0.712DeepInfra
—$103StreamLake
Benchmarks
SWE-Bench Verified
7.2%42%
GPQA Diamond
33.3%59.1%
MMLU
76.7%88.5%
Overview
CompanyAnthropicDeepSeek
Release dateMar 4 2024Dec 26 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

DeepSeek V3 leads Claude 3 Haiku on 3 of the 3 benchmarks they both report (SWE-Bench Verified, GPQA Diamond, MMLU). Claude 3 Haiku shipped 297 days before DeepSeek V3, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3 Haiku) vs 128k (DeepSeek V3). Claude 3 Haiku is closed, while DeepSeek V3 is open weight.

On SWE-Bench Verified, DeepSeek V3 leads at 42% vs Claude 3 Haiku at 7.2%. On GPQA Diamond, DeepSeek V3 leads at 59.1% vs Claude 3 Haiku at 33.3%. On MMLU, DeepSeek V3 leads at 88.5% vs Claude 3 Haiku at 76.7%.