Compare AI models

Specifications
Parameters
—671B
Context window
200k128k
API pricing
Cheapest input
—$0.256DeepInfra
Cheapest output
—$0.712DeepInfra
—$103StreamLake
Benchmarks
SWE-Bench Verified
33.4%42%
GPQA Diamond
59.4%59.1%
MMLU
90.4%88.5%
Overview
CompanyAnthropicDeepSeek
Release dateJun 20 2024Dec 26 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Claude 3.5 Sonnet leads DeepSeek V3 on 2 of the 3 benchmarks they both report (SWE-Bench Verified, GPQA Diamond, MMLU). Claude 3.5 Sonnet shipped 189 days before DeepSeek V3, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.5 Sonnet) vs 128k (DeepSeek V3). Claude 3.5 Sonnet is closed, while DeepSeek V3 is open weight.

On SWE-Bench Verified, DeepSeek V3 leads at 42% vs Claude 3.5 Sonnet at 33.4%. On GPQA Diamond, Claude 3.5 Sonnet leads at 59.4% vs DeepSeek V3 at 59.1%. On MMLU, Claude 3.5 Sonnet leads at 90.4% vs DeepSeek V3 at 88.5%.