Compare AI models

Specifications
Parameters
—671B
Context window
200k128k
API pricing
Cheapest input
—$0.256DeepInfra
Cheapest output
—$0.712DeepInfra
—$103StreamLake
Benchmarks
SWE-Bench Verified
49%42%
GPQA Diamond
65%59.1%
MMLU
90.5%88.5%
Overview
CompanyAnthropicDeepSeek
Release dateOct 22 2024Dec 26 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Claude 3.5 Sonnet (upgraded) leads DeepSeek V3 on 3 of the 3 benchmarks they both report (SWE-Bench Verified, GPQA Diamond, MMLU). Claude 3.5 Sonnet (upgraded) shipped 65 days before DeepSeek V3, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.5 Sonnet (upgraded)) vs 128k (DeepSeek V3). Claude 3.5 Sonnet (upgraded) is closed, while DeepSeek V3 is open weight.

On SWE-Bench Verified, Claude 3.5 Sonnet (upgraded) leads at 49% vs DeepSeek V3 at 42%. On GPQA Diamond, Claude 3.5 Sonnet (upgraded) leads at 65% vs DeepSeek V3 at 59.1%. On MMLU, Claude 3.5 Sonnet (upgraded) leads at 90.5% vs DeepSeek V3 at 88.5%.