Compare AI models

Specifications
Parameters
—236B
Context window
200k128k
Benchmarks
SWE-Bench Verified
33.4%19%
HumanEval
92%87.2%
Overview
CompanyAnthropicDeepSeek
Release dateJun 20 2024Jul 24 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Claude 3.5 Sonnet leads DeepSeek Coder V2-0724 on 2 of the 2 benchmarks they both report (SWE-Bench Verified, HumanEval). Claude 3.5 Sonnet shipped 34 days before DeepSeek Coder V2-0724, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.5 Sonnet) vs 128k (DeepSeek Coder V2-0724). Claude 3.5 Sonnet is closed, while DeepSeek Coder V2-0724 is open weight.

On SWE-Bench Verified, Claude 3.5 Sonnet leads at 33.4% vs DeepSeek Coder V2-0724 at 19%. On HumanEval, Claude 3.5 Sonnet leads at 92% vs DeepSeek Coder V2-0724 at 87.2%.