Compare AI models

Specifications
Parameters
—16B
Context window
200k32k
Benchmarks
HumanEval
93.7%57.3%
MMLU
90.5%55.7%
Overview
CompanyAnthropicDeepSeek
Release dateOct 22 2024May 16 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Claude 3.5 Sonnet (upgraded) leads DeepSeek V2 Lite on 2 of the 2 benchmarks they both report (HumanEval, MMLU). DeepSeek V2 Lite shipped 159 days before Claude 3.5 Sonnet (upgraded), so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.5 Sonnet (upgraded)) vs 32k (DeepSeek V2 Lite). Claude 3.5 Sonnet (upgraded) is closed, while DeepSeek V2 Lite is open weight.

On HumanEval, Claude 3.5 Sonnet (upgraded) leads at 93.7% vs DeepSeek V2 Lite at 57.3%. On MMLU, Claude 3.5 Sonnet (upgraded) leads at 90.5% vs DeepSeek V2 Lite at 55.7%.