Compare AI models

Specifications
Parameters
236B—
Context window
128k128k
Benchmarks
SWE-Bench Verified
19%41.4%
HumanEval
87.2%92.4%
Overview
CompanyDeepSeekOpenAI
Release dateJul 24 2024Sep 12 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

o1-preview leads DeepSeek Coder V2-0724 on 2 of the 2 benchmarks they both report (SWE-Bench Verified, HumanEval). DeepSeek Coder V2-0724 shipped 50 days before o1-preview, so benchmark comparisons should account for the intervening progress.

Context windows are 128k (DeepSeek Coder V2-0724) vs 128k (o1-preview). DeepSeek Coder V2-0724 is open weight, while o1-preview is closed.

On SWE-Bench Verified, o1-preview leads at 41.4% vs DeepSeek Coder V2-0724 at 19%. On HumanEval, o1-preview leads at 92.4% vs DeepSeek Coder V2-0724 at 87.2%.