Compare AI models

Specifications
Parameters
16B/236B51B
Context window
128k128k
Benchmarks
ARC-Challenge
92.8%69.2%
MMLU
79.2%80.2%
GSM8K
94.9%91.43%
Overview
CompanyDeepSeekNVIDIA
Release dateJun 14 2024Sep 23 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

DeepSeek Coder V2 leads Llama 3.1 Nemotron 51B on 2 of the 3 benchmarks they both report (ARC-Challenge, MMLU, GSM8K). DeepSeek Coder V2 shipped 101 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

DeepSeek Coder V2 has 16B/236B parameters, while Llama 3.1 Nemotron 51B has 51B. Context windows are 128k (DeepSeek Coder V2) vs 128k (Llama 3.1 Nemotron 51B).

On ARC-Challenge, DeepSeek Coder V2 leads at 92.8% vs Llama 3.1 Nemotron 51B at 69.2%. On MMLU, Llama 3.1 Nemotron 51B leads at 80.2% vs DeepSeek Coder V2 at 79.2%. On GSM8K, DeepSeek Coder V2 leads at 94.9% vs Llama 3.1 Nemotron 51B at 91.43%.