Compare AI models

Specifications
Parameters
16B51B
Context window
32k128k
Benchmarks
MMLU
55.7%80.2%
GSM8K
72%91.43%
Overview
CompanyDeepSeekNVIDIA
Release dateMay 16 2024Sep 23 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama 3.1 Nemotron 51B leads DeepSeek V2 Lite on 2 of the 2 benchmarks they both report (MMLU, GSM8K). DeepSeek V2 Lite shipped 130 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

DeepSeek V2 Lite has 16B parameters, while Llama 3.1 Nemotron 51B has 51B. Context windows are 32k (DeepSeek V2 Lite) vs 128k (Llama 3.1 Nemotron 51B).

On MMLU, Llama 3.1 Nemotron 51B leads at 80.2% vs DeepSeek V2 Lite at 55.7%. On GSM8K, Llama 3.1 Nemotron 51B leads at 91.43% vs DeepSeek V2 Lite at 72%.