Compare AI models

Specifications
Parameters
51B0.5B/1.5B/7B/57B/72B
Context window
128k128k
Benchmarks
MMLU
80.2%82.3%
GSM8K
91.43%91.1%
Overview
CompanyNVIDIAQwen
Release dateSep 23 2024Jun 6 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama 3.1 Nemotron 51B and Qwen2 are evenly matched across the 2 benchmarks they both report (MMLU, GSM8K). Qwen2 shipped 109 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

Llama 3.1 Nemotron 51B has 51B parameters, while Qwen2 has 0.5B/1.5B/7B/57B/72B. Context windows are 128k (Llama 3.1 Nemotron 51B) vs 128k (Qwen2).

On MMLU, Qwen2 leads at 82.3% vs Llama 3.1 Nemotron 51B at 80.2%. On GSM8K, Llama 3.1 Nemotron 51B leads at 91.43% vs Qwen2 at 91.1%.