Compare AI models

Specifications
Parameters
51B314B
Context window
128k8k
Benchmarks
MMLU
80.2%73%
GSM8K
91.43%62.9%
Overview
CompanyNVIDIASpaceXSI
Release dateSep 23 2024Nov 3 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama 3.1 Nemotron 51B leads Grok‑1 on 2 of the 2 benchmarks they both report (MMLU, GSM8K). Grok‑1 shipped 325 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

Llama 3.1 Nemotron 51B has 51B parameters, while Grok‑1 has 314B. Context windows are 128k (Llama 3.1 Nemotron 51B) vs 8k (Grok‑1).

On MMLU, Llama 3.1 Nemotron 51B leads at 80.2% vs Grok‑1 at 73%. On GSM8K, Llama 3.1 Nemotron 51B leads at 91.43% vs Grok‑1 at 62.9%.