Compare AI models

Specifications
Parameters
51B—
Context window
128k128k
Benchmarks
MMLU
80.2%81.3%
GSM8K
91.43%90%
Overview
CompanyNVIDIASpaceXSI
Release dateSep 23 2024Mar 28 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Llama 3.1 Nemotron 51B and Grok‑1.5 are evenly matched across the 2 benchmarks they both report (MMLU, GSM8K). Grok‑1.5 shipped 179 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

Context windows are 128k (Llama 3.1 Nemotron 51B) vs 128k (Grok‑1.5). Llama 3.1 Nemotron 51B is open weight, while Grok‑1.5 is closed.

On MMLU, Grok‑1.5 leads at 81.3% vs Llama 3.1 Nemotron 51B at 80.2%. On GSM8K, Llama 3.1 Nemotron 51B leads at 91.43% vs Grok‑1.5 at 90%.