Compare AI models

Specifications
Parameters
51B—
Context window
128k128k
Benchmarks
MMLU
80.2%87.5%
Overview
CompanyNVIDIASpaceXSI
Release dateSep 23 2024Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 leads Llama 3.1 Nemotron 51B on 1 of the 1 benchmark they both report (MMLU). Grok‑2 shipped 41 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

Context windows are 128k (Llama 3.1 Nemotron 51B) vs 128k (Grok‑2). Llama 3.1 Nemotron 51B is open weight, while Grok‑2 is closed.

On MMLU, Grok‑2 leads at 87.5% vs Llama 3.1 Nemotron 51B at 80.2%.