Compare AI models

Specifications
Parameters
51B—
Context window
128k—
Benchmarks
MMLU
80.2%86.2%
Overview
CompanyNVIDIASpaceXSI
Release dateSep 23 2024Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 mini leads Llama 3.1 Nemotron 51B on 1 of the 1 benchmark they both report (MMLU). Grok‑2 mini shipped 41 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

Llama 3.1 Nemotron 51B is open weight, while Grok‑2 mini is closed.

On MMLU, Grok‑2 mini leads at 86.2% vs Llama 3.1 Nemotron 51B at 80.2%.