Compare AI models

Specifications
Parameters
16B51B
Context window
8k128k
Benchmarks
WinoGrande
74.6%84.53%
MMLU
70%80.2%
GSM8K
77.4%91.43%
Overview
CompanyMoonshot AINVIDIA
Release dateFeb 22 2025Sep 23 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama 3.1 Nemotron 51B leads Moonlight on 3 of the 3 benchmarks they both report (WinoGrande, MMLU, GSM8K). Llama 3.1 Nemotron 51B shipped 152 days before Moonlight, so benchmark comparisons should account for the intervening progress.

Moonlight has 16B parameters, while Llama 3.1 Nemotron 51B has 51B. Context windows are 8k (Moonlight) vs 128k (Llama 3.1 Nemotron 51B).

On WinoGrande, Llama 3.1 Nemotron 51B leads at 84.53% vs Moonlight at 74.6%. On MMLU, Llama 3.1 Nemotron 51B leads at 80.2% vs Moonlight at 70%. On GSM8K, Llama 3.1 Nemotron 51B leads at 91.43% vs Moonlight at 77.4%.