Compare AI models

Specifications
Parameters
16B253B
Context window
8k128k
Benchmarks
LiveCodeBench
14.3%66.3%
GPQA Diamond
35.2%76%
Overview
CompanyMoonshot AINVIDIA
Release dateFeb 22 2025Apr 7 2025
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama Nemotron Ultra 253B leads Moonlight on 2 of the 2 benchmarks they both report (LiveCodeBench, GPQA Diamond). Moonlight shipped 44 days before Llama Nemotron Ultra 253B, so benchmark comparisons should account for the intervening progress.

Moonlight has 16B parameters, while Llama Nemotron Ultra 253B has 253B. Context windows are 8k (Moonlight) vs 128k (Llama Nemotron Ultra 253B).

On LiveCodeBench, Llama Nemotron Ultra 253B leads at 66.3% vs Moonlight at 14.3%. On GPQA Diamond, Llama Nemotron Ultra 253B leads at 76% vs Moonlight at 35.2%.