Compare AI models

Specifications
Parameters
51B—
Context window
128k128k
Benchmarks
MMLU
80.2%90.8%
Overview
CompanyNVIDIAOpenAI
Release dateSep 23 2024Sep 12 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

o1-preview leads Llama 3.1 Nemotron 51B on 1 of the 1 benchmark they both report (MMLU). o1-preview shipped 11 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

Context windows are 128k (Llama 3.1 Nemotron 51B) vs 128k (o1-preview). Llama 3.1 Nemotron 51B is open weight, while o1-preview is closed.

On MMLU, o1-preview leads at 90.8% vs Llama 3.1 Nemotron 51B at 80.2%.