Compare AI models

Specifications
Parameters
51B—
Context window
128k128k
Benchmarks
MMLU
80.2%85.2%
Overview
CompanyNVIDIAOpenAI
Release dateSep 23 2024Sep 12 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

o1-mini leads Llama 3.1 Nemotron 51B on 1 of the 1 benchmark they both report (MMLU). o1-mini shipped 11 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

Context windows are 128k (Llama 3.1 Nemotron 51B) vs 128k (o1-mini). Llama 3.1 Nemotron 51B is open weight, while o1-mini is closed.

On MMLU, o1-mini leads at 85.2% vs Llama 3.1 Nemotron 51B at 80.2%.