Compare AI models

Specifications
Parameters
51B—
Context window
128k200k
Benchmarks
MMLU
80.2%90%
Overview
CompanyNVIDIAOpenAI
Release dateSep 23 2024Apr 16 2025
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

o4-mini leads Llama 3.1 Nemotron 51B on 1 of the 1 benchmark they both report (MMLU). Llama 3.1 Nemotron 51B shipped 205 days before o4-mini, so benchmark comparisons should account for the intervening progress.

Context windows are 128k (Llama 3.1 Nemotron 51B) vs 200k (o4-mini). Llama 3.1 Nemotron 51B is open weight, while o4-mini is closed.

On MMLU, o4-mini leads at 90% vs Llama 3.1 Nemotron 51B at 80.2%.