Compare AI models

Specifications
Parameters
8B—
Context window
4k128k
Benchmarks
MMLU
54.4%85.2%
Overview
CompanyNVIDIAOpenAI
Release dateNov 15 2023Sep 12 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

o1-mini leads Nemotron-3 8B on 1 of the 1 benchmark they both report (MMLU). Nemotron-3 8B shipped 302 days before o1-mini, so benchmark comparisons should account for the intervening progress.

Context windows are 4k (Nemotron-3 8B) vs 128k (o1-mini). Nemotron-3 8B is open weight, while o1-mini is closed.

On MMLU, o1-mini leads at 85.2% vs Nemotron-3 8B at 54.4%.