Compare AI models

Specifications
Parameters
51B—
Context window
128k128k
API pricing
Input price
—$0.15
Output price
—$0.60
Cached input price
—$0.075
Cheapest input
—$0.15Azure
Cheapest output
—$0.60Azure
—$60.00OpenAI list price
Benchmarks
MMLU
80.2%82%
Overview
CompanyNVIDIAOpenAI
Release dateSep 23 2024Jul 18 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

GPT-4o mini leads Llama 3.1 Nemotron 51B on 1 of the 1 benchmark they both report (MMLU). Only GPT-4o mini has a verified first-party price for an available API: $0.15 per million input tokens and $0.60 per million output tokens. No currently available pay-as-you-go API rate is tracked for Llama 3.1 Nemotron 51B. GPT-4o mini shipped 67 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

Context windows are 128k (Llama 3.1 Nemotron 51B) vs 128k (GPT-4o mini). Llama 3.1 Nemotron 51B is open weight, while GPT-4o mini is closed.

On MMLU, GPT-4o mini leads at 82% vs Llama 3.1 Nemotron 51B at 80.2%.