Compare AI models

Specifications
Parameters
12B51B
Context window
128k128k
Benchmarks
MMLU
69.2%80.2%
Overview
CompanyMistralNVIDIA
Release dateSep 11 2024Sep 23 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama 3.1 Nemotron 51B leads Pixtral 24.09 on 1 of the 1 benchmark they both report (MMLU). Pixtral 24.09 shipped 12 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

Pixtral 24.09 has 12B parameters, while Llama 3.1 Nemotron 51B has 51B. Context windows are 128k (Pixtral 24.09) vs 128k (Llama 3.1 Nemotron 51B).

On MMLU, Llama 3.1 Nemotron 51B leads at 80.2% vs Pixtral 24.09 at 69.2%.