Compare AI models

Specifications
Parameters
12B8B
Context window
128k8k
Benchmarks
HumanEval
72%36.22%
MMLU
69.2%69.51%
Overview
CompanyMistralNVIDIA
Release dateSep 11 2024Aug 21 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Pixtral 24.09 and Mistral NeMo Minitron 8B are evenly matched across the 2 benchmarks they both report (HumanEval, MMLU). Mistral NeMo Minitron 8B shipped 21 days before Pixtral 24.09, so benchmark comparisons should account for the intervening progress.

Pixtral 24.09 has 12B parameters, while Mistral NeMo Minitron 8B has 8B. Context windows are 128k (Pixtral 24.09) vs 8k (Mistral NeMo Minitron 8B).

On HumanEval, Pixtral 24.09 leads at 72% vs Mistral NeMo Minitron 8B at 36.22%. On MMLU, Mistral NeMo Minitron 8B leads at 69.51% vs Pixtral 24.09 at 69.2%.