Compare AI models

Specifications
Parameters
47B8B
Context window
32k8k
Benchmarks
HumanEval
40.2%36.22%
ARC-Challenge
59.7%64.42%
HellaSwag
84.4%83.03%
WinoGrande
77.2%80.35%
MMLU
70.6%69.51%
GSM8K
58.4%58.45%
Overview
CompanyMistralNVIDIA
Release dateDec 8 2023Aug 21 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Mixtral 8×7B and Mistral NeMo Minitron 8B are evenly matched across the 6 benchmarks they both report. Mixtral 8×7B shipped 257 days before Mistral NeMo Minitron 8B, so benchmark comparisons should account for the intervening progress.

Mixtral 8×7B has 47B parameters, while Mistral NeMo Minitron 8B has 8B. Context windows are 32k (Mixtral 8×7B) vs 8k (Mistral NeMo Minitron 8B).

On HumanEval, Mixtral 8×7B leads at 40.2% vs Mistral NeMo Minitron 8B at 36.22%. On ARC-Challenge, Mistral NeMo Minitron 8B leads at 64.42% vs Mixtral 8×7B at 59.7%. On HellaSwag, Mixtral 8×7B leads at 84.4% vs Mistral NeMo Minitron 8B at 83.03%. On WinoGrande, Mistral NeMo Minitron 8B leads at 80.35% vs Mixtral 8×7B at 77.2%. On MMLU, Mixtral 8×7B leads at 70.6% vs Mistral NeMo Minitron 8B at 69.51%. On GSM8K, Mistral NeMo Minitron 8B leads at 58.45% vs Mixtral 8×7B at 58.4%.