Compare AI models

Specifications
Parameters
7B8B
Context window
8k8k
Benchmarks
HumanEval
26.2%36.22%
ARC-Challenge
54.9%64.42%
HellaSwag
81%83.03%
WinoGrande
74.2%80.35%
MMLU
62.5%69.51%
GSM8K
36.5%58.45%
Overview
CompanyMistralNVIDIA
Release dateSep 27 2023Aug 21 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Mistral NeMo Minitron 8B leads Mistral 7B on 6 of the 6 benchmarks they both report. Mistral 7B shipped 329 days before Mistral NeMo Minitron 8B, so benchmark comparisons should account for the intervening progress.

Mistral 7B has 7B parameters, while Mistral NeMo Minitron 8B has 8B. Context windows are 8k (Mistral 7B) vs 8k (Mistral NeMo Minitron 8B).

On HumanEval, Mistral NeMo Minitron 8B leads at 36.22% vs Mistral 7B at 26.2%. On ARC-Challenge, Mistral NeMo Minitron 8B leads at 64.42% vs Mistral 7B at 54.9%. On HellaSwag, Mistral NeMo Minitron 8B leads at 83.03% vs Mistral 7B at 81%. On WinoGrande, Mistral NeMo Minitron 8B leads at 80.35% vs Mistral 7B at 74.2%. On MMLU, Mistral NeMo Minitron 8B leads at 69.51% vs Mistral 7B at 62.5%. On GSM8K, Mistral NeMo Minitron 8B leads at 58.45% vs Mistral 7B at 36.5%.