Compare AI models

Specifications
Parameters
12B8B
Context window
128k8k
API pricing
Cheapest input
$0.0166Io Net—
Cheapest output
$0.0216Io Net—
$4.40Io Net · fp16—
Benchmarks
HellaSwag
83.5%83.03%
WinoGrande
76.8%80.35%
MMLU
68%69.51%
Overview
CompanyMistralNVIDIA
Release dateJul 18 2024Aug 21 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Mistral NeMo Minitron 8B leads Mistral NeMo on 2 of the 3 benchmarks they both report (HellaSwag, WinoGrande, MMLU). Mistral NeMo shipped 34 days before Mistral NeMo Minitron 8B, so benchmark comparisons should account for the intervening progress.

Mistral NeMo has 12B parameters, while Mistral NeMo Minitron 8B has 8B. Context windows are 128k (Mistral NeMo) vs 8k (Mistral NeMo Minitron 8B).

On HellaSwag, Mistral NeMo leads at 83.5% vs Mistral NeMo Minitron 8B at 83.03%. On WinoGrande, Mistral NeMo Minitron 8B leads at 80.35% vs Mistral NeMo at 76.8%. On MMLU, Mistral NeMo Minitron 8B leads at 69.51% vs Mistral NeMo at 68%.