Compare AI models

Specifications
Parameters
8B—
Context window
8k—
Benchmarks
HumanEval
36.22%85.7%
MMLU
69.51%86.2%
Overview
CompanyNVIDIASpaceXSI
Release dateAug 21 2024Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 mini leads Mistral NeMo Minitron 8B on 2 of the 2 benchmarks they both report (HumanEval, MMLU). Grok‑2 mini shipped 8 days before Mistral NeMo Minitron 8B, so benchmark comparisons should account for the intervening progress.

Mistral NeMo Minitron 8B is open weight, while Grok‑2 mini is closed.

On HumanEval, Grok‑2 mini leads at 85.7% vs Mistral NeMo Minitron 8B at 36.22%. On MMLU, Grok‑2 mini leads at 86.2% vs Mistral NeMo Minitron 8B at 69.51%.