Compare AI models

Specifications
Parameters
8B—
Context window
8k128k
Benchmarks
HumanEval
36.22%88.4%
MMLU
69.51%87.5%
Overview
CompanyNVIDIASpaceXSI
Release dateAug 21 2024Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 leads Mistral NeMo Minitron 8B on 2 of the 2 benchmarks they both report (HumanEval, MMLU). Grok‑2 shipped 8 days before Mistral NeMo Minitron 8B, so benchmark comparisons should account for the intervening progress.

Context windows are 8k (Mistral NeMo Minitron 8B) vs 128k (Grok‑2). Mistral NeMo Minitron 8B is open weight, while Grok‑2 is closed.

On HumanEval, Grok‑2 leads at 88.4% vs Mistral NeMo Minitron 8B at 36.22%. On MMLU, Grok‑2 leads at 87.5% vs Mistral NeMo Minitron 8B at 69.51%.