Compare AI models

Specifications
Parameters
8B314B
Context window
8k8k
Benchmarks
HumanEval
36.22%63.2%
MMLU
69.51%73%
GSM8K
58.45%62.9%
Overview
CompanyNVIDIASpaceXSI
Release dateAug 21 2024Nov 3 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Grok‑1 leads Mistral NeMo Minitron 8B on 3 of the 3 benchmarks they both report (HumanEval, MMLU, GSM8K). Grok‑1 shipped 292 days before Mistral NeMo Minitron 8B, so benchmark comparisons should account for the intervening progress.

Mistral NeMo Minitron 8B has 8B parameters, while Grok‑1 has 314B. Context windows are 8k (Mistral NeMo Minitron 8B) vs 8k (Grok‑1).

On HumanEval, Grok‑1 leads at 63.2% vs Mistral NeMo Minitron 8B at 36.22%. On MMLU, Grok‑1 leads at 73% vs Mistral NeMo Minitron 8B at 69.51%. On GSM8K, Grok‑1 leads at 62.9% vs Mistral NeMo Minitron 8B at 58.45%.