Compare AI models

Specifications
Parameters
7B/13B/70B—
Context window
4k—
Benchmarks
HumanEval
29.9%85.7%
MATH
13.5%73%
MMLU
68.9%86.2%
Overview
CompanyMetaSpaceXSI
Release dateJul 18 2023Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 mini leads LLaMA 2 on 3 of the 3 benchmarks they both report (HumanEval, MATH, MMLU). LLaMA 2 shipped 392 days before Grok‑2 mini, so benchmark comparisons should account for the intervening progress.

LLaMA 2 is open weight, while Grok‑2 mini is closed.

On HumanEval, Grok‑2 mini leads at 85.7% vs LLaMA 2 at 29.9%. On MATH, Grok‑2 mini leads at 73% vs LLaMA 2 at 13.5%. On MMLU, Grok‑2 mini leads at 86.2% vs LLaMA 2 at 68.9%.