Compare AI models

Specifications
Parameters
7B—
Context window
8k—
Benchmarks
HumanEval
26.2%85.7%
MMLU
62.5%86.2%
Overview
CompanyMistralSpaceXSI
Release dateSep 27 2023Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 mini leads Mistral 7B on 2 of the 2 benchmarks they both report (HumanEval, MMLU). Mistral 7B shipped 321 days before Grok‑2 mini, so benchmark comparisons should account for the intervening progress.

Mistral 7B is open weight, while Grok‑2 mini is closed.

On HumanEval, Grok‑2 mini leads at 85.7% vs Mistral 7B at 26.2%. On MMLU, Grok‑2 mini leads at 86.2% vs Mistral 7B at 62.5%.