Compare AI models

Specifications
Parameters
7B—
Context window
32k—
Benchmarks
HumanEval
38.4%85.7%
MATH
13.2%73%
Overview
CompanyMistralSpaceXSI
Release dateMay 22 2024Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 mini leads Mistral 7B v0.3 on 2 of the 2 benchmarks they both report (HumanEval, MATH). Mistral 7B v0.3 shipped 83 days before Grok‑2 mini, so benchmark comparisons should account for the intervening progress.

Mistral 7B v0.3 is open weight, while Grok‑2 mini is closed.

On HumanEval, Grok‑2 mini leads at 85.7% vs Mistral 7B v0.3 at 38.4%. On MATH, Grok‑2 mini leads at 73% vs Mistral 7B v0.3 at 13.2%.