Compare AI models

Specifications
Parameters
7B—
Context window
32k128k
Benchmarks
HumanEval
38.4%88.4%
MATH
13.2%76.1%
Overview
CompanyMistralSpaceXSI
Release dateMay 22 2024Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 leads Mistral 7B v0.3 on 2 of the 2 benchmarks they both report (HumanEval, MATH). Mistral 7B v0.3 shipped 83 days before Grok‑2, so benchmark comparisons should account for the intervening progress.

Context windows are 32k (Mistral 7B v0.3) vs 128k (Grok‑2). Mistral 7B v0.3 is open weight, while Grok‑2 is closed.

On HumanEval, Grok‑2 leads at 88.4% vs Mistral 7B v0.3 at 38.4%. On MATH, Grok‑2 leads at 76.1% vs Mistral 7B v0.3 at 13.2%.