Compare AI models

Specifications
Parameters
7B—
Context window
32k128k
Benchmarks
HumanEval
38.4%74.1%
MATH
13.2%50.6%
Overview
CompanyMistralSpaceXSI
Release dateMay 22 2024Mar 28 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok‑1.5 leads Mistral 7B v0.3 on 2 of the 2 benchmarks they both report (HumanEval, MATH). Grok‑1.5 shipped 55 days before Mistral 7B v0.3, so benchmark comparisons should account for the intervening progress.

Context windows are 32k (Mistral 7B v0.3) vs 128k (Grok‑1.5). Mistral 7B v0.3 is open weight, while Grok‑1.5 is closed.

On HumanEval, Grok‑1.5 leads at 74.1% vs Mistral 7B v0.3 at 38.4%. On MATH, Grok‑1.5 leads at 50.6% vs Mistral 7B v0.3 at 13.2%.