Compare AI models

Specifications
Parameters
0.5B/1.5B/7B/57B/72B—
Context window
128k—
Benchmarks
HumanEval
86%85.7%
MATH
69%73%
MMLU-Pro
64.4%72%
MMLU
82.3%86.2%
Overview
CompanyQwenSpaceXSI
Release dateJun 6 2024Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 mini leads Qwen2 on 3 of the 4 benchmarks they both report (HumanEval, MATH, MMLU-Pro, MMLU). Qwen2 shipped 68 days before Grok‑2 mini, so benchmark comparisons should account for the intervening progress.

Qwen2 is open weight, while Grok‑2 mini is closed.

On HumanEval, Qwen2 leads at 86% vs Grok‑2 mini at 85.7%. On MATH, Grok‑2 mini leads at 73% vs Qwen2 at 69%. On MMLU-Pro, Grok‑2 mini leads at 72% vs Qwen2 at 64.4%. On MMLU, Grok‑2 mini leads at 86.2% vs Qwen2 at 82.3%.