Compare AI models

Specifications
Context window
1M—
Benchmarks
HumanEval
86.6%85.7%
MATH
81.1%73%
MMLU-Pro
64.5%72%
Overview
CompanyQwenSpaceXSI
Release dateNov 15 2024Aug 13 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Qwen2.5-Turbo (1M) leads Grok‑2 mini on 2 of the 3 benchmarks they both report (HumanEval, MATH, MMLU-Pro). Grok‑2 mini shipped 94 days before Qwen2.5-Turbo (1M), so benchmark comparisons should account for the intervening progress.

Published specifications for these two models are limited — see each model page for the latest details.

On HumanEval, Qwen2.5-Turbo (1M) leads at 86.6% vs Grok‑2 mini at 85.7%. On MATH, Qwen2.5-Turbo (1M) leads at 81.1% vs Grok‑2 mini at 73%. On MMLU-Pro, Grok‑2 mini leads at 72% vs Qwen2.5-Turbo (1M) at 64.5%.