Compare AI models

Specifications
Parameters
16B—
Context window
32k—
Benchmarks
HumanEval
57.3%85.7%
MATH
27.9%73%
MMLU
55.7%86.2%
Overview
CompanyDeepSeekSpaceXSI
Release dateMay 16 2024Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Grok‑2 mini leads DeepSeek V2 Lite on 3 of the 3 benchmarks they both report (HumanEval, MATH, MMLU). DeepSeek V2 Lite shipped 89 days before Grok‑2 mini, so benchmark comparisons should account for the intervening progress.

DeepSeek V2 Lite is open weight, while Grok‑2 mini is closed.

On HumanEval, Grok‑2 mini leads at 85.7% vs DeepSeek V2 Lite at 57.3%. On MATH, Grok‑2 mini leads at 73% vs DeepSeek V2 Lite at 27.9%. On MMLU, Grok‑2 mini leads at 86.2% vs DeepSeek V2 Lite at 55.7%.