Compare AI models

Specifications
Parameters
70B—
Context window
128k—
API pricing
Cheapest input
$0.10DeepInfra—
Cheapest output
$0.32DeepInfra—
$36.00DeepInfra · turbo · fp8—
Benchmarks
HumanEval
88.4%85.7%
MATH
77%73%
MMLU-Pro
68.9%72%
MMLU
86%86.2%
Overview
CompanyMetaSpaceXSI
Release dateDec 6 2024Aug 13 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

LLaMA 3.3 and Grok‑2 mini are evenly matched across the 4 benchmarks they both report (HumanEval, MATH, MMLU-Pro, MMLU). Grok‑2 mini shipped 115 days before LLaMA 3.3, so benchmark comparisons should account for the intervening progress.

LLaMA 3.3 is open weight, while Grok‑2 mini is closed.

On HumanEval, LLaMA 3.3 leads at 88.4% vs Grok‑2 mini at 85.7%. On MATH, LLaMA 3.3 leads at 77% vs Grok‑2 mini at 73%. On MMLU-Pro, Grok‑2 mini leads at 72% vs LLaMA 3.3 at 68.9%. On MMLU, Grok‑2 mini leads at 86.2% vs LLaMA 3.3 at 86%.