Compare AI models

Specifications
Parameters
123B—
Context window
128k—
API pricing
Cheapest input
$2.00Mistral—
Cheapest output
$6.00Mistral—
$700Mistral—
Benchmarks
HumanEval
92.1%72%
MMLU
84%81.5%
Overview
CompanyMistralZ.ai
Release dateJul 24 2024Jan 16 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Mistral Large 2 leads GLM-4 on 2 of the 2 benchmarks they both report (HumanEval, MMLU). GLM-4 shipped 190 days before Mistral Large 2, so benchmark comparisons should account for the intervening progress.

Mistral Large 2 is open weight, while GLM-4 is closed.

On HumanEval, Mistral Large 2 leads at 92.1% vs GLM-4 at 72%. On MMLU, Mistral Large 2 leads at 84% vs GLM-4 at 81.5%.