Compare AI models

Specifications
Parameters
123B6B
Context window
128k32k
API pricing
Cheapest input
$2.00Mistral—
Cheapest output
$6.00Mistral—
$700Mistral—
Benchmarks
HumanEval
92.1%9.8%
MMLU
84%45.2%
Overview
CompanyMistralZ.ai
Release dateJul 24 2024Jun 25 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Mistral Large 2 leads ChatGLM2-6B on 2 of the 2 benchmarks they both report (HumanEval, MMLU). ChatGLM2-6B shipped 395 days before Mistral Large 2, so benchmark comparisons should account for the intervening progress.

Mistral Large 2 has 123B parameters, while ChatGLM2-6B has 6B. Context windows are 128k (Mistral Large 2) vs 32k (ChatGLM2-6B).

On HumanEval, Mistral Large 2 leads at 92.1% vs ChatGLM2-6B at 9.8%. On MMLU, Mistral Large 2 leads at 84% vs ChatGLM2-6B at 45.2%.