Compare AI models

Specifications
Parameters
123B6B
Context window
128k8k
API pricing
Cheapest input
$2.00Mistral—
Cheapest output
$6.00Mistral—
$700Mistral—
Benchmarks
HumanEval
92.1%58.5%
MMLU
84%61.4%
Overview
CompanyMistralZ.ai
Release dateJul 24 2024Oct 27 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Mistral Large 2 leads ChatGLM3-6B on 2 of the 2 benchmarks they both report (HumanEval, MMLU). ChatGLM3-6B shipped 271 days before Mistral Large 2, so benchmark comparisons should account for the intervening progress.

Mistral Large 2 has 123B parameters, while ChatGLM3-6B has 6B. Context windows are 128k (Mistral Large 2) vs 8k (ChatGLM3-6B).

On HumanEval, Mistral Large 2 leads at 92.1% vs ChatGLM3-6B at 58.5%. On MMLU, Mistral Large 2 leads at 84% vs ChatGLM3-6B at 61.4%.