Compare AI models

Specifications
Parameters
8B—
Context window
128k—
Benchmarks
HumanEval
76.8%72%
MATH
54.5%47.9%
Overview
CompanyMistralZ.ai
Release dateOct 16 2024Jan 16 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Ministral 8B leads GLM-4 on 2 of the 2 benchmarks they both report (HumanEval, MATH). GLM-4 shipped 274 days before Ministral 8B, so benchmark comparisons should account for the intervening progress.

Ministral 8B is open weight, while GLM-4 is closed.

On HumanEval, Ministral 8B leads at 76.8% vs GLM-4 at 72%. On MATH, Ministral 8B leads at 54.5% vs GLM-4 at 47.9%.