Compare AI models

Specifications
Parameters
3B6B
Context window
128k8k
Benchmarks
HumanEval
77.4%58.5%
MATH
51.7%25.7%
Overview
CompanyMistralZ.ai
Release dateOct 16 2024Oct 27 2023
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Ministral 3B leads ChatGLM3-6B on 2 of the 2 benchmarks they both report (HumanEval, MATH). ChatGLM3-6B shipped 355 days before Ministral 3B, so benchmark comparisons should account for the intervening progress.

Ministral 3B has 3B parameters, while ChatGLM3-6B has 6B. Context windows are 128k (Ministral 3B) vs 8k (ChatGLM3-6B). Ministral 3B is closed, while ChatGLM3-6B is open weight.

On HumanEval, Ministral 3B leads at 77.4% vs ChatGLM3-6B at 58.5%. On MATH, Ministral 3B leads at 51.7% vs ChatGLM3-6B at 25.7%.