Compare AI models

Specifications
Parameters
24B6B
Context window
32k32k
API pricing
Cheapest input
$0.04DeepInfra—
Cheapest output
$0.064DeepInfra—
$14.00DeepInfra · fp8—
Benchmarks
HumanEval
84.8%9.8%
MATH
70.6%6.9%
Overview
CompanyMistralZ.ai
Release dateJan 30 2025Jun 25 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Mistral Small 3 leads ChatGLM2-6B on 2 of the 2 benchmarks they both report (HumanEval, MATH). ChatGLM2-6B shipped 585 days before Mistral Small 3, so benchmark comparisons should account for the intervening progress.

Mistral Small 3 has 24B parameters, while ChatGLM2-6B has 6B. Context windows are 32k (Mistral Small 3) vs 32k (ChatGLM2-6B).

On HumanEval, Mistral Small 3 leads at 84.8% vs ChatGLM2-6B at 9.8%. On MATH, Mistral Small 3 leads at 70.6% vs ChatGLM2-6B at 6.9%.