Compare AI models

Specifications
Parameters
7B6B
Context window
32k32k
Benchmarks
MATH
56.6%6.9%
GSM8K
77.1%25.9%
Overview
CompanyMistralZ.ai
Release dateJul 16 2024Jun 25 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Mathstral 7B leads ChatGLM2-6B on 2 of the 2 benchmarks they both report (MATH, GSM8K). ChatGLM2-6B shipped 387 days before Mathstral 7B, so benchmark comparisons should account for the intervening progress.

Mathstral 7B has 7B parameters, while ChatGLM2-6B has 6B. Context windows are 32k (Mathstral 7B) vs 32k (ChatGLM2-6B).

On MATH, Mathstral 7B leads at 56.6% vs ChatGLM2-6B at 6.9%. On GSM8K, Mathstral 7B leads at 77.1% vs ChatGLM2-6B at 25.9%.