Compare AI models

Specifications
Parameters
7B6B
Context window
32k8k
Benchmarks
MATH
56.6%25.7%
GSM8K
77.1%72.3%
Overview
CompanyMistralZ.ai
Release dateJul 16 2024Oct 27 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Mathstral 7B leads ChatGLM3-6B on 2 of the 2 benchmarks they both report (MATH, GSM8K). ChatGLM3-6B shipped 263 days before Mathstral 7B, so benchmark comparisons should account for the intervening progress.

Mathstral 7B has 7B parameters, while ChatGLM3-6B has 6B. Context windows are 32k (Mathstral 7B) vs 8k (ChatGLM3-6B).

On MATH, Mathstral 7B leads at 56.6% vs ChatGLM3-6B at 25.7%. On GSM8K, Mathstral 7B leads at 77.1% vs ChatGLM3-6B at 72.3%.