Compare AI models

Specifications
Parameters
7B110B
Context window
32k32k
Benchmarks
MATH
56.6%49.6%
GSM8K
77.1%85.4%
Overview
CompanyMistralQwen
Release dateJul 16 2024Apr 25 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Mathstral 7B and Qwen1.5-110B are evenly matched across the 2 benchmarks they both report (MATH, GSM8K). Qwen1.5-110B shipped 82 days before Mathstral 7B, so benchmark comparisons should account for the intervening progress.

Mathstral 7B has 7B parameters, while Qwen1.5-110B has 110B. Context windows are 32k (Mathstral 7B) vs 32k (Qwen1.5-110B).

On MATH, Mathstral 7B leads at 56.6% vs Qwen1.5-110B at 49.6%. On GSM8K, Qwen1.5-110B leads at 85.4% vs Mathstral 7B at 77.1%.