Compare AI models

Specifications
Parameters
7B7B/14B
Context window
32k1M
Benchmarks
MATH
56.6%79.5%
GSM8K
77.1%94.8%
Overview
CompanyMistralQwen
Release dateJul 16 2024Jan 27 2025
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Qwen2.5-1M leads Mathstral 7B on 2 of the 2 benchmarks they both report (MATH, GSM8K). Mathstral 7B shipped 195 days before Qwen2.5-1M, so benchmark comparisons should account for the intervening progress.

Mathstral 7B has 7B parameters, while Qwen2.5-1M has 7B/14B. Context windows are 32k (Mathstral 7B) vs 1M (Qwen2.5-1M).

On MATH, Qwen2.5-1M leads at 79.5% vs Mathstral 7B at 56.6%. On GSM8K, Qwen2.5-1M leads at 94.8% vs Mathstral 7B at 77.1%.