Compare AI models

Specifications
Parameters
12B—
Context window
128k1M
Benchmarks
HumanEval
72%86.6%
IFEval
61.3%76.3%
MATH
48.1%81.1%
Overview
CompanyMistralQwen
Release dateSep 11 2024Nov 15 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Qwen2.5-Turbo (1M) leads Pixtral 24.09 on 3 of the 3 benchmarks they both report (HumanEval, IFEval, MATH). Pixtral 24.09 shipped 65 days before Qwen2.5-Turbo (1M), so benchmark comparisons should account for the intervening progress.

Context windows are 128k (Pixtral 24.09) vs 1M (Qwen2.5-Turbo (1M)). Pixtral 24.09 is open weight, while Qwen2.5-Turbo (1M) is closed.

On HumanEval, Qwen2.5-Turbo (1M) leads at 86.6% vs Pixtral 24.09 at 72%. On IFEval, Qwen2.5-Turbo (1M) leads at 76.3% vs Pixtral 24.09 at 61.3%. On MATH, Qwen2.5-Turbo (1M) leads at 81.1% vs Pixtral 24.09 at 48.1%.