Compare AI models

Specifications
Parameters
7B110B
Context window
32k32k
Benchmarks
HumanEval
38.4%52.4%
MATH
13.2%49.6%
Overview
CompanyMistralQwen
Release dateMay 22 2024Apr 25 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Qwen1.5-110B leads Mistral 7B v0.3 on 2 of the 2 benchmarks they both report (HumanEval, MATH). Qwen1.5-110B shipped 27 days before Mistral 7B v0.3, so benchmark comparisons should account for the intervening progress.

Mistral 7B v0.3 has 7B parameters, while Qwen1.5-110B has 110B. Context windows are 32k (Mistral 7B v0.3) vs 32k (Qwen1.5-110B).

On HumanEval, Qwen1.5-110B leads at 52.4% vs Mistral 7B v0.3 at 38.4%. On MATH, Qwen1.5-110B leads at 49.6% vs Mistral 7B v0.3 at 13.2%.