Compare AI models

Specifications
Parameters
7B—
Context window
32k128k
Benchmarks
HumanEval
38.4%83.7%
MATH
13.2%64.3%
Overview
CompanyMistralOpenAI
Release dateMay 22 2024Nov 6 2023
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

GPT-4 Turbo leads Mistral 7B v0.3 on 2 of the 2 benchmarks they both report (HumanEval, MATH). GPT-4 Turbo shipped 198 days before Mistral 7B v0.3, so benchmark comparisons should account for the intervening progress.

Context windows are 32k (Mistral 7B v0.3) vs 128k (GPT-4 Turbo). Mistral 7B v0.3 is open weight, while GPT-4 Turbo is closed.

On HumanEval, GPT-4 Turbo leads at 83.7% vs Mistral 7B v0.3 at 38.4%. On MATH, GPT-4 Turbo leads at 64.3% vs Mistral 7B v0.3 at 13.2%.