Compare AI models

Specifications
Parameters
7B—
Context window
32k128k
Benchmarks
HumanEval
38.4%92.4%
Overview
CompanyMistralOpenAI
Release dateMay 22 2024Sep 12 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

o1-preview leads Mistral 7B v0.3 on 1 of the 1 benchmark they both report (HumanEval). Mistral 7B v0.3 shipped 113 days before o1-preview, so benchmark comparisons should account for the intervening progress.

Context windows are 32k (Mistral 7B v0.3) vs 128k (o1-preview). Mistral 7B v0.3 is open weight, while o1-preview is closed.

On HumanEval, o1-preview leads at 92.4% vs Mistral 7B v0.3 at 38.4%.