Compare AI models

Specifications
Parameters
7B—
Context window
32k200k
Benchmarks
HumanEval
38.4%97.3%
Overview
CompanyMistralOpenAI
Release dateMay 22 2024Apr 16 2025
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

o4-mini leads Mistral 7B v0.3 on 1 of the 1 benchmark they both report (HumanEval). Mistral 7B v0.3 shipped 329 days before o4-mini, so benchmark comparisons should account for the intervening progress.

Context windows are 32k (Mistral 7B v0.3) vs 200k (o4-mini). Mistral 7B v0.3 is open weight, while o4-mini is closed.

On HumanEval, o4-mini leads at 97.3% vs Mistral 7B v0.3 at 38.4%.