Compare AI models

Specifications
Parameters
—7B
Context window
200k32k
Benchmarks
HumanEval
93.7%38.4%
Overview
CompanyAnthropicMistral
Release dateOct 22 2024May 22 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Claude 3.5 Sonnet (upgraded) leads Mistral 7B v0.3 on 1 of the 1 benchmark they both report (HumanEval). Mistral 7B v0.3 shipped 153 days before Claude 3.5 Sonnet (upgraded), so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.5 Sonnet (upgraded)) vs 32k (Mistral 7B v0.3). Claude 3.5 Sonnet (upgraded) is closed, while Mistral 7B v0.3 is open weight.

On HumanEval, Claude 3.5 Sonnet (upgraded) leads at 93.7% vs Mistral 7B v0.3 at 38.4%.