Compare AI models

Specifications
Parameters
—7B
Context window
200k32k
Benchmarks
HumanEval
92%38.4%
Overview
CompanyAnthropicMistral
Release dateJun 20 2024May 22 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Claude 3.5 Sonnet leads Mistral 7B v0.3 on 1 of the 1 benchmark they both report (HumanEval). Mistral 7B v0.3 shipped 29 days before Claude 3.5 Sonnet, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.5 Sonnet) vs 32k (Mistral 7B v0.3). Claude 3.5 Sonnet is closed, while Mistral 7B v0.3 is open weight.

On HumanEval, Claude 3.5 Sonnet leads at 92% vs Mistral 7B v0.3 at 38.4%.