Compare AI models

Specifications
Parameters
—7B
Context window
200k32k
Benchmarks
HumanEval
88.1%38.4%
Overview
CompanyAnthropicMistral
Release dateOct 22 2024May 22 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Claude 3.5 Haiku leads Mistral 7B v0.3 on 1 of the 1 benchmark they both report (HumanEval). Mistral 7B v0.3 shipped 153 days before Claude 3.5 Haiku, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3.5 Haiku) vs 32k (Mistral 7B v0.3). Claude 3.5 Haiku is closed, while Mistral 7B v0.3 is open weight.

On HumanEval, Claude 3.5 Haiku leads at 88.1% vs Mistral 7B v0.3 at 38.4%.