Compare AI models

Specifications
Parameters
—7B
Context window
32k32k
Benchmarks
HumanEval
67.7%38.4%
MATH
32.6%13.2%
Overview
CompanyGoogleMistral
Release dateDec 13 2023May 22 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Gemini 1.0 Pro leads Mistral 7B v0.3 on 2 of the 2 benchmarks they both report (HumanEval, MATH). Gemini 1.0 Pro shipped 161 days before Mistral 7B v0.3, so benchmark comparisons should account for the intervening progress.

Context windows are 32k (Gemini 1.0 Pro) vs 32k (Mistral 7B v0.3). Gemini 1.0 Pro is closed, while Mistral 7B v0.3 is open weight.

On HumanEval, Gemini 1.0 Pro leads at 67.7% vs Mistral 7B v0.3 at 38.4%. On MATH, Gemini 1.0 Pro leads at 32.6% vs Mistral 7B v0.3 at 13.2%.