Compare AI models

Specifications
Parameters
16B—
Context window
32k1M
Benchmarks
HumanEval
57.3%74.3%
MATH
27.9%54.9%
MMLU
55.7%78.9%
GSM8K
72%86.2%
Overview
CompanyDeepSeekGoogle
Release dateMay 16 2024May 14 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Gemini 1.5 Flash leads DeepSeek V2 Lite on 4 of the 4 benchmarks they both report (HumanEval, MATH, MMLU, GSM8K). Gemini 1.5 Flash shipped 2 days before DeepSeek V2 Lite, so benchmark comparisons should account for the intervening progress.

Context windows are 32k (DeepSeek V2 Lite) vs 1M (Gemini 1.5 Flash). DeepSeek V2 Lite is open weight, while Gemini 1.5 Flash is closed.

On HumanEval, Gemini 1.5 Flash leads at 74.3% vs DeepSeek V2 Lite at 57.3%. On MATH, Gemini 1.5 Flash leads at 54.9% vs DeepSeek V2 Lite at 27.9%. On MMLU, Gemini 1.5 Flash leads at 78.9% vs DeepSeek V2 Lite at 55.7%. On GSM8K, Gemini 1.5 Flash leads at 86.2% vs DeepSeek V2 Lite at 72%.