Compare AI models

Specifications
Parameters
—16B
Context window
32k8k
Benchmarks
HumanEval
74.4%48.1%
MATH
53.2%45.3%
MMLU
83.7%70%
GSM8K
88.9%77.4%
Overview
CompanyGoogleMoonshot AI
Release dateFeb 8 2024Feb 22 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Gemini 1.0 Ultra leads Moonlight on 4 of the 4 benchmarks they both report (HumanEval, MATH, MMLU, GSM8K). Gemini 1.0 Ultra shipped 380 days before Moonlight, so benchmark comparisons should account for the intervening progress.

Context windows are 32k (Gemini 1.0 Ultra) vs 8k (Moonlight). Gemini 1.0 Ultra is closed, while Moonlight is open weight.

On HumanEval, Gemini 1.0 Ultra leads at 74.4% vs Moonlight at 48.1%. On MATH, Gemini 1.0 Ultra leads at 53.2% vs Moonlight at 45.3%. On MMLU, Gemini 1.0 Ultra leads at 83.7% vs Moonlight at 70%. On GSM8K, Gemini 1.0 Ultra leads at 88.9% vs Moonlight at 77.4%.