Compare AI models

Specifications
Parameters
16B—
Context window
8k128k
Benchmarks
HumanEval
48.1%92.4%
GPQA Diamond
35.2%73.3%
MMLU
70%90.8%
Overview
CompanyMoonshot AIOpenAI
Release dateFeb 22 2025Sep 12 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

o1-preview leads Moonlight on 3 of the 3 benchmarks they both report (HumanEval, GPQA Diamond, MMLU). o1-preview shipped 163 days before Moonlight, so benchmark comparisons should account for the intervening progress.

Context windows are 8k (Moonlight) vs 128k (o1-preview). Moonlight is open weight, while o1-preview is closed.

On HumanEval, o1-preview leads at 92.4% vs Moonlight at 48.1%. On GPQA Diamond, o1-preview leads at 73.3% vs Moonlight at 35.2%. On MMLU, o1-preview leads at 90.8% vs Moonlight at 70%.