Compare AI models

Specifications
Parameters
—8B
Context window
32k4k
Benchmarks
HellaSwag
84.7%76.4%
MMLU
71.8%54.4%
Overview
CompanyGoogleNVIDIA
Release dateDec 13 2023Nov 15 2023
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Gemini 1.0 Pro leads Nemotron-3 8B on 2 of the 2 benchmarks they both report (HellaSwag, MMLU). Nemotron-3 8B shipped 28 days before Gemini 1.0 Pro, so benchmark comparisons should account for the intervening progress.

Context windows are 32k (Gemini 1.0 Pro) vs 4k (Nemotron-3 8B). Gemini 1.0 Pro is closed, while Nemotron-3 8B is open weight.

On HellaSwag, Gemini 1.0 Pro leads at 84.7% vs Nemotron-3 8B at 76.4%. On MMLU, Gemini 1.0 Pro leads at 71.8% vs Nemotron-3 8B at 54.4%.