Compare AI models

Specifications
Parameters
2B/7B8B
Context window
8k4k
Benchmarks
HellaSwag
81.2%76.4%
MMLU
64.3%54.4%
Overview
CompanyGoogleNVIDIA
Release dateFeb 21 2024Nov 15 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Gemma 1 leads Nemotron-3 8B on 2 of the 2 benchmarks they both report (HellaSwag, MMLU). Nemotron-3 8B shipped 98 days before Gemma 1, so benchmark comparisons should account for the intervening progress.

Gemma 1 has 2B/7B parameters, while Nemotron-3 8B has 8B. Context windows are 8k (Gemma 1) vs 4k (Nemotron-3 8B).

On HellaSwag, Gemma 1 leads at 81.2% vs Nemotron-3 8B at 76.4%. On MMLU, Gemma 1 leads at 64.3% vs Nemotron-3 8B at 54.4%.