Compare AI models

Specifications
Parameters
1.8B/3.25B51B
Context window
32k128k
Benchmarks
MMLU
55.8%80.2%
Overview
CompanyGoogleNVIDIA
Release dateDec 6 2023Sep 23 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama 3.1 Nemotron 51B leads Gemini 1.0 Nano on 1 of the 1 benchmark they both report (MMLU). Gemini 1.0 Nano shipped 292 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

Gemini 1.0 Nano has 1.8B/3.25B parameters, while Llama 3.1 Nemotron 51B has 51B. Context windows are 32k (Gemini 1.0 Nano) vs 128k (Llama 3.1 Nemotron 51B). Gemini 1.0 Nano is closed, while Llama 3.1 Nemotron 51B is open weight.

On MMLU, Llama 3.1 Nemotron 51B leads at 80.2% vs Gemini 1.0 Nano at 55.8%.