Compare AI models

Specifications
Parameters
8B51B
Context window
1M128k
Benchmarks
MMLU
68.1%80.2%
Overview
CompanyGoogleNVIDIA
Release dateOct 3 2024Sep 23 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama 3.1 Nemotron 51B leads Gemini 1.5 Flash-8B on 1 of the 1 benchmark they both report (MMLU). Llama 3.1 Nemotron 51B shipped 10 days before Gemini 1.5 Flash-8B, so benchmark comparisons should account for the intervening progress.

Gemini 1.5 Flash-8B has 8B parameters, while Llama 3.1 Nemotron 51B has 51B. Context windows are 1M (Gemini 1.5 Flash-8B) vs 128k (Llama 3.1 Nemotron 51B). Gemini 1.5 Flash-8B is closed, while Llama 3.1 Nemotron 51B is open weight.

On MMLU, Llama 3.1 Nemotron 51B leads at 80.2% vs Gemini 1.5 Flash-8B at 68.1%.