Compare AI models

Specifications
Parameters
—49B
Context window
1M128k
Benchmarks
LiveCodeBench
28.9%73.58%
GPQA Diamond
51.5%71.97%
MMLU-Pro
71.6%79.53%
Overview
CompanyGoogleNVIDIA
Release dateFeb 5 2025Jul 25 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama Nemotron Super 49B v1.5 leads Gemini 2.0 Flash-Lite on 3 of the 3 benchmarks they both report (LiveCodeBench, GPQA Diamond, MMLU-Pro). Gemini 2.0 Flash-Lite shipped 170 days before Llama Nemotron Super 49B v1.5, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 2.0 Flash-Lite) vs 128k (Llama Nemotron Super 49B v1.5). Gemini 2.0 Flash-Lite is closed, while Llama Nemotron Super 49B v1.5 is open weight.

On LiveCodeBench, Llama Nemotron Super 49B v1.5 leads at 73.58% vs Gemini 2.0 Flash-Lite at 28.9%. On GPQA Diamond, Llama Nemotron Super 49B v1.5 leads at 71.97% vs Gemini 2.0 Flash-Lite at 51.5%. On MMLU-Pro, Llama Nemotron Super 49B v1.5 leads at 79.53% vs Gemini 2.0 Flash-Lite at 71.6%.