Compare AI models

Specifications
Parameters
—49B
Context window
2M128k
Benchmarks
LiveCodeBench
36%73.58%
GPQA Diamond
64.7%71.97%
MMLU-Pro
79.1%79.53%
Overview
CompanyGoogleNVIDIA
Release dateFeb 5 2025Jul 25 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama Nemotron Super 49B v1.5 leads Gemini 2.0 Pro on 3 of the 3 benchmarks they both report (LiveCodeBench, GPQA Diamond, MMLU-Pro). Gemini 2.0 Pro shipped 170 days before Llama Nemotron Super 49B v1.5, so benchmark comparisons should account for the intervening progress.

Context windows are 2M (Gemini 2.0 Pro) vs 128k (Llama Nemotron Super 49B v1.5). Gemini 2.0 Pro is closed, while Llama Nemotron Super 49B v1.5 is open weight.

On LiveCodeBench, Llama Nemotron Super 49B v1.5 leads at 73.58% vs Gemini 2.0 Pro at 36%. On GPQA Diamond, Llama Nemotron Super 49B v1.5 leads at 71.97% vs Gemini 2.0 Pro at 64.7%. On MMLU-Pro, Llama Nemotron Super 49B v1.5 leads at 79.53% vs Gemini 2.0 Pro at 79.1%.