Compare AI models

Specifications
Parameters
—49B
Context window
2M128k
Benchmarks
LiveCodeBench
34.3%73.58%
GPQA Diamond
59.1%71.97%
MMLU-Pro
75.8%79.53%
Overview
CompanyGoogleNVIDIA
Release dateSep 24 2024Jul 25 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama Nemotron Super 49B v1.5 leads Gemini 1.5 Pro-002 on 3 of the 3 benchmarks they both report (LiveCodeBench, GPQA Diamond, MMLU-Pro). Gemini 1.5 Pro-002 shipped 304 days before Llama Nemotron Super 49B v1.5, so benchmark comparisons should account for the intervening progress.

Context windows are 2M (Gemini 1.5 Pro-002) vs 128k (Llama Nemotron Super 49B v1.5). Gemini 1.5 Pro-002 is closed, while Llama Nemotron Super 49B v1.5 is open weight.

On LiveCodeBench, Llama Nemotron Super 49B v1.5 leads at 73.58% vs Gemini 1.5 Pro-002 at 34.3%. On GPQA Diamond, Llama Nemotron Super 49B v1.5 leads at 71.97% vs Gemini 1.5 Pro-002 at 59.1%. On MMLU-Pro, Llama Nemotron Super 49B v1.5 leads at 79.53% vs Gemini 1.5 Pro-002 at 75.8%.