Compare AI models

Specifications
Parameters
—49B
Context window
1M128k
Benchmarks
LiveCodeBench
35.1%73.58%
GPQA Diamond
62.1%71.97%
MMLU-Pro
76.4%79.53%
Overview
CompanyGoogleNVIDIA
Release dateDec 11 2024Jul 25 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama Nemotron Super 49B v1.5 leads Gemini 2.0 Flash on 3 of the 3 benchmarks they both report (LiveCodeBench, GPQA Diamond, MMLU-Pro). Gemini 2.0 Flash shipped 226 days before Llama Nemotron Super 49B v1.5, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 2.0 Flash) vs 128k (Llama Nemotron Super 49B v1.5). Gemini 2.0 Flash is closed, while Llama Nemotron Super 49B v1.5 is open weight.

On LiveCodeBench, Llama Nemotron Super 49B v1.5 leads at 73.58% vs Gemini 2.0 Flash at 35.1%. On GPQA Diamond, Llama Nemotron Super 49B v1.5 leads at 71.97% vs Gemini 2.0 Flash at 62.1%. On MMLU-Pro, Llama Nemotron Super 49B v1.5 leads at 79.53% vs Gemini 2.0 Flash at 76.4%.