Compare AI models

Specifications
Parameters
—49B
Context window
1M128k
Benchmarks
LiveCodeBench
30%73.58%
GPQA Diamond
51%71.97%
MMLU-Pro
67.3%79.53%
Overview
CompanyGoogleNVIDIA
Release dateSep 24 2024Jul 25 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama Nemotron Super 49B v1.5 leads Gemini 1.5 Flash-002 on 3 of the 3 benchmarks they both report (LiveCodeBench, GPQA Diamond, MMLU-Pro). Gemini 1.5 Flash-002 shipped 304 days before Llama Nemotron Super 49B v1.5, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 1.5 Flash-002) vs 128k (Llama Nemotron Super 49B v1.5). Gemini 1.5 Flash-002 is closed, while Llama Nemotron Super 49B v1.5 is open weight.

On LiveCodeBench, Llama Nemotron Super 49B v1.5 leads at 73.58% vs Gemini 1.5 Flash-002 at 30%. On GPQA Diamond, Llama Nemotron Super 49B v1.5 leads at 71.97% vs Gemini 1.5 Flash-002 at 51%. On MMLU-Pro, Llama Nemotron Super 49B v1.5 leads at 79.53% vs Gemini 1.5 Flash-002 at 67.3%.