Compare AI models

Specifications
Parameters
1B/4B/12B/27B49B
Context window
—128k
API pricing
Cheapest input
$0.04DeepInfra—
Cheapest output
$0.05Parasail—
$10.50Parasail · bf16—
Benchmarks
LiveCodeBench
29.7%73.58%
GPQA Diamond
42.4%71.97%
MMLU-Pro
67.5%79.53%
Overview
CompanyGoogleNVIDIA
Release dateMar 12 2025Jul 25 2025
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama Nemotron Super 49B v1.5 leads Gemma 3 on 3 of the 3 benchmarks they both report (LiveCodeBench, GPQA Diamond, MMLU-Pro). Gemma 3 shipped 135 days before Llama Nemotron Super 49B v1.5, so benchmark comparisons should account for the intervening progress.

Gemma 3 has 1B/4B/12B/27B parameters, while Llama Nemotron Super 49B v1.5 has 49B.

On LiveCodeBench, Llama Nemotron Super 49B v1.5 leads at 73.58% vs Gemma 3 at 29.7%. On GPQA Diamond, Llama Nemotron Super 49B v1.5 leads at 71.97% vs Gemma 3 at 42.4%. On MMLU-Pro, Llama Nemotron Super 49B v1.5 leads at 79.53% vs Gemma 3 at 67.5%.