Compare AI models

Specifications
Parameters
1B/4B/12B/27B4B
Context window
—128k
API pricing
Cheapest input
$0.04DeepInfra—
Cheapest output
$0.05Parasail—
$10.50Parasail · bf16—
Benchmarks
IFEval
90.4%75.5%
GPQA Diamond
42.4%55.1%
Overview
CompanyGoogleNVIDIA
Release dateMar 12 2025May 20 2025
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Gemma 3 and Llama Nemotron Nano 4B v1.1 are evenly matched across the 2 benchmarks they both report (IFEval, GPQA Diamond). Gemma 3 shipped 69 days before Llama Nemotron Nano 4B v1.1, so benchmark comparisons should account for the intervening progress.

Gemma 3 has 1B/4B/12B/27B parameters, while Llama Nemotron Nano 4B v1.1 has 4B.

On IFEval, Gemma 3 leads at 90.4% vs Llama Nemotron Nano 4B v1.1 at 75.5%. On GPQA Diamond, Llama Nemotron Nano 4B v1.1 leads at 55.1% vs Gemma 3 at 42.4%.