Compare AI models

Specifications
Parameters
5.1B/8B/26B/31B4B/30B/235B
Context window
—256k
API pricing
Cheapest input
$0.04Darkbloom—
Cheapest output
$0.10Modal—
$15.50Darkbloom—
Benchmarks
LiveCodeBench
80%74.1%
GPQA Diamond
84.3%81.1%
MMLU-Pro
85.2%84.4%
Overview
CompanyGoogleQwen
Release dateApr 2 2026Jul 21 2025
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Gemma 4 leads Qwen3-2507 on 3 of the 3 benchmarks they both report (LiveCodeBench, GPQA Diamond, MMLU-Pro). Qwen3-2507 shipped 255 days before Gemma 4, so benchmark comparisons should account for the intervening progress.

Gemma 4 has 5.1B/8B/26B/31B parameters, while Qwen3-2507 has 4B/30B/235B.

On LiveCodeBench, Gemma 4 leads at 80% vs Qwen3-2507 at 74.1%. On GPQA Diamond, Gemma 4 leads at 84.3% vs Qwen3-2507 at 81.1%. On MMLU-Pro, Gemma 4 leads at 85.2% vs Qwen3-2507 at 84.4%.