Compare AI models

Specifications
Parameters
5.1B/8B/26B/31B—
Context window
—1M
API pricing
Cheapest input
$0.04Darkbloom—
Cheapest output
$0.10Modal—
$15.50Darkbloom—
Benchmarks
LiveCodeBench
80%37.8%
MMLU-Pro
85.2%64.5%
Overview
CompanyGoogleQwen
Release dateApr 2 2026Nov 15 2024
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Gemma 4 leads Qwen2.5-Turbo (1M) on 2 of the 2 benchmarks they both report (LiveCodeBench, MMLU-Pro). Qwen2.5-Turbo (1M) shipped 503 days before Gemma 4, so benchmark comparisons should account for the intervening progress.

Gemma 4 is open weight, while Qwen2.5-Turbo (1M) is closed.

On LiveCodeBench, Gemma 4 leads at 80% vs Qwen2.5-Turbo (1M) at 37.8%. On MMLU-Pro, Gemma 4 leads at 85.2% vs Qwen2.5-Turbo (1M) at 64.5%.