Compare AI models

Specifications
Parameters
—7B/14B
Context window
2M1M
Benchmarks
LiveCodeBench
36%38.6%
MATH
91.8%79.5%
MMLU-Pro
79.1%63.3%
Overview
CompanyGoogleQwen
Release dateFeb 5 2025Jan 27 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Gemini 2.0 Pro leads Qwen2.5-1M on 2 of the 3 benchmarks they both report (LiveCodeBench, MATH, MMLU-Pro). Qwen2.5-1M shipped 9 days before Gemini 2.0 Pro, so benchmark comparisons should account for the intervening progress.

Context windows are 2M (Gemini 2.0 Pro) vs 1M (Qwen2.5-1M). Gemini 2.0 Pro is closed, while Qwen2.5-1M is open weight.

On LiveCodeBench, Qwen2.5-1M leads at 38.6% vs Gemini 2.0 Pro at 36%. On MATH, Gemini 2.0 Pro leads at 91.8% vs Qwen2.5-1M at 79.5%. On MMLU-Pro, Gemini 2.0 Pro leads at 79.1% vs Qwen2.5-1M at 63.3%.