Compare AI models

Specifications
Context window
1M1M
Benchmarks
LiveCodeBench
30%37.8%
MATH
77.9%81.1%
MMLU-Pro
67.3%64.5%
Overview
CompanyGoogleQwen
Release dateSep 24 2024Nov 15 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Qwen2.5-Turbo (1M) leads Gemini 1.5 Flash-002 on 2 of the 3 benchmarks they both report (LiveCodeBench, MATH, MMLU-Pro). Gemini 1.5 Flash-002 shipped 52 days before Qwen2.5-Turbo (1M), so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 1.5 Flash-002) vs 1M (Qwen2.5-Turbo (1M)).

On LiveCodeBench, Qwen2.5-Turbo (1M) leads at 37.8% vs Gemini 1.5 Flash-002 at 30%. On MATH, Qwen2.5-Turbo (1M) leads at 81.1% vs Gemini 1.5 Flash-002 at 77.9%. On MMLU-Pro, Gemini 1.5 Flash-002 leads at 67.3% vs Qwen2.5-Turbo (1M) at 64.5%.