Compare AI models

Specifications
Context window
1M1M
Benchmarks
LiveCodeBench
35.1%37.8%
MMLU-Pro
76.4%64.5%
Overview
CompanyGoogleQwen
Release dateDec 11 2024Nov 15 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Gemini 2.0 Flash and Qwen2.5-Turbo (1M) are evenly matched across the 2 benchmarks they both report (LiveCodeBench, MMLU-Pro). Qwen2.5-Turbo (1M) shipped 26 days before Gemini 2.0 Flash, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 2.0 Flash) vs 1M (Qwen2.5-Turbo (1M)).

On LiveCodeBench, Qwen2.5-Turbo (1M) leads at 37.8% vs Gemini 2.0 Flash at 35.1%. On MMLU-Pro, Gemini 2.0 Flash leads at 76.4% vs Qwen2.5-Turbo (1M) at 64.5%.