Compare AI models

Specifications
Parameters
—4B/30B/235B
Context window
1M256k
Benchmarks
LiveCodeBench
30%74.1%
GPQA Diamond
51%81.1%
MMLU-Pro
67.3%84.4%
Overview
CompanyGoogleQwen
Release dateSep 24 2024Jul 21 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Qwen3-2507 leads Gemini 1.5 Flash-002 on 3 of the 3 benchmarks they both report (LiveCodeBench, GPQA Diamond, MMLU-Pro). Gemini 1.5 Flash-002 shipped 300 days before Qwen3-2507, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (Gemini 1.5 Flash-002) vs 256k (Qwen3-2507). Gemini 1.5 Flash-002 is closed, while Qwen3-2507 is open weight.

On LiveCodeBench, Qwen3-2507 leads at 74.1% vs Gemini 1.5 Flash-002 at 30%. On GPQA Diamond, Qwen3-2507 leads at 81.1% vs Gemini 1.5 Flash-002 at 51%. On MMLU-Pro, Qwen3-2507 leads at 84.4% vs Gemini 1.5 Flash-002 at 67.3%.