Compare AI models

Specifications
Context window
128k1M
Benchmarks
HumanEval
83.7%86.6%
MATH
64.3%81.1%
Overview
CompanyOpenAIQwen
Release dateNov 6 2023Nov 15 2024
AccessClosedClosed
Model detailsView modelView model

Frequently asked questions

Qwen2.5-Turbo (1M) leads GPT-4 Turbo on 2 of the 2 benchmarks they both report (HumanEval, MATH). GPT-4 Turbo shipped 375 days before Qwen2.5-Turbo (1M), so benchmark comparisons should account for the intervening progress.

Context windows are 128k (GPT-4 Turbo) vs 1M (Qwen2.5-Turbo (1M)).

On HumanEval, Qwen2.5-Turbo (1M) leads at 86.6% vs GPT-4 Turbo at 83.7%. On MATH, Qwen2.5-Turbo (1M) leads at 81.1% vs GPT-4 Turbo at 64.3%.