Compare AI models

Specifications
Parameters
—1.5B/7B/72B
Context window
8k4k
API pricing
Cheapest input
$30.00Azure—
Cheapest output
$60.00Azure—
$9,000Azure—
Benchmarks
GSM8K
92%95.9%
Overview
CompanyOpenAIQwen
Release dateMar 14 2023Sep 19 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Qwen2.5-Math leads GPT-4 on 1 of the 1 benchmark they both report (GSM8K). GPT-4 shipped 555 days before Qwen2.5-Math, so benchmark comparisons should account for the intervening progress.

Context windows are 8k (GPT-4) vs 4k (Qwen2.5-Math). GPT-4 is closed, while Qwen2.5-Math is open weight.

On GSM8K, Qwen2.5-Math leads at 95.9% vs GPT-4 at 92%.