Compare AI models

Specifications
Parameters
—7B/14B
Context window
1M1M
API pricing
Input price
$0.40—
Output price
$1.60—
Cached input price
$0.10—
Cheapest input
$0.40Azure—
Cheapest output
$1.60Azure—
$160OpenAI list price—
Benchmarks
HumanEval
93.8%88.4%
IFEval
84.1%84.3%
Overview
CompanyOpenAIQwen
Release dateApr 14 2025Jan 27 2025
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

GPT-4.1 mini and Qwen2.5-1M are evenly matched across the 2 benchmarks they both report (HumanEval, IFEval). Only GPT-4.1 mini has a verified first-party price for an available API: $0.40 per million input tokens and $1.60 per million output tokens. No currently available pay-as-you-go API rate is tracked for Qwen2.5-1M. Qwen2.5-1M shipped 77 days before GPT-4.1 mini, so benchmark comparisons should account for the intervening progress.

Context windows are 1M (GPT-4.1 mini) vs 1M (Qwen2.5-1M). GPT-4.1 mini is closed, while Qwen2.5-1M is open weight.

On HumanEval, GPT-4.1 mini leads at 93.8% vs Qwen2.5-1M at 88.4%. On IFEval, Qwen2.5-1M leads at 84.3% vs GPT-4.1 mini at 84.1%.