Compare AI models

Specifications
Parameters
—1.5B/7B/72B
Context window
100k4k
Benchmarks
GSM8K
86.7%95.9%
Overview
CompanyAnthropicQwen
Release dateAug 9 2023Sep 19 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Qwen2.5-Math leads Claude Instant 1.2 on 1 of the 1 benchmark they both report (GSM8K). Claude Instant 1.2 shipped 407 days before Qwen2.5-Math, so benchmark comparisons should account for the intervening progress.

Context windows are 100k (Claude Instant 1.2) vs 4k (Qwen2.5-Math). Claude Instant 1.2 is closed, while Qwen2.5-Math is open weight.

On GSM8K, Qwen2.5-Math leads at 95.9% vs Claude Instant 1.2 at 86.7%.