Compare AI models

Specifications
Parameters
—0.5B/1.5B/7B/57B/72B
Context window
100k128k
Benchmarks
HumanEval
58.7%86%
GSM8K
86.7%91.1%
Overview
CompanyAnthropicQwen
Release dateAug 9 2023Jun 6 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Qwen2 leads Claude Instant 1.2 on 2 of the 2 benchmarks they both report (HumanEval, GSM8K). Claude Instant 1.2 shipped 302 days before Qwen2, so benchmark comparisons should account for the intervening progress.

Context windows are 100k (Claude Instant 1.2) vs 128k (Qwen2). Claude Instant 1.2 is closed, while Qwen2 is open weight.

On HumanEval, Qwen2 leads at 86% vs Claude Instant 1.2 at 58.7%. On GSM8K, Qwen2 leads at 91.1% vs Claude Instant 1.2 at 86.7%.