Compare AI models

Specifications
Parameters
—7B
Context window
200k64k
Benchmarks
HumanEval
75.9%83.5%
Overview
CompanyAnthropicQwen
Release dateMar 4 2024Apr 16 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

CodeQwen1.5 leads Claude 3 Haiku on 1 of the 1 benchmark they both report (HumanEval). Claude 3 Haiku shipped 43 days before CodeQwen1.5, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3 Haiku) vs 64k (CodeQwen1.5). Claude 3 Haiku is closed, while CodeQwen1.5 is open weight.

On HumanEval, CodeQwen1.5 leads at 83.5% vs Claude 3 Haiku at 75.9%.