Compare AI models

Specifications
Parameters
—27B
Context window
200k256k
Benchmarks
SWE-Bench Verified
7.2%77.2%
GPQA Diamond
33.3%87.8%
MMMU
50.2%82.9%
Overview
CompanyAnthropicQwen
Release dateMar 4 2024Apr 22 2026
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Qwen3.6-27B leads Claude 3 Haiku on 3 of the 3 benchmarks they both report (SWE-Bench Verified, GPQA Diamond, MMMU). Claude 3 Haiku shipped 779 days before Qwen3.6-27B, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (Claude 3 Haiku) vs 256k (Qwen3.6-27B). Claude 3 Haiku is closed, while Qwen3.6-27B is open weight.

On SWE-Bench Verified, Qwen3.6-27B leads at 77.2% vs Claude 3 Haiku at 7.2%. On GPQA Diamond, Qwen3.6-27B leads at 87.8% vs Claude 3 Haiku at 33.3%. On MMMU, Qwen3.6-27B leads at 82.9% vs Claude 3 Haiku at 50.2%.