Compare AI models

Specifications
Parameters
9B/27B7B
Context window
8k64k
API pricing
Cheapest input
$0.65NextBit—
Cheapest output
$0.65NextBit—
$163NextBit · int4—
Benchmarks
HumanEval
51.8%83.5%
Overview
CompanyGoogleQwen
Release dateJun 27 2024Apr 16 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

CodeQwen1.5 leads Gemma 2 on 1 of the 1 benchmark they both report (HumanEval). CodeQwen1.5 shipped 72 days before Gemma 2, so benchmark comparisons should account for the intervening progress.

Gemma 2 has 9B/27B parameters, while CodeQwen1.5 has 7B. Context windows are 8k (Gemma 2) vs 64k (CodeQwen1.5).

On HumanEval, CodeQwen1.5 leads at 83.5% vs Gemma 2 at 51.8%.