Compare AI models

Specifications
Parameters
—7B
Context window
32k64k
Benchmarks
HumanEval
74.4%83.5%
Overview
CompanyGoogleQwen
Release dateFeb 8 2024Apr 16 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

CodeQwen1.5 leads Gemini 1.0 Ultra on 1 of the 1 benchmark they both report (HumanEval). Gemini 1.0 Ultra shipped 68 days before CodeQwen1.5, so benchmark comparisons should account for the intervening progress.

Context windows are 32k (Gemini 1.0 Ultra) vs 64k (CodeQwen1.5). Gemini 1.0 Ultra is closed, while CodeQwen1.5 is open weight.

On HumanEval, CodeQwen1.5 leads at 83.5% vs Gemini 1.0 Ultra at 74.4%.