Compare AI models

Specifications
Parameters
70B9B
Context window
16k128k
Benchmarks
HumanEval
53%82.3%
Overview
CompanyMetaZ.ai
Release dateJan 29 2024Jul 5 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

CodeGeeX4-ALL-9B leads Code Llama 70B on 1 of the 1 benchmark they both report (HumanEval). Code Llama 70B shipped 158 days before CodeGeeX4-ALL-9B, so benchmark comparisons should account for the intervening progress.

Code Llama 70B has 70B parameters, while CodeGeeX4-ALL-9B has 9B. Context windows are 16k (Code Llama 70B) vs 128k (CodeGeeX4-ALL-9B).

On HumanEval, CodeGeeX4-ALL-9B leads at 82.3% vs Code Llama 70B at 53%.