Compare AI models

Specifications
Parameters
8B/70B9B
Context window
8k128k
Benchmarks
HumanEval
81.7%82.3%
Overview
CompanyMetaZ.ai
Release dateApr 18 2024Jul 5 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

CodeGeeX4-ALL-9B leads LLaMA 3 (8B/70B) on 1 of the 1 benchmark they both report (HumanEval). LLaMA 3 (8B/70B) shipped 78 days before CodeGeeX4-ALL-9B, so benchmark comparisons should account for the intervening progress.

LLaMA 3 (8B/70B) has 8B/70B parameters, while CodeGeeX4-ALL-9B has 9B. Context windows are 8k (LLaMA 3 (8B/70B)) vs 128k (CodeGeeX4-ALL-9B).

On HumanEval, CodeGeeX4-ALL-9B leads at 82.3% vs LLaMA 3 (8B/70B) at 81.7%.