Compare AI models

Specifications
Parameters
47B9B
Context window
32k128k
Benchmarks
HumanEval
40.2%82.3%
Overview
CompanyMistralZ.ai
Release dateDec 8 2023Jul 5 2024
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

CodeGeeX4-ALL-9B leads Mixtral 8×7B on 1 of the 1 benchmark they both report (HumanEval). Mixtral 8×7B shipped 210 days before CodeGeeX4-ALL-9B, so benchmark comparisons should account for the intervening progress.

Mixtral 8×7B has 47B parameters, while CodeGeeX4-ALL-9B has 9B. Context windows are 32k (Mixtral 8×7B) vs 128k (CodeGeeX4-ALL-9B).

On HumanEval, CodeGeeX4-ALL-9B leads at 82.3% vs Mixtral 8×7B at 40.2%.