Compare AI models

Specifications
Parameters
1B/3B/11B/90B6B
Context window
128k32k
API pricing
Cheapest input
$0.027Cloudflare—
Cheapest output
$0.201Cloudflare—
$15.45Cloudflare—
Benchmarks
MATH
68%6.9%
MMLU
86%45.2%
Overview
CompanyMetaZ.ai
Release dateSep 25 2024Jun 25 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

LLaMA 3.2 leads ChatGLM2-6B on 2 of the 2 benchmarks they both report (MATH, MMLU). ChatGLM2-6B shipped 458 days before LLaMA 3.2, so benchmark comparisons should account for the intervening progress.

LLaMA 3.2 has 1B/3B/11B/90B parameters, while ChatGLM2-6B has 6B. Context windows are 128k (LLaMA 3.2) vs 32k (ChatGLM2-6B).

On MATH, LLaMA 3.2 leads at 68% vs ChatGLM2-6B at 6.9%. On MMLU, LLaMA 3.2 leads at 86% vs ChatGLM2-6B at 45.2%.