Compare AI models

Specifications
Parameters
—6B
Context window
200k32k
API pricing
Input price
$2.00—
Output price
$8.00—
Cached input price
$0.50—
Cheapest input
$2.00OpenAI—
Cheapest output
$8.00OpenAI—
$800OpenAI list price—
Benchmarks
HumanEval
87.4%9.8%
MMLU
92.9%45.2%
Overview
CompanyOpenAIZ.ai
Release dateApr 16 2025Jun 25 2023
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

o3 leads ChatGLM2-6B on 2 of the 2 benchmarks they both report (HumanEval, MMLU). Only o3 has a verified first-party price for an available API: $2.00 per million input tokens and $8.00 per million output tokens. No currently available pay-as-you-go API rate is tracked for ChatGLM2-6B. ChatGLM2-6B shipped 661 days before o3, so benchmark comparisons should account for the intervening progress.

Context windows are 200k (o3) vs 32k (ChatGLM2-6B). o3 is closed, while ChatGLM2-6B is open weight.

On HumanEval, o3 leads at 87.4% vs ChatGLM2-6B at 9.8%. On MMLU, o3 leads at 92.9% vs ChatGLM2-6B at 45.2%.