ChatGLM2-6BOpen Weight
Released
ChatGLM2-6B is an AI model released by Z.ai on Sunday, Jun 25 2023, 103 days after ChatGLM-6B. It is an open-weight model — the trained weights are available to download and run. It is a 6B parameterThe learned values that shape how a model responds. B means billion and T means trillion. For mixture-of-experts models, the total count is larger than the number active for each token. Parameter count alone does not measure quality. model with a 32k token context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider.. Benchmark results (shown below) cover HumanEval, MATH, HellaSwag, MMLU, and GSM8K.
Get Z.ai releases and AI news.
Every other Monday
Benchmarks
Coding
Reasoning & science
Compare ChatGLM2-6B with
Suggested comparisons
ChatGLM2-6BvsGLM-5.3-FlashChatGLM2-6BvsGPT-6.2 AstraChatGLM2-6BvsClaude Fable 5.2ChatGLM2-6BvsGemini 4 HydrogenChatGLM2-6BvsMuse EmberChatGLM2-6BvsGrok 4.7ChatGLM2-6BvsDeepSeek-V4.1-Flash-1017ChatGLM2-6BvsMistral Large 4ChatGLM2-6BvsKimi K3.1 ProChatGLM2-6BvsQwen4-MaxChatGLM2-6BvsNemotron 3.5 Bolt E4B 4GBAbout
ChatGLM2-6B was the second generation of Zhipu AI and Tsinghua's bilingual assistant. The team trained a new checkpoint and used multi-query attention to make inference faster. FlashAttention helped extend the sequence length beyond the first generation's 2K tokens.
The initial model supported sequences up to 32K, with dialogue alignment trained at 8K. The GLM team's later family report measured 45.2% on MMLU and 25.9% on GSM8K for this checkpoint.
Frequently asked questions
ChatGLM2-6B was released by Z.ai on Sunday, Jun 25 2023.