Compare AI models

Specifications
Parameters
8B6B
Context window
4k8k
Benchmarks
HellaSwag
76.4%79.7%
MMLU
54.4%61.4%
Overview
CompanyNVIDIAZ.ai
Release dateNov 15 2023Oct 27 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

ChatGLM3-6B leads Nemotron-3 8B on 2 of the 2 benchmarks they both report (HellaSwag, MMLU). ChatGLM3-6B shipped 19 days before Nemotron-3 8B, so benchmark comparisons should account for the intervening progress.

Nemotron-3 8B has 8B parameters, while ChatGLM3-6B has 6B. Context windows are 4k (Nemotron-3 8B) vs 8k (ChatGLM3-6B).

On HellaSwag, ChatGLM3-6B leads at 79.7% vs Nemotron-3 8B at 76.4%. On MMLU, ChatGLM3-6B leads at 61.4% vs Nemotron-3 8B at 54.4%.