Compare AI models

Specifications
Parameters
8B6B
Context window
4k2k
Benchmarks
HellaSwag
76.4%30.4%
MMLU
54.4%25.2%
Overview
CompanyNVIDIAZ.ai
Release dateNov 15 2023Mar 14 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Nemotron-3 8B leads ChatGLM-6B on 2 of the 2 benchmarks they both report (HellaSwag, MMLU). ChatGLM-6B shipped 246 days before Nemotron-3 8B, so benchmark comparisons should account for the intervening progress.

Nemotron-3 8B has 8B parameters, while ChatGLM-6B has 6B. Context windows are 4k (Nemotron-3 8B) vs 2k (ChatGLM-6B).

On HellaSwag, Nemotron-3 8B leads at 76.4% vs ChatGLM-6B at 30.4%. On MMLU, Nemotron-3 8B leads at 54.4% vs ChatGLM-6B at 25.2%.