Compare AI models

Specifications
Parameters
8B6B
Context window
4k32k
Benchmarks
HellaSwag
76.4%57%
MMLU
54.4%45.2%
Overview
CompanyNVIDIAZ.ai
Release dateNov 15 2023Jun 25 2023
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Nemotron-3 8B leads ChatGLM2-6B on 2 of the 2 benchmarks they both report (HellaSwag, MMLU). ChatGLM2-6B shipped 143 days before Nemotron-3 8B, so benchmark comparisons should account for the intervening progress.

Nemotron-3 8B has 8B parameters, while ChatGLM2-6B has 6B. Context windows are 4k (Nemotron-3 8B) vs 32k (ChatGLM2-6B).

On HellaSwag, Nemotron-3 8B leads at 76.4% vs ChatGLM2-6B at 57%. On MMLU, Nemotron-3 8B leads at 54.4% vs ChatGLM2-6B at 45.2%.