Compare AI models

Specifications
Parameters
—51B
Context window
100k128k
Benchmarks
GSM8K
86.7%91.43%
Overview
CompanyAnthropicNVIDIA
Release dateAug 9 2023Sep 23 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Llama 3.1 Nemotron 51B leads Claude Instant 1.2 on 1 of the 1 benchmark they both report (GSM8K). Claude Instant 1.2 shipped 411 days before Llama 3.1 Nemotron 51B, so benchmark comparisons should account for the intervening progress.

Context windows are 100k (Claude Instant 1.2) vs 128k (Llama 3.1 Nemotron 51B). Claude Instant 1.2 is closed, while Llama 3.1 Nemotron 51B is open weight.

On GSM8K, Llama 3.1 Nemotron 51B leads at 91.43% vs Claude Instant 1.2 at 86.7%.